U know does sound like op is not on top of the mood and that can affect ur punts etc.
The only time when I wanted to stop punting was probably my mood and other aspects of my life - not the actual punt in itself.
I notice when my life is going well - my sexual desires are up and I am more playful with my girls
It's a good idea to sort urself out, if punting is affecting it then sure stop.
However when ur mood returns, u may feel like to punt again - did seem like u punted before ur relationship so it's not like it has to be it. If u do return to punting after u sort ur stuff out don't feel too much guilt