It sounds like you are playing with lust. Starting, but not going all the way. And then taking credit for not doing anything "really" bad. Feeling in control.
I played this game for decades. Start a little, but as long as there's no zera l'vatala, I think I'm alright. But, I didn't always succeed. And I probably failed more often than not. That's okay, I said to myself. I'll just analyze the situation, figure out what happened that made me go too far, and just be more careful next time. But next time, it was something different that led to the fall. So, I've got to watch out for THAT next time, too. And then something DIFFERENT, of course unexpected, caught me off guard next time.
For me, THAT was one of the signs of being an addict; playing with lust, thinking I was in control, but not really being in control. The AA analogy for this is like a drunk who figures he can't handle vodka, so he drinks beer instead. That doesn't work, so he switches to wine.
It was a HUGE step for me, for my recovery, to realize that IT'S ALL THE SAME THING! No matter what tricks I'm trying to do not to have zera l'vatala, the underlying motivation is always the same. I'M PLAYING WITH LUST. I'm a lust addict, even though I'm no doing anything "really wrong."
--Eye.