Sounds like you've got yourself addicted mate. Welcome to the forum from the UK.
A large part of the problem is you've been having group sex or at least threesomes. You've got Jehovah watching and the Governing Body telling your partners what's good and bad! Maybe even Fred Franz is up there wagging his finger.
But then again ... try being open and loving and you'll probably get enough sex from your partner to keep it in your trousers when other females catch your eye.
When you focus on the "kind" of sex you get when the other person is happy with a "simpler" sex life the problem possibly lies with you?
More importantly, now you're out why not check out fully what it is you want to go back to. We can help.