I know how it is. It almost seems like the two of you getting together is a foregone conclusion, a marriage made in heaven. You get hints from others suggesting that you might be "compatible."
This will continue until one of you leaves or one of you makes a different choice. It sounds like both of those things are happening with you.
The only thing worse than breaking off a lousy relationship is letting it go on.