No - you will not always feel this way. Some of this "baggage" you will carry, like a scar for your whole life, true. BUT, you will learn to "forget" the scar, it will become un-noticeable after time. Your children will have an easier time of it - by the time they are adults they will have had opportunity to readjust.
Plus, as you meet more in the "world" and truly begin revolving life around something outside the truth, you realize that EVERYONE comes with their own quirks. They have their own baggage, their own scars. And then one day it WILL dawn on you, that you are, and always have been, more "alike" than you are different from everyone else around you. You just happened to follow a different path to getting to now.