You can overthink it to death, and make it more complicated (eg the way you were treated as a kid, etc), but the short answer is:
they make you feel that way because YOU LET them make you feel that way....
Eleanor Roosevelt said it all with, "No one can make you feel inferior without your consent". So don't give your consent. Once you decide it's important enough to do, the problem will disappear just like that...