A) I don't really care how they see me. If they think less of me just because I don't believe the same things they do, they are not the kind of people I want to be friends with anyway.
B) Hell yeah.
Having said that, I think it does take either a very strong mind, or a certain type of personality (non-sentimental, more logical than emotional, or very easy going) to cope well with leaving. Even then, it is still hard. It must have been harder before the internet though.