I would say "indifference" is a more appropriate descriptor.
Personally I dont really buy the whole "I love my fellow man" position. Lets be honest. We may love our friends, our family, our pets...but complete strangers? I doubt it. Now, I would come to the aid of a fellow citizen who needed my help in an emergency, but I consider that civic duty, not "love". Love is a strong emotion and concept that should be reserved for special relationships.