It's a peculiarity of human nature that groups that on the surface appear to be very close often have a huge amount of antipathy for each other.
If you've ever seen Hopis and Navajos interact together you know exactly what I'm talking about, but the phenomenon is hardly limited to those two groups.
Race (Or the perception thereof) is only one of many reasons why humans decide to dislike each other.