Also there are laws in each state that would make it difficult to even make a federal law.
That is why Kennedy brought out the National Guard to enforce US laws that protected the blacks. Also, look at laws now that protect the gays. As difficult as it may seem, Federal laws can be passed that go against local laws.