Clearly there IS abuse. Please don't ever think the police don't want to do something or aren't interested. They are here for your protection. Each and EVERY time there is any kind of abuse-drugs, DUI, violence, you are obliated for SOOO many reasons to get the police involved. Keep a record of all incidents and report them!! File charges-make his life a living hell.
Sooner or later, he will back off. He sounds like scum. Keep calling child protective services as well.
DO IT. The alternative for kids is unpalateable.