Good people do too little until it's too late or an escalation is necessary to correct things.
This is true. There is a huge silent majority of people just observing at the moment. They haven't done anything because ... well it hasn't gotten to their neighborhoods.
If you observe the antifa types that are rioting, they are soft weak teenagers who are bullies and don't have the grit to actually fight. They just want to take a hammer to a window.
The huge mistake would be to start targeting suburbs where people are armed and anxious. I could well see some rioters decide they will target a neighborhood and private homes and that is where this takes a huge turn.