The only people that don’t feel any guilt are psychos. If you are doing something that harms others you should feel some guilt, don’t you think?
The problem is some people only see what is in front of them and don’t realize their actions have consequences for others.
Religions have abused this power over people, but the principle of right and wrong still remains.