Well, some people are naive and some people are hypocrites and some people are just immoral. For example, the same assumption that led you to use the word we as if society is a single cohesive group is the same fallacy that leads people to thinking the government is just a big version of them, like ...

But I'm not convinced a pacifist society could exist. What you define as violence is arbitrary, your body is engaged in constant acts of violence to maintain its health every second.