You have two opposing groups, let’s call them a and B. Group a says “we dont think group b has a right to exist and we are prepared to get violent” and group b says “we will never use violence”. How long do you expect group b to last?

Fascists are mercifully not common where I live, but if I hear one mouthing off they’re going to get a savage beating.