Is it wrong to believe that Physical force should only be used in self defence ?

Because this makes me wanna hate anyone who doesn't , no matter what the situation is or what shit the other person has done.

Edit : I also support physical force for defense of others