I still remember an incident from high school. One of my classmates was very short and pudgy and wore thick glasses. And if I told you his name and asked you to picture what someone with that name would look like, you'd probably picture him just as he actually was. He didn't act nerdy or odd, though. One day during intramural basketball, he was playing on an another court and a big guy at least a foot taller started harassing him. He ignored it until the big guy shoved him. He wound up and walloped the big guy smack in the face. Cold cocked him, broke his nose, knocked out a couple of teeth, lots of blood spurting. When the situation got sorted out, only the big guy got suspended. Nobody tried to pick on the little guy after that.
Jerks are jerks regardless of size.