Well, if it was purely verbal, I would've suggested that you just ignore them. They probably just want to get a rise out of you, so the more irate and annoyed you get, the more glee they'll feel. But if it's getting physical, then I suggest you seek help from someone in a position of authority. Fighting back on your own might actually make things worse.