It IS attacking you, and it was Rogue's side because Rogue made some stupid crap up about having a base code of 8 or 9 digits, instead of 0 and 1.

Cale left because he figured you could get away with anything because you were Keyguy's best bud;
Rogue never bothered to return because he didn't want to deal with you and your magic and crap.