I blame class. Sure, Himura and Lily pass notes, but Matt's not exactly someone who would do that, especially because nobody he knows is in his class.