I rarely pay attention to people who aren't interacting with me, both because it cuts down on my reading time and prevents accidental metagaming.