True. it would have to be managed somehow. Maybe it'll be possible to only have it trigger a notification once it goes of of the chat, and only if you've not focused the window between it being posted and it being removed to the logs?
Perhaps it could trigger if someone mentions you when you're not there, though.