[quote=8]
Sorry, I guess I should've provided some background. His family is super rich, white, etc. His dad grew up poor, very much unlike his current financial position. By saying "like that" he's implying that black people are by default, poor.
[/quote]

Well, I mean nothing he said sounds like it was inherently racist, but it could be lost within the absence of tonality and his character in your post, which I'm willing to trust you on as you know him more than I do. But, from a surface value, it sounds like he's saying "Yeah my dad was brought up around black people", which wouldn't be surprising if he was from a poor upbringing as minorities, for many many self-perpetual and external reasons, are being segregated negatively through the lens of socio-economics in regards to ethnicity.