The self conscious thing is definitely the second bit of that equation keeping me from going for any of these. Closest I got recently was one of those work-out boxing classes but never made it to the class (unrelated to self conscious, just couldn't find parking in time).

I might try boxing since it seems like you could probably practice it from home to some degree.