I've always found the term 'Minorities' works in that sense. It's more accurate generally too cause it's always the people lesser in number geographically you have these issues (Save women in 3rd world countries) and not the majority of the people there.