It could be just as likely that not many people know of Terin's military history- maybe he's changed his name since the war. I mean, most people in FEZ aren't concerned in something as insignificant as "history", but yeah, a few people here and there might be a bit iffy.

Sam has no particular loyalty to the UEE- moreso just his family.