Sure, if you want to. Just remember that most of the guards are golems.