Oh yeah totally, they are just there to protect the castle so if you have business there they'll move. If you wanna have some of them act like assholes, "OK WE AIN'T LETTIN YOU THREW HEA!" then that's fine too.