If you aren't in that faction, you can't really do anything in that factions land.