If you're still worried about fighting, you can just have your character avoid it. In fact, there won't be much fighting for a little while anyway.