It all depends. In the last one, I had a small defense force up at all times. However, doing that will of course limit your maximum army size as your expenses would be greater if you have a standing force compared to not having one. That being said. Some random events could occur where you would want some sort of military.