Perhaps we could reach some middle ground and tag team/have some sort of villainous enterprise, eh optimist? Rather than a single villainous figure a steadily strengthening confederation of baddies? But the single manor villain route is always a highly satisfying end...