So what I envision is later 'medieval' with Knights in metal armor and black powder cannons, but not quite to guns yet.

There's no religious magic per se, but there can certainly be religious magic users. I could see a small number of them escaping persecution by claiming their magic was bestowed onto them by whatever deity they worship. Hell, they may believe as much themselves.