I forgot to mention that it was only Sauron and his underlings who’ve kidnapped and tortured Saeril. 
Saruman hadn’t gone corrupt at the time before the events of the Hobbit.