They're not rumours, it's objective fact you're a pedophile.

It's just a problem of how the Guild works combined with nicety and shyness of your prey.