I think it is entirely reasonable to have a judge who is not participating if available (such as myself). If they aren't available to make a ruling, say within X amount of time, then it defaults to another who may be in the tournament but not in the fight.

Just an option.