It could be a round robin style tournament rather than single elimination. That way everyone gets their 3 fights in even with just 4 people active. Probably better that way in general, since nobody gets kicked out first round before they even have a learning chance.