The impression I got concerning the antagonist was that it is not a character hiding within the party or something, but rather the sum of all misfortune that happens to our characters. So, that would include controlling monsters, making accidents happen, etc. I could be wrong, though.