I like stress pool. But let's give them one and two are both non-penalties. It gets to -1 and 3 and 4.

So: 
1-2 No penalty
3-4 Penalty of -1
5-6 Penalty of -2
Above this all actions get minus two, and players should have their characters act accordingly.