When you do this, he teleports behind you and slashes at you rapidly with Oblivion in his remaining hand. Oblivion hits harder than Oathkeeper. Therefore, when he lands his blows, they hurt just a bit more.