You're still in a fighting mood. As he gets close you immediately swing for his head. Your fist grazes his ear and cheek.
What happens next is a blur. He crashes into you and starts whacking you all over. You do the same but you weight more than him so it's over quickly.
You prop him up against a tree. He'll be alright.