A lot of people dies from just a single punch. He may have beat him for half and hour or he may have landed a strong punch, hard to know for sure.
Even then, even he is not actively attacking someone, you never know if he is going to pull up a knife or something, I wouldn't stop until he is completely harmless as well.