Is there any way to just edit the damage for a single player? And not globally?

Yes, don't grant the permission to an entire group, but just to a single player.