Anyway to turn off everyone being able to see whos getting pvp capped?

You can disable the handicap messages by revoking the following permission for default users:

pvpcaps.use​

Thank you i'm a bot.