When adding somone to the team they auth on everything i has set permissions for. which is fine.

But when removing them from the team, they dont Un-Auth?
this a bug? or permission issue?

It should be permission issue