When permission for player was removed, they are still having the perks unless they discard the weapon and use a new one.