No TC access but can remove walls

I'm having a problem on a server where once a player is raided and loses access to their TC they can still remove any walls they originally placed down before the raid. They can do this even after losing TC access. Is there something I'm missing to prevent an original owner of an entity from still being able to remove the item without permission? I just want it to work where only someone with TC access can remove an item. Is someone loses TC access it does not allow to still remove a wall if they were the original owner.

Enable them. Entities can only be removed if the entity owner has TC access 

    "Use Entity Owners": true,
    "Use Tool Cupboards (Strongly unrecommended)": true,