Whats to stop people who are under attack at their base just using this to get out with their gear ???

The teleport timer is cancelled when you take damage. You are also unable to teleport if you don't have building privilege.

going to shut it down during the raid?