Temporary permissions are not removed after the specified time