It would be really nice since there is also a plugin for spectate mode so we would not die every time. I get it that it must be really hard to code it, but it would be awesome if it would work.

Guess no one ever requested the feature.
Could eventually be considered as a feature, of Wulf's plugin allows other plugins to use it in a decent manner.