I gave my moderators the perms needed to use this and while they vanish, they are unable to fly/no clip. Do you need admin access to use this even with perms?

To use noclip, yes. This plugin focuses on making players invisible, not on trying to allow non-admins to noclip, which requires extra logic. There are some other plugins which try to solve the latter problem.