Is there an easy way to turn this plugin off, or do I just unload it from console?

Unloading it would be toggling it off, there's not really a need to keep it loaded if you aren't using it.