I've installed the plugin and granted the needed permissions but no matter what rate I set crafting too, everything crafts instantly. I'm puzzled.

To stop instant crafting you will need to remove the permission craftingcontroller.instantbulkcraft. Make sure in your config your default craft rate percentage is set above 0%. Also check your vip permissions as well as your advance crafting options.