I don't know if I'm doing something wrong, but the things I put in the config under whitelist just delete themselves when I reload the plugin.

Would be great 2 c the config which you're trying to use. It might be that you are writing invalid json, which then fails to be parsed, which leads to config being reset to default