Is it possible to have a setting to allow players to just type the password once, instead of per connect?

Yes, it is a setting in the config file.