Does the "Commands On Connect" run every time a player joins the server or just first time joins?
Is it possible to force it to run on first time joins only?

It is on connection, not spawn. May be able to add that as an option.