I seen some servers has autoban feature for fresh steam accounts which are not even set up.
What is that anticheat?

nashslash

https://umod.org/plugins/server-armour

There's no option for steam without profile.

Maybe try Steam Checks?

0x89A

Maybe try Steam Checks?

Thanks, would be great, but it's just kicking instead of ban :/

This is just an educated guess, but it's probably designed that way because people's profiles can change. In your case, a player can be kicked for no profile, then they set up their profile and try again. It would be kinda unfair to find themselves permanently banned after they've complied with your restrictions.

I am pretty confident this can be done by using "RustAdmin" tool which is downloadable from Google.

You're able to specify to automatically ban someone based off of gamebans < or > a #, and several other factors.