BaggeIm hosting 3 rust servers on the same i7 4770k processor. Could that maybe be the issue? even though 2 of them are mostly empty.
Are they all using the same cores? If so, yes. I'd set them to each use 2 different cores. They would be competing for the usage of those CPU cores otherwise.