Server Crash Error!

This is just a question to other server owners / plugin devs.

I have no idea what causes this console spam (i haven't been able to figure it out yet)
This basically spams the console up until the server crashes.

My question is, if anyone else ever experienced this specific error, and if someone knows what causes this specific error.
This error is awkward and gives me no intel whatsoever on what causes it, also this happens rarely, this particular crash is the 2nd time it happened in 4 months.

But i would still like to know what causes it, so does anyone know?

yWGVyVvu4mZJQDZ.png
Also this is literally the only info that the console shows, during the crash.

That console spam happens due to a bug in the workcart physics logic. Every time I have seen it happen, I saw that one workcart was inside another. That can happen at intersections, and sometimes at other places. That error often precedes a server crash, but it's also possible for the workcarts to recover without crashing the server.

I used to see this a few times a week since I run Automated Workcarts around the clock, which significantly increased the likelihood of them glitching. I would often see it happen at a stop location where one workcart had rear-ended another. After one workcart would get slightly inside the other (for unknown reasons), the rear workcart would start doing a slow merging animation where it would be getting further and further inside the front workcart. After merging like 90% of the way, both workcarts would resume normal movement while stuck together. If a third workcart bumped into the rear workcart, the front workcart would zoom forward at light speed, often too fast to even see because it takes a few seconds for it to be nearby before it is networked, so it would usually not even be shown in the first place, but I could see it's map marker teleporting around. The server crash would always happen while the workcart was moving super fast, particularly when it hit something else. Super fast collisions wouldn't always crash the server though, as often times it would just hit the next workcart, causing that workcart to move super fast instead.

I implemented collision detection into the Automated Workcarts plugin to detect when any automated workcart experienced the merging effect, in order to automatically destroy it as a safety measure. That feature has worked really well, but I haven't seen the issue happen in months. I also created a standalone plugin which has just the detection and mitigation, which I've given to a few people who have had the issue. It has reduced the rate of crashes, but we aren't any closer to understanding why the merging effect happens.

NKXTQs24ExGTuL8.jpg WhiteThunder

That console spam happens due to a bug in the workcart physics logic. Every time I have seen it happen, I saw that one workcart was inside another. That can happen at intersections, and sometimes at other places. That error often precedes a server crash, but it's also possible for the workcarts to recover without crashing the server.

I used to see this a few times a week since I run Automated Workcarts around the clock, which significantly increased the likelihood of them glitching. I would often see it happen at a stop location where one workcart had rear-ended another. After one workcart would get slightly inside the other (for unknown reasons), the rear workcart would start doing a slow merging animation where it would be getting further and further inside the front workcart. After merging like 90% of the way, both workcarts would resume normal movement while stuck together. If a third workcart bumped into the rear workcart, the front workcart would zoom forward at light speed, often too fast to even see because it takes a few seconds for it to be nearby before it is networked, so it would usually not even be shown in the first place, but I could see it's map marker teleporting around. The server crash would always happen while the workcart was moving super fast, particularly when it hit something else. Super fast collisions wouldn't always crash the server though, as often times it would just hit the next workcart, causing that workcart to move super fast instead.

I implemented collision detection into the Automated Workcarts plugin to detect when any automated workcart experienced the merging effect, in order to automatically destroy it as a safety measure. That feature has worked really well, but I haven't seen the issue happen in months. I also created a standalone plugin which has just the detection and mitigation, which I've given to a few people who have had the issue. It has reduced the rate of crashes, but we aren't any closer to understanding why the merging effect happens.

Thank you so much for the explenation, is there a possibility i could get ahold of the plugin you are speaking of?



Merged post

Now this caused a crash as well, yet again something that happens extremely rarely, that i have no idea what the cause is for.
Is this related to the workcarts as well perhaps??

Figured i would use this thread for this error as well, instead of creating a new thread.

73g60sDlWuwF2WK.png

After working on it some more today, I've uploaded it here.
https://github.com/WheteThunger/TrainCollisionDebug

That second error is also related. When you see that, it means the server already experienced a temporary freeze. The plugin will likely destroy the workcarts after that happens, at least that's what I've seen in my stress testing.

NKXTQs24ExGTuL8.jpg WhiteThunder

After working on it some more today, I've uploaded it here.
https://github.com/WheteThunger/TrainCollisionDebug

That second error is also related. When you see that, it means the server already experienced a temporary freeze. The plugin will likely destroy the workcarts after that happens, at least that's what I've seen in my stress testing.

Hey, thank you very much for being responsive and so helpful.

This will most defenitely help me understanding this issue more. I appreciate you sharing the plugin.