uMod - Server got freezes for 10-15 minutes ($$$ for fix) - Rust

Posted 6 years ago

Hello.

From last year server after restart works 10-15 minutes, then freezes for next 10-15 minutes. Sometimes (like today) it happens when the server has been running for over 10 hours and then lags starts and server got freezes for 10-15 minutes, unfreeze for 5 minutes, then again, again, again until i will restart whole server. I have 5 vCores 3.20GHz, normal usage is 15-20% CPU and 6-8GB of RAM (depends on how long wipe is). Idk if this is problem of plugins beacuse I've tested that before and with 2 most important plugins (TruePVE, PreventLooting) lags still appear. When server freezes CPU usage drops to ~1%, but RAM is still normal.
Server is running on Linux 4.4 Ubuntu 16.04 64bit with 5 vCores 3.20GHz and 12GB RAM.
I can give a small reward for fixing this issue, beacuse it is not bad when server freezes at 4AM, but i don't like tons of freezes at 6PM. Please help! :(

Posted 6 years ago

Last updated 6 years ago

Use Timed Execute to schedule twice daily restarts?

Posted 6 years ago

Last updated 6 years ago

Server is restarted everyday at 4AM. Lags are mostly 10 minutes AFTER server restart.

Edit: I have installed munin on VPS. If anyone is experienced in this way i can give password.

Posted 6 years ago

The first obvious step is to unload ALL plugins and see if it resolves the issue. If it does, then you'll know it's a plugin issue and you can add them back one by one until you isolate the individual problematic plugin. If the problem persists even without plugins then it's more likely to be a hardware or network issue.

Posted 6 years ago

Last updated 6 years ago

As i said with only 2 plugins problem was still on server. If the problem were a plugin, then it would be hard to add one by one over 120 plugins, beacuse it will took over 3 months haha. There is no way to check whick plugin cause CPU freeze? When i had server on hosting the problem already existed so when i changed to VPS it not helped a lot (better fps and ping, but freezes are still on server).

Edit: Idk if it will help, but when i've started test server on localhost there were no freezes at any time. (Windows).

Posted 6 years ago

Last updated 6 years ago

ThePitereq
As i said with only 2 plugins problem was still on server. If the problem were a plugin, then it would be hard to add one by one over 120 plugins, beacuse it will took over 3 months haha. There is no way to check whick plugin cause CPU freeze? When i had server on hosting the problem already existed so when i changed to VPS it not helped a lot (better fps and ping, but freezes are still on server).
Edit: Idk if it will help, but when i've started test server on localhost there were no freezes at any time. (Windows).

type o.plugins and post the result here

you can see which plugin has very long hook time

Posted 6 years ago

Last updated 6 years ago

Okay. I will send from PluginsTime, beacuse there is restricted content somewhere in authors :v

Plugin informations:
Logger.cs 371.97s (3.066%)
BotSpawn.cs 60.99s (0.503%)
Fishing.cs 58.13s (0.479%)
DungeonManager.cs 48.6s (0.401%)
ZombieHorde.cs 46.91s (0.387%)
NTeleportation.cs 45.59s (0.376%)
TsunHorse.cs 31.75s (0.262%)
QuickSort.cs 29.98s (0.247%)
Vanish.cs 26.83s (0.221%)
MasterKey.cs 19.68s (0.162%)
TimedExecute.cs 19.16s (0.158%)
GrTeleport.cs 18.97s (0.156%)
CustomSkinsStacksFix.cs 14.21s (0.117%)
SkinBox.cs 11.63s (0.096%)
SkinPerks.cs 10.94s (0.09%)
InfoPanel.cs 9.73s (0.08%)
TruePVE.cs 8.87s (0.073%)
ZLevelsRemastered.cs 7.08s (0.058%)
NPCBases.cs 7.06s (0.058%)
ZoneManager.cs 4s (0.033%)
ServerRewards.cs 3.84s (0.032%)
VehicleLicence.cs 3.64s (0.03%)
Quests.cs 3.51s (0.029%)
PlayerChallenges.cs 2.95s (0.024%)
SimpleLoot.cs 2.83s (0.023%)
RustRewards.cs 2.7s (0.022%)
BuildingBlocker.cs 2.38s (0.02%)
Clans.cs 2.15s (0.018%)
FancyDrop.cs 1.92s (0.016%)
GatherManager.cs 1.87s (0.015%)
FurnaceSplitter.cs 1.58s (0.013%)
NightLantern.cs 1.53s (0.013%)
EntityLimit.cs 1.44s (0.012%)
DisableHeliRocketDamage.cs 1.42s (0.012%)
AdminMenu.cs 1.41s (0.012%)
BuildingGrades.cs 1.32s (0.011%)
EventProtector.cs 1.17s (0.01%)
AdminRadar.cs 1.09s (0.009%)
SaveMyMap.cs 1.04s (0.009%)
Kits.cs 1.02s (0.008%)
PlaytimeRewards.cs 0.8s (0.007%)
ItemBank.cs 0.68s (0.006%)
QuickSmelt.cs 0.65s (0.005%)
SpecifiedGather.cs 0.63s (0.005%)
NeverWear.cs 0.62s (0.005%)
AutoDoors.cs 0.59s (0.005%)
TreePlanter.cs 0.54s (0.004%)
WeaponChanger.cs 0.51s (0.004%)
CompoundOptions.cs 0.48s (0.004%)
BarrelPoints.cs 0.47s (0.004%)
SurveyManager.cs 0.42s (0.003%)
CandyStorage.cs 0.41s (0.003%)
PreventLooting.cs 0.37s (0.003%)
CraftPlus.cs 0.37s (0.003%)
ItemTransfer.cs 0.37s (0.003%)
EventStorage.cs 0.36s (0.003%)
Telekinesis.cs 0.36s (0.003%)
ImageLibrary.cs 0.35s (0.003%)
BetterChat.cs 0.35s (0.003%)
SlidingDoors.cs 0.33s (0.003%)
NightVision.cs 0.31s (0.003%)
MarkerManager.cs 0.28s (0.002%)
SharedDoors.cs 0.27s (0.002%)
SmartShop.cs 0.26s (0.002%)
CopyPaste.cs 0.21s (0.002%)
ChainsawFailureProbability.cs 0.2s (0.002%)
Friends.cs 0.2s (0.002%)
ExtendedWorkbenchRadius.cs 0.2s (0.002%)
ScrapHelicopterFix.cs 0.19s (0.002%)
ChinookHelicopterFix.cs 0.18s (0.001%)
InfiniteCandles.cs 0.17s (0.001%)
RemoverTool.cs 0.17s (0.001%)
HelicopterSetup.cs 0.15s (0.001%)
ExtendedRecycler.cs 0.15s (0.001%)
EventQuiz.cs 0.15s (0.001%)
BuildingUpgrade.cs 0.13s (0.001%)
DiscordRewards.cs 0.12s (0.001%)
MinicopterSeating.cs 0.12s (0.001%)
EnhancedHammer.cs 0.12s (0.001%)
CraftingController.cs 0.12s (0.001%)
InventoryViewer.cs 0.11s (0.001%)
Trade.cs 0.11s (0.001%)
CustomUnwrap.cs 0.09s (0.001%)
SedanPiano.cs 0.09s (0.001%)
PlaytimeAPI.cs 0.09s (0.001%)
BetterChatIgnore.cs 0.08s (0.001%)
Ignore.cs 0.08s (0.001%)
EasyVote.cs 0.08s (0.001%)
RandomSpawns.cs 0.07s (0.001%)
KillMessages.cs 0.05s (0%)
QuarryLocks.cs 0.04s (0%)
VendingLogs.cs 0.04s (0%)
LoadingMessages.cs 0.03s (0%)
RewardStorage.cs 0.03s (0%)
LootBouncer.cs 0.03s (0%)
ConnectMessages.cs 0.03s (0%)
StackSizeController.cs 0.03s (0%)
ZzzEffects.cs 0.03s (0%)
BetterChatMute.cs 0.01s (0%)
ColouredNames.cs 0.01s (0%)
TimedPermissions.cs 0.01s (0%)
AdminHammer.cs 0.01s (0%)
ServerVendings.cs 0.01s (0%)
PrivateMessages.cs 0.01s (0%)
Upgrades.cs 0.01s (0%)
InventoryCleaner.cs 0s (0%)
QuarryStopChecker.cs 0s (0%)
InformationalCommands.cs 0s (0%)
BroadcastMessages.cs 0s (0%)
Broadcast.cs 0s (0%)
Metabolism.cs 0s (0%)
Aliases.cs 0s (0%)
NoWeaponDrop.cs 0s (0%)
SignArtist.cs 0s (0%)
TimeOfDay.cs 0s (0%)
PluginsTime.cs 0s (0%)
NoExperiments.cs 0s (0%)
NoGiveNotices.cs 0s (0%)
CustomGive.cs 0s (0%)
MultiCommands.cs 0s (0%)
PrefabSniffer.cs 0s (0%)

Edit: But there is problem. Hook time is always other, besed on things did on freeze. Sometimes it is DiscordRewards, sometimes other plugins. Like this Logger now after lag:
Calling 'OnUserCommand' on 'Logger v2.2.1' took 370594ms

Posted 6 years ago

"with only 2 plugins problem was still on server"

... so remove those plugins and see what happens. If you still have the problem, then it's not a plugin issue and you need to look at your hardware or network.

Posted 6 years ago

Last updated 6 years ago

What in the world are you logging there? I mean thats taking a crapton of time! Right there is probably half your issue. Also if you are running ouydated version of BS or Zombie Hordes that COULD cause issues. Depending on the number of AI and Zombies that could cause issuse as well... had that happen on my server. TsunHorse is no longer needed as horse riding is in game and that addon has tons of issues and if I remember is no longer updated. BetterChat has conflicts with ColouredNames so its could cause issues as well. I also see a number of addons that do the same function as another and even a number of addons Ive never even seen. I would recommend cleaning out addons never or hardly ever used... could also look into cleaning up files in the oxide/data folder because when thoes get too big it can causes freezes as well.

Merged post

Also if you loaded 1 by 1 the addons and let them run for 5-10min before addin the rest it would only take you about 10-20 hours... yes thats a long time and would honestly take you 2-3 days but in the end if you want a smoothly running server(s) youll need to put in the work.

Merged post

Also whats your entity count when the server saves?

Posted 6 years ago

#10

BotSpawn - Newest version updated
Zombie Horde - updated nearby 200 zombies
TsunHorse - updated by k1lly0u for now, and it is used to ride in chickents etc. :D
ColouredNames - I've not saw any errors or something

I am clearing data files in every 2-3 months so files are not that big as you think.

Loading addons one by one is not that easy as you think. Server lag is random. I cannot check one plugin every 10 minutes beacuse lag is only on restart and not always or randomly once per 10-30 days.

For now i have 100k entities.

Posted 6 years ago

#11

I'm gonna try this for the 3rd and final time... UNLOAD ALL OF YOUR PLUGINS!! If the problem persists with no plugins then you won't have to reload any plugins one by one because it's not a plugins issue!

I know you want someone to come along, wave a magic wand and fix your problems for you without any disruption or down time, but you need to face reality and tackle the problem logically. Alternatively, carry on pestering people on a forum to make wild guesses on what the problem might be without actually doing anything about it. Whatever works for you.