Jump to content

Lockups/Lag/Performance Issues


Clinton

Recommended Posts

Ok, first off I host the Public AllGamer server which is pretty popular with a peak at ~45 people or so and usually averages over 20 from what we've seen. I'm hosting it for a few friends personally, but said why not let other people join. I have a pretty large background when it comes to hosting gameservers and other applications/services as it's my fulltime job.

 

All of that being said as one of the larger servers that we can see on the server list we've been getting a LOT of lockups and required restarts. After the server has been running a while on a world we'll see one core pegging at 100% as well. Could this be due to fire spread? Obviously that thread is pretty important, but I have no way of figuring out what it's for.

 

 

Here's some of the various console logs we've copied before having to ctrl+c the server and restart it:

 

EDIT: I forgot to mention this was happening on 30.12 and now also happening on 30.15

Jan 11, 2015 12:59:30 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:31 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:32 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:33 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:33 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:34 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:35 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:35 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionJan 11, 2015 12:59:37 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerException
GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7GOT PACKET FROM UNKNOWN CONNECTION guid=-1 packetId=7Jan 11, 2015 1:00:23 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionDisconnected player aceReceived packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Unknown command broadcast RestartingQuitJan 11, 2015 1:00:23 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerExceptionDisconnected player in CurrentCell.getObjectList() removedloaded chunks for cell 175,93 ms=7.126931loaded chunks for cell 175,94 ms=8.129547
Received packet type=53 connection is null.Received packet type=7 connection is null.Received packet type=34 connection is null.Received packet type=7 connection is null.Received packet type=53 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=53 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=53 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=53 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=53 connection is null.Received packet type=12 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.User Jo is trying to connect.User Lord Moldy Butt is trying to connect.Received packet type=2 connection is null.User internetfr3ak is trying to connect.User Butt Search 2012 is trying to connect.Connected new client Butt Search 2012 ID # 0 and assigned DL port 16262testing TCP download port 16262Received packet type=2 connection is null.Received packet type=7 connection is null.Received packet type=67 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=2 connection is null.Received packet type=7 connection is null.Received packet type=67 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=67 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=7 connection is null.Received packet type=34 connection is null.Received packet type=34 connection is null.
Link to comment
Share on other sites

Just had another lockup this morning/last night.

Connection Lost for id=25 username=ZXNGALLOConnection Lost for id=1 username=EttoryConnection Lost for id=2 username=nullConnection Lost for id=18 username=RussellConnection Lost for id=7 username=ZadirConnection Lost for id=3 username=nullConnection Lost for id=33 username=AndreConnection Lost for id=24 username=JR.SHIFTConnection Lost for id=4 username=nullConnection Lost for id=1 username=nullConnection Lost for id=4 username=nullConnection Lost for id=6 username=nullConnection Lost for id=1 username=nullConnection Lost for id=9 username=nullConnection Lost for id=4 username=nullConnection Lost for id=10 username=цвцвцвConnection Lost for id=14 username=nullConnection Lost for id=8 username=nullConnection Lost for id=11 username=nullConnection Lost for id=2 username=nullConnection Lost for id=27 username=MarwinGamerConnection Lost for id=1 username=nullConnection Lost for id=1 username=nullConnection Lost for id=0 username=nullConnection Lost for id=8 username=nullConnection Lost for id=7 username=nullConnection Lost for id=1 username=nullConnection Lost for id=0 username=nullConnection Lost for id=2 username=nullConnection Lost for id=2 username=nullConnection Lost for id=0 username=nullConnection Lost for id=4 username=nullConnection Lost for id=7 username=nullConnection Lost for id=0 username=nullConnection Lost for id=5 username=nullConnection Lost for id=13 username=BaldwinConnection Lost for id=2 username=nullConnection Lost for id=4 username=nullConnection Lost for id=6 username=nullConnection Lost for id=8 username=nullConnection Lost for id=6 username=nullConnection Lost for id=5 username=nullConnection Lost for id=4 username=nullConnection Lost for id=2 username=nullConnection Lost for id=6 username=nullConnection Lost for id=7 username=nullConnection Lost for id=5 username=nullConnection Lost for id=2 username=nullConnection Lost for id=0 username=nullConnection Lost for id=0 username=nullConnection Lost for id=6 username=nullConnection Lost for id=8 username=nullConnection Lost for id=4 username=nullConnection Lost for id=19 username=Mountain DewedConnection Lost for id=0 username=nullConnection Lost for id=0 username=nullConnection Lost for id=0 username=null
Link to comment
Share on other sites

Thanks for posting these.  It seems that something goes wrong before these repeated errors occur though.  With so many players, I wouldn't be too surprised if the server just ran out of memory.  I might have fixed the 100% CPU, I know I've seen the path-find thread do that once in a while.

 

I don't understand why this isn't showing a stack trace after the NullPointerException.  It makes it impossible to know where the error actually occurs, annoying!

Jan 11, 2015 12:59:32 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerException
Link to comment
Share on other sites

We've got both servers set to use 8GB of RAM. Haven't seen any OOM errors yet, but have no way to measure as you know Java just likes grabbing all the memory given to it.

 

I will say when it locks up nothing works including quit so I just have to ctrl c out.

Link to comment
Share on other sites

 

Thanks for posting these.  It seems that something goes wrong before these repeated errors occur though.  With so many players, I wouldn't be too surprised if the server just ran out of memory.  I might have fixed the 100% CPU, I know I've seen the path-find thread do that once in a while.

 

I don't understand why this isn't showing a stack trace after the NullPointerException.  It makes it impossible to know where the error actually occurs, annoying!

Jan 11, 2015 12:59:32 AM zombie.gameStates.IngameState updateSEVERE: nulljava.lang.NullPointerException

 

It could be a Object hotspot issue, or the way you handle your garbage collection (System.gc() / primitive vs. OOP data handling architecture). 

 

Not too sure about the missing stacktrace though. 

 

Edit: It could boil down to how the thread synchronize with the data too. 

 

Sleeping the thread has a dramatic effect on cpu usage, even if sleeping for 1ms). 

 

It all boils down to how the code is constructed, and I expect you guys know your Java. :) 

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...