Lag

Ardmore

Can someone look into this? It's pretty bad and a lot of people are complaining about it, so it's more than likely on the game side.

Thanks

Munsia

I'm not lagging...then again it might be an area thing, though normally my area gets hit with it first. Server's in Chicago isn't it?

Karlach

It's particularly infuriating when you're wanting to do things, and can't because you know one spike will probably result in your corpse getting scraped off the floor.

This isn't affecting anyone in one locale either, asking about, it seems rather global.

Munsia

Superior interwebs? What's your ping to Lusternia vs another site?

Elanorwen

I dunno about server being in Chicago. I'm in Illinois and I keep getting random waves of lag to Lusternia... died twice last night due to it in a bashing area that I normally breeze through... but when you get hit by 12s of no response from the server, you kinda can't do much. It seems to happen entirely at random and I normally run a ping when I get even a second of lag... usually to another location to see if it's me or Lusternia, and my ping to google has never gone higher than 40ms

Ardmore

It's not constant lag, it comes and goes, and while it's only there for 5 seconds at a time it's very noticeable and very annoying. People from all over the world have noted it.

Zouviqil

NYC reporting in with lag.

Caerlyr

Ardmore said:

Can someone look into this? It's pretty bad and a lot of people are complaining about it, so it's more than likely on the game side.

Thanks

Yep, most definitely. I've had reports from people across the globe. This is definitely an issue.

Munsia

Fear my protective bubble, I spose.

Marcella

I've never had influencing have the mobs attack me back.

 Recently they've started to do that, due to input lag.

Hmmm.

Ieptix

I've checked our logs for lag spikes, haven't seen anything out of the ordinary for today. Judging by some of the comments earlier in the thread, it seems as though the issue was network lag, rather than a problem with Lusternia (since mobs were apparently still attacking, etc).

Is the lag still a problem? I've only been up for a little while, but I haven't had any trouble.

Zouviqil

Small example from earlier of the lag.

Ssaliss

Hmm. Could you point out the lag in that bit, Zou? Because personally, I can't see it... also, it looks like you copy/pasted it twice.

Zouviqil

Ssaliss said:

Hmm. Could you point out the lag in that bit, Zou? Because personally, I can't see it... also, it looks like you copy/pasted it twice.

I did, my fault... pay attention to half. Note the time stamps. Starts at 14:54:00 when I send out the command. Two seconds later, the game responds and does my command, and results in Mork spamming sips.

This part:

4004h, 5259m, 5399e, 10p xk-01-04-2014 @ 14:54:00 (1-11-373 @ 08:00) cure mork temperature
You have recovered equilibrium.
4004h, 5259m, 5399e, 10p exk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
You may drink another health, mana, or bromide potion.
4004h, 5259m, 5399e, 10p exk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
You place a forefinger between Morkarion's eyes and attempt to cure him.
4004h, 5259m, 5224e, 10p xk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
Morkarion takes a drink from a coiling vial of swarthy crystal.
4004h, 5259m, 5224e, 10p xk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
Morkarion takes a drink from a coiling vial of swarthy crystal.
4004h, 5259m, 5224e, 10p xk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
Morkarion takes a drink from a coiling vial of swarthy crystal.
4004h, 5259m, 5224e, 10p xk-01-04-2014 @ 14:54:02 (1-11-373 @ 08:00)
Morkarion takes a drink from a coiling vial of swarthy crystal.
4004h, 5259m, 5224e, 10p xk-01-04-2014 @ 14:54:03 (1-11-373 @ 08:00)
A grinning frost imp jumps from one foot to the next before leaping into the air
in a flurry of limbs, fist, foot, and tail slamming into Morkarion's face in
quick succession, each blow leaving a frost-rimed bruise.
A vicious frost fiend lunges forward, jagged teeth clamping onto Morkarion's leg
and drawing blood even as the wound freezes shut with a crackle.

Elanorwen

Random spikes between .6s and 2.5s today so far... I tried keeping a ping going to Google and alt+tabbed as soon as the lag hit... no change in ping speed ever... low at 29ms, high at 40ms, average speed - 34ms


EDIT: I play plenty of other stuff online, from Anno 2070 in online multi-player to SWTOR/EVE Online... and never seem to have issues in either of those compared to the issues that have been popping up with Lusty of late. Now, if it were just me complaining, I can understand it being a network issue... last night, during the 12s lag spike, I pointed it out on a clan and had at least three other people say they felt it too, so it sounds like it's not a network issue.

EDIT2: Just ran a ping to lusternia.com, average speed was 29ms over 500 packets. During that time, I had several spikes up to 1.3s... again, alt+tab showed absolutely no major increase in the ping response speed during the lag waves.

Ieptix

Pinging Google isn't going to be terribly informative. If it's a network issue, it'd be something near Lusternia, not something local to you. More useful would be trying to get a traceroute to Lusternia when the issue crops up (using the traceroute command on Linux (and probably Mac, though I'm not sure) systems, or tracert on Windows (I may have the name wrong here, unfortunately. I'm so very rarely booted into Windows)).

I can say with high confidence that there isn't a problem with Lusternia itself. There have been no lag spikes on Lusternia's end that've been more than a couple tenths of a second, and these have been few and far between.

Elanorwen

Ieptix said:

Pinging Google isn't going to be terribly informative. If it's a network issue, it'd be something near Lusternia, not something local to you. More useful would be trying to get a traceroute to Lusternia when the issue crops up (using the traceroute command on Linux (and probably Mac, though I'm not sure) systems, or tracert on Windows (I may have the name wrong here, unfortunately. I'm so very rarely booted into Windows)).

I can say with high confidence that there isn't a problem with Lusternia itself. There have been no lag spikes on Lusternia's end that've been more than a couple tenths of a second, and these have been few and far between.

It tends to be a short-time issue... as in it'll lag for 1-2s where you get absolutely no response from the server after executing a command, then it'll run fine for the next 20-30s, when it will hit you again. The interval between lag hits seems to be completely random, so running a traceroute is likely to happen post-issue, which is why I also ran a ping on lusternia.com and saw absolutely no lag on the ping during the time I was having lag spikes affect my playing of Lusternia. Not sure, if it was really a network issue, I'd think ping to lusternia.com would also show a problem.

EDIT: That said, traceroute showed nothing new... except the knowledge that I'm roughly 6 (8 if you count router + cable modem) hops away from Lusternia... and most of it is short-range. So yes, the server is in Chicago... and I'm probably about 20 miles away from it physically... and getting lag spikes. Hmmmm.

Munsia

Could reintroduce that 'Lag' syntax...

Moi

I got like a whole minute of command lag earlier today, but I'm pretty sure that's due to playing on my laptop over wifi in the same room as the microwave making the popcorn for movie night tonight.

Lavinya

I have been getting noticable lag spikes too, my internet isn't the fastest at the best of times here, but it's been more exaggerated and regular than usual.

Uruk

Same here... Everything else is working fine on my end but I keep getting really bad spurts off and on. It also doesn't appear to be server side because I'll be attacked by mobs in between commands being input and going through.

Ssaliss

Yeah. This is what happened just now:
[spoiler]
Lag incomingLag incomingLag incoming
Ping: 3821
Ping: 2825
Ping: 1820
Lag incomingLag incomingLag incoming
Ping: 3840
Ping: 2845
Ping: 1846
Lag incomingLag incomingLag incoming
Ping: 3459
Ping: 2464
Ping: 1467
Dashing in from the southeast, an Artificial Guardian Unit resumes its motionless watch.
4210h, 6000m, 7590e, 10p, 18900en, 27900w ex-
Lag incomingLag incomingLag incomingLag incoming
Ping: 4065
Ping: 3065
Ping: 2073
Ping: 1077
Lag incomingLag incomingLag incoming
Ping: 3512
Ping: 2517
Ping: 1515Lag incomingLag incomingLag incoming
Erupting into motion, an Artificial Guardian Unit dashes to the southeast.
4210h, 6000m, 7590e, 10p, 18900en, 27900w ex-
Ping: 3803
Ping: 2811
Ping: 1809
Lag incomingLag incomingLag incoming
Ping: 3418
Ping: 2418
Ping: 1416
Lag incomingLag incomingLag incomingLag incoming
Ping: 4375
Ping: 3375
Ping: 2382
Ping: 1380
Dashing in from the southeast, an Artificial Guardian Unit resumes its motionless watch.
4210h, 6000m, 7590e, 10p, 18900en, 27900w ex-
Lag incomingLag incomingLag incoming
Ping: 3749
Ping: 2753
Ping: 1757
[/spoiler]
And ping said this:
[spoiler]
Skickar ping-signal till lusternia.com [69.65.42.86] med 32 byte data:
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=138ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=138ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=140ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=138ms TTL=54
Svar från 69.65.42.86: byte=32 tid=140ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=143ms TTL=54
Svar från 69.65.42.86: byte=32 tid=138ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=140ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=142ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54
Svar från 69.65.42.86: byte=32 tid=139ms TTL=54
Svar från 69.65.42.86: byte=32 tid=141ms TTL=54

Ping-statistik för 69.65.42.86:
    Paket: Skickade = 75, Mottagna = 75, Förlorade = 0 (0 %),
Ungefärlig överföringstid i millisekunder:
    Lägsta = 138 ms, Högsta = 143 ms, Medel = 140 ms
[/spoiler]
As a note, the first is in-game ping through GMCP.Ping, and the latter is, of course, just a general ping.

EDIT: It could be added that the reason for the several ping-messages one second apart in the top half is because they all get queued up. So if I have four waiting, and all four come back to me at the same time, I get four pings one second apart.

Ssaliss

Just in case it helps: It doesn't seem to be server-lag, but neither does it seem to be network lag. I tried to prove it was server lag by influencing, and this is what happened:
[spoiler]
You sing the praises of the heroic exploits of an illithoid scourge, recounting his many incredible adventures.
An illithoid scourge ponders your words, but then snorts arrogantly.
4210h, 5950m, 5547e, 10p, 18900en, 26944w x-
Lag incomingLag incomingLag incoming
You have recovered equilibrium.
4210h, 5900m, 5547e, 10p, 18900en, 26940w ex-
An illithoid scourge demands of you, "What am I supposed to think of that?"
Your ego drains as you consider your response.
4210h, 6000m, 5223e, 10p, 18900en, 26946w ex-
Ping: 3835
Ping: 2835
Ping: 1837
You compliment an illithoid scourge on his outstanding intellect and physique.
An illithoid scourge ponders your words, but then snorts arrogantly.
Preparing to use sip balance.
4210h, 6000m, 4815e, 10p, 18900en, 26941w x-
[/spoiler]
So things obviously keep happening while it's lagging, thus disproving server lag. However, I was also running a ping side-by-side when this was happening, and that one was flawless with ping times between 138 and 144 ms, which kinda says it isn't network lag either. So... yeah. Good luck hunting this one down.

Elanorwen

Ssaliss said:

Just in case it helps: It doesn't seem to be server-lag, but neither does it seem to be network lag. I tried to prove it was server lag by influencing, and this is what happened:
[spoiler]
You sing the praises of the heroic exploits of an illithoid scourge, recounting his many incredible adventures.
An illithoid scourge ponders your words, but then snorts arrogantly.
4210h, 5950m, 5547e, 10p, 18900en, 26944w x-
Lag incomingLag incomingLag incoming
You have recovered equilibrium.
4210h, 5900m, 5547e, 10p, 18900en, 26940w ex-
An illithoid scourge demands of you, "What am I supposed to think of that?"
Your ego drains as you consider your response.
4210h, 6000m, 5223e, 10p, 18900en, 26946w ex-
Ping: 3835
Ping: 2835
Ping: 1837
You compliment an illithoid scourge on his outstanding intellect and physique.
An illithoid scourge ponders your words, but then snorts arrogantly.
Preparing to use sip balance.
4210h, 6000m, 4815e, 10p, 18900en, 26941w x-
[/spoiler]
So things obviously keep happening while it's lagging, thus disproving server lag. However, I was also running a ping side-by-side when this was happening, and that one was flawless with ping times between 138 and 144 ms, which kinda says it isn't network lag either. So... yeah. Good luck hunting this one down.

Back in the day when I used to code for a Godwars, whenever we wanted to implement new stuff, we did a hot reboot... was called a copyover but either way, what it does is restart the MUD completely while keeping everyone connected. Still, during the reboot process, people would experience 4-5s of lag. It is essentially what we get with the Fates weaving new threads into the tapestry or whatever the exact message was.

Anyway, it seems at times that lag is generated by people putting essence into a nexus, for instance. I know I got a clt warning about essence recently and everything seemed to slow down immensely for the 5-10s that it took for the person to stick essence in the nexus, then it resumed as normal. Something to ponder, at least.

EDIT: And yes, I wasn't the only person that experienced lag when essence was being inserted into the nexus.

Ssaliss

Well, yes, but that's more likely to freeze everything, both you and mobs, isn't it? This doesn't freeze mobs, so I doubt it's related to the above issues. It more seems like the main Lusternia socket gets temporarily frozen or something; the server is still chugging along smoothly, and when the socket gets unfrozen, everything is sent at once. It would also explain why pings don't show any problems.

Granted, I have no clue if that kind of a problem is even possible, or what would cause/fix it, but... yeah.

Everiine

I had a ton of lag this afternoon, and I wasn't even doing anything... even checking things like CWHO, QW, and NSTAT took a few seconds to complete.

Elanorwen

Ssaliss said:

Well, yes, but that's more likely to freeze everything, both you and mobs, isn't it? This doesn't freeze mobs, so I doubt it's related to the above issues. It more seems like the main Lusternia socket gets temporarily frozen or something; the server is still chugging along smoothly, and when the socket gets unfrozen, everything is sent at once. It would also explain why pings don't show any problems.

Granted, I have no clue if that kind of a problem is even possible, or what would cause/fix it, but... yeah.

Dunno... it was a Godwars, so fights were... KILL <x> then watch at the ton of scroll, for the most part.... and if memory serves, those kept going, just sent a massive chunk your way at once. In Lusternia, though, your side of the fight relies entirely on your input, so you see how an effect like that can go badly.

Ssaliss

Thing is, the mobs here (as far as I know) advance by ticks of a quarter of a second. So if Lusternia is busy processing something for 10 seconds (like what would happen during a hot reboot), the mobs wouldn't advance at all due to no ticks happening. Same if Lusternia was busy processing putting essence into a nexus (although frankly, I've never experienced that causing lag myself, so odds are that was just a fluke on your end that they happened to coincide with lag attacks).

Enyalida

Hey, there was previously some kind of database error/fault that would lag the entire game anytime checked a sufficiently long list of tailoring patterns, so it could be a trigger for lag.

Ssaliss

And did the mobs attack during the lag caused by that? I'm guessing no, but I wouldn't be able to say for sure, since I wasn't around for it (at least not that I can remember).

Ieptix

Enyalida said:

Hey, there was previously some kind of database error/fault that would lag the entire game anytime checked a sufficiently long list of tailoring patterns, so it could be a trigger for lag.

That was fixed ages ago, and isn't an issue at this point.

I'm going to try lowering the tick we're using to detect lag, and see if anything comes up. As of right now, for the fifteenth, there were two processor-bound lag spikes of .49 and 1.05 seconds, though that's across spans of thirty seconds, and it's possible the lag is being amortized over the full period.