STILL Lag and Errors
Filter
Show Official Posts OnlyReplies
I'm wondering if we can get an update on this issue. Are they working on this, are there any culprits, etc.
You deserve it[/font]
[font=georgia] [ToT=Pseudonym] CW Shop Join my HA contest! [/font]
This! I really understood from the communication about the new shops that those were the reason for the errors. Now all the old ones are disabled, and here we are again. What's the next excuse?
I just had another round of errors for several minutes, and pages just keep "hanging". I don't have the spinning wheel anymore since disabling it in preferences, but I do feel that pages keep hanging. Like hovering stalls sometimes, and even when I'm typing right now, sometimes the cursor just freezes and hangs for a few seconds. That only started a few days ago.
Who's in charge here? What the hell is going on with the lag and errors? This is utterly insane and completely unacceptable after all you put us through with the new shops and galleries!. So much for the site running smoothly now huh? I mean, seriously.
The old shops are still live. I got my first 502 in almost a week today, excited to see how we do without the old shops!
Me too! BUT, yesterday before the legacy shops were put back I did quests from Shinwa up the widget to Pete and it was scary how few items there were on the shop search page. Pete asked me for Tatties and Neeps and there were 4 available, 3 after I'd been there. Once the legacies were restored the search pages filled up again. People just aren't getting rid of their legacies...why not? How much longer are the legacies going to be searchable? I was amazed at how many there were when I was questing earlier. Is it time to get tough and just shut them all down? Crap, I've already deleted mine...but not my galleries just yet. I do need to make time to shovel everything over.
I want to address this idea that this shop change would completely eradicate the current errors. We said we hoped they'd help (and they have!) with the server errors because the legacy shops were (and still are, to an extent) a major bottleneck in our server-database connection. We're working on other things, too, but I'm afraid that we only believed the shops to be a MAJOR factor, not the entire factor in solving our problems. Removing this bottleneck, however, clears out a lot of our logs and lets us know what we should focus on going forward. The decision to keep legacy shops in the shop search has not helped that cause, but it was a necessary decision to keep those items available and in the economy.
I know it's frustrating to have to deal with this, and trust me when I say it's just as frustrating for us as it is for you. But just to demostrate that the new shops really have helped, I wanted to show you guys a graph of all of our 5xx errors. Something funky is definitely going on today, and I'm trying to figure out what, but our average 502/504 errors have dropped by more than 75% since we implemented the new shops.
~ I realize as you mentioned that the 502/504 errors have dropped by more than 75%, since the new shops were implemented. I do also understand you are trying to figure out what is causing this to happen. However, I have continuously experience this on a daily basis still, since the shop/galleries have been switched over. It use to be where majority of the 502/504's were appearing when I tried to open or take out an item from my gallery. Since the changeover, I have been receiving it from refreshing different pages, inventory, account search, shop search etc...
[br clear=all]
Not to be a jerk or anything but it looks like it's started going back up since Vesnali's start...
omg you're right and i'm so dumb i didn't even make that connection
I maybe get a 520 or whatever once a day anymore. I haven't seen a 502/504 in a while. Some lag yes but the site has always been laggy especially around events. So I don't really mind it. At least they have dropped.
[kiss=blackwolf_2009] [dance=blackwolf_2009] [egg=blackwolf_2009] [TP=blackwolf_2009]
Given what you deal with on a daily basis, it happens. XD
I'm going to chime in to the great post that made and make a few points.
- How we find these bottlenecks and how we deal with them. We have a few tools that include outputs from our database, and the queries that take the most time. For the past six to eight months the user shops tables have been a MASSIVE chunk of those logs, to the point where we have to do significant, digging to find other slower queries around that. NOW those queries are all gone, and we have the ability to really dig into the other queries that are causing problems. Fortunately, those queries are all smaller (taking a look right now - things like searching items by tag, the donation corner, etc) that don't require massive overhauls.
- Vesnali is a great point. This gives us a great opportunity to understand why the site buckled under that pressure. We had the hypothesis that it was primarily items being moved to/from the user shops and that turned out to be mostly true, but now we can see what the smaller pressure points are.
Hopefully from all of these changes we can show you that chart again in a few days with it back on the downswing!
💖 ✨ 🤗
~ I don't believe it has anything to do with Vesnali. I have been experiencing 502/504's continuously prior to it starting, and the only change I do see is that I am able to open my old gallery and remove items (most of the time) without having to receive that error. As I mentioned above, I am starting to get those 502/504 pages in different areas on the site.
[br clear=all]
[-Guru] the thing is, most of the time when you're getting them, everyone is getting them. if a single page takes a while to load, you may see an isolated one, which was probably the case with you previously removing items from a large gallery. but if you're getting them in random places, that means the server-database connections froze up and it is a site-wide problem for everyone at that time.
~ I am just telling you what I have experienced in the past as well as present. As for everyone having the same issue at the same time, is not necessarily true. I have spoken to others, when I did experience having those errors, and it appears that it was only happening to me.
[br clear=all]
Would you maybe reconsider finding a way to convert legacy shops into new shops? I feel like I keep saying this, but if you were to convert shops for us then A) all those items would still be available and B) you could get rid of all the legacy shops. If the new shops are really that much of an improvement, then even a huge limit-surpassing shop with 20k unique items has to be better for the server than leaving all those items in a legacy shop.
And by the way, do we know how long legacy shops will stick around?
[edit]
Also, I'd be curious to see that chart extended ~2 weeks or more before the shop changes were announced, just to get some kind of baseline. Starting at the 14th just tells us that the site is performing better now than it was when people were mass-moving their item hoards after the announcement, which we already know is true. :P
at this point, we don't have a date in mind for fully disabling legacy shops again. but we're not going to reenable pricing or autopricing, which hopefully acts as an incentive for people to move their items over!
re: the graph, aws only gives us two weeks of data, so that was the most graph i could do! if i could have done more than two weeks, i wouldn't have posted the two week graph hahaha :(
Not being able to price or autoprice doesn't really work as an incentive for old galleries though. Some people like me are not bothering to move the old gallery items over.......
