Horrible forum lag
Filter
Show Official Posts OnlyReplies
- Here's what I'm dealing with:
Edit: Removed the youtube link because I don't need my full name out there for everyone to see. If any admins/mods want to see it, you can message me.
This is in real time. If you watch until the end, you'll see that regular pages load almost instantly, so it's not a problem with my internet connection.
I've been dealing with this for nearly 2 months.
edit: nvm. i thought it was a lag problem but i guess not
I can't really be the only person experiencing this, right?
It's driving me insane. :(
Edit: And if it is just me, does anyone know what could be causing it? Like I said before, it's only the forums so I know it's not my internet connection. I really can't think of anything else that could cause it to only affect my account and no one else's.
Unless people have just gotten used to the lag and don't see it as a problem anymore?
It's totally not just you , I've done just about all of the things on the forums that I can to speed them up outside of us buying a HUGE memcached instance (because right now it's caching every post - but they fall out of cache pretty quickly because forum posts can be quite large), but I'm working on moving them to a more instant solution which you can see here which loads posts as you view them instead of trying to load a million posts at a time.
(Obviously not the styling or functionality / posts are truncated)
[edit]
(this may or may not work idk - click on topics at the start)
💖 ✨ 🤗
- That does seem a lot better, at least in terms of load time. Have you tried it with direct links to posts yet? There were issues with that last time you tried loading the forums with JS, which was the main reason most of us were against it at the time.
How did the forums get so broken in the first place?
They aren't broken they're just big. We have 13 million posts, all full text, in a MySQL database which isn't really what they were meant to do. Most forums on the internet don't get to be this size (yay for us, but also boo for us!) and it makes going through all of them really hard.
We have a few options. Something like the link I posted above which loads each post separately via javascript (which you can see takes a second for data to show up), loading the text part of the forums into another type of database (where we have all of our logs now is a great example) but we saw the growing pains last time I moved a bunch of data around ;).
💖 ✨ 🤗
I get that, but this was a pretty sudden thing that happened a couple of months ago. The lag wasn't gradual at all.
I've pushed some changes tonight that hosts our forums in two places. One in our own database (no change) and one with it an elasticsearch server (which means soon forums will be searchable again, yay!) where it checks for the post first.
Its cold now, meaning there are very few actual posts on it, but as you browse the forums this should improve.
💖 ✨ 🤗
- I still haven't seen any improvements. The forums are still as laggy as ever.
Just here to confirm that the forums are laggy for me for 2 months now as well, so doesn't feel alone. :) But your remark also stands, it just feels forever that the forums have been going slow, that we (or at least I) am getting used to it. Maybe not many people are posting about it because nothing seems to change, but I'm sure that everyone is still annoyed about it. Or they don't post because they dread the waiting times to come to this thread ...
Still getting this, sometimes the site crashes before it lets certain topics load.
OKAY, I've just pushed some changes to my dev. Check out the forums there, click on a few topics.
The posts load one by one which make the page itself load MUCH faster. Let me know what you see, or if you have any weird issues.
💖 ✨ 🤗
- The forum homepage is still extremely slow, and my browser locks up briefly as threads load. So there's less lag there, but it brings in another usability issue.
Direct links to posts also don't work properly. It's the same issue we had last time you tried to load posts with JS.
They don't link correctly? Hmm, I made them have a min-height (the loading frame) and they link correctly for me, I just tried a few of them. Are you using chrome or firefox?
Yeah, the locking up thing is frustrating, I need to figure out how to better batch the request (or merge them) for the threads. Also right now this is really just a lopped off version of the current forums, it's fetching a lot of data per post that isn't really needed so the individual posts could be sped up a lot, I think.
💖 ✨ 🤗
- Try this direct link. Instead of taking me directly to 's post, it drops me a few posts above his.
Firefox:
Chrome:
It's basically random every time. It depends how fast the posts load.
[edit]
And if you're using the direct link button in the upper right for testing, you're doing it wrong. Those urls link to the live forums, not the dev server.
That's so weird, because this is my experience.
💖 ✨ 🤗
- That doesn't look like it's taking you directly to his post. If it was, the bar at the top of his post would be flush with the top of your browser window, and you wouldn't see the previous post at all.
It looks like the forums are loading faster for you for whatever reason, so it's more accurate than what I've experienced, but it's still off.
Is it weird that I actually prefer it sending me to the middle of the page?
Either way give my dev a check again, it's got some changes so that the front page (hopefully) loads faster, and some changes so that less information is being sent with each post so hopefully less browser lag. If you still get it, I may just have to decrease the # of posts per page.
💖 ✨ 🤗