Thank you everyone for your patience today! We found the issue, our cache database (what typically makes the site zip along) was accepting more connections than usual due to the quest-a-thon. When we built out this caching infrastructure, we didn't take into account the type of traffic that a quest-a-thon creates (lots of buying from user shops which is great for the site, but makes the database sad) which resulted in a lot more traffic than usual.
We've increased the size of our redis database, and set up alerts to warn us in the future when it reaches 75% of capacity, so we should be able to detect this a lot faster. Thank you!
💖 ✨ 🤗