Hello all!

Just wanted to give you an update on what's going on today, as the turbulence has been worse than expected.

This morning one of our valiant webservers by the humble name of web2 experienced some issues with its disk drive array. I concluded that it probably needed a disk replaced and took web2 out of the rotation for main Subeta servers. Unfortunately, DNS is cached around the world, so while most of you got the effect of this update immediately, some people were still being redirected to web2 this evening.

A simple disk replacement hasn't fixed web2, and the data center technicians have been hard at work (we hope) fixing the problem since we first alerted them to it this morning.

Running with only 2 web servers has taxed the site a bit, causing some lag. As mentioned above, a few people with aggressive DNS caching continue to be sent to web2, which is responsible for some reports of images or entire pages not working.

Another factor is that without web2 also acting as a DNS server, we were unexpectedly left standing with only 1 DNS server, which has caused some further issues. web3 is now online as a backup server, which should alleviate part of this problem.

In any case, we apologize for the ripple effect this is causing on the site's functionality. Web2 should be back up and running shortly, and hopefully everything will return to normal quickly after that.

Thanks,
Alex