If we aren't able to fix this quickly, do you guys think it would be fairest to just take the Mystery Dance page offline?

It seems like people would rather it stay up while we're debugging, so we'll leave it up. Thank you :)

Okay so - I just made a change to the logic for the pool of users it selects from, that should make it a lot more fair. It's just hard to tell. Could you let me know if it seems better over the next few hours?

Locking this up as resolved!