Deleting the entire category (clicking the delete button that's next to the collapse/expand button) does not result in an instant update of the events counter. It used to be the case, but it no longer does this (has been this like for at least 2 months). Deleting individual events updates the counter instantly, but not the whole category - that involves a refresh.
There was likely an adjustment to the cache timer..
Mine updates as soon as I navigate to another page.