The last month, the livecounter.theyosh.nl website had a busy period. Almost every day we reached 900+ requests per second. That is about 30.000+ users that is seeing the counter. The problem that arises is that there not enough upload bandwidth. We have updated the livecounter under the hood, in such a way, that we can not handle 40.000+ users!! That is an increase of 33%!
Houston, we have problem
This month the counters of the livecounter website are running in overtime. There are a few new websites using the counter, they doubled the total amount of requests! The website was doing some 100-150 req/s average daily. Since this month the amount of requests are almost 400 req/s.
Due this amount we are experiencing some performance problems at spike moments. We are looking into new ways to reduce the load and still handle this amount of traffic. Here are some stats:
This week there was a hard disk failure. And it took longer than intended to fix the failing disk. But after four days we are back online... with still a failing disk :(
So at the moment the data is being moved from the failing disk to a new disk. This will take some hours and probably also some downtime. But at least the site is up and the mail is working again.