Incident that occurred on Monday, January 22
By Arti on Tuesday 23 January 2007, 12:11 - Gandi - Permalink
We would prefer to be announcing a new product right now, but unfortunately life has its ups and downs...
Yesterday, as some of you may have noticed, we had a problem with our nameservers.
A (highly unusual) chain of events occurred that led to a kind of 'traffic jam' in the processing of requests. Please note, I am not referring to a DDOS.
Nonetheless, our machines did not respond as we expected, and more specifically, our database showed us its limits...
To those customers that may feel our service is not up to par, I would like to reassure them that our new network architecture is comprised of 3 nameservers located at three different locations, and connected by a fiber optic loop.
We anticipated a gradual increase in load on the new nameservers, though it was abrupt (multiplied by a factor of 60), and this caused the outage: my fault.
To those that wished we could have been more open and transparent with regards to this situation, I must say that I am rather surprised at that, but since this is not the general opinion, I am somewhat reassured.
All last night, and all throughout the night, at the critical time of the incident, we were more concentrated on fixing the problem than making excused. This is why everything returned to normal this morning, and I would like to apologize to all of you in the name of the entire staff at Gandi!
We have made several changes in order to consolidate our platform, notably changing our database to BerkeleyDB. This will have an effect on the time needed to update your DNS changes, unfortunately; Changes may now take up to 5 minutes to take effect. This is the price to pay for much more stability, and this what seems to be the most reasonable thing for us to do. The good news is that the response time has been multiplied by 100.
Thank you for your understanding in that our Customer Care Department received a large number of requests yesterday (around 3% of our customers were affected by the outage), and they will be working twice as hard to return to an acceptable response time to your requests.
Today is another day 
Comments
So, it was a bad day for others too... Onxxne didn't to accept my new DNS entry yesterday. I've just be able to enter it last hour :-(( So my blog about free software will wait a few hours before being tested.
To Arti : Well you've been transparent and clear on that incident, because you've explained it just after set it up back. I wouldn't agree at all if you begin with the PR, and after with the repair !!
So carry on this good work, responsible and ethical for your client and for the web community (see fight against domain abuse and spams) ! Gandi, we love you :-*
Thanks for the kind words RVB!
Such incidents are always regrettable, though the positive side is that they end up leaving Gandi stronger than before they occurred!
Have fun!
To RVB : thanx for this
This is the way we're working here.
I don't know if I am part of the 3% of customer affected (I'm sure there is a problem with my domain that I spotted on that day anyway
); however I am quite disappointed that my support request by mail was left unanswered. I would have really appreciated receiving this kind of honest report on my mail, before arriving desperately at the Bar 
Hi Enz,
We are in the process of looking at what may be causing your forwarding to not work. It is not related to the "incident", because that has been fixed, however.
So far, my guess is that it has something to do with the way your host's site takes the URL information, since your forwarding is correctly configured, but right now we are in the middle of an investigation surrounding your case - which is unique - and you will be getting a "real" answer hopefully by this morning.
The silence on our part in reply to your support mail, is not neglect, but it is because I want to reply with a solution and not an excuse...
UPDATE: We have identified the source of the issue, Enz. It was related to the special nature of .name domain names when, like yours, they are already subdomains (something-dot-something-dot-name). Our tech Jedi have fixed the bug and as a result your site is forwarding perfectly now.
The force is strong in you...
Big Cheers to your tech Jedis!!
Enz
None of my webbsites function, it seems that the redirections do not function.
venezuelamia.info
asve.info
datateknikservice.com
Please help me to restore these functions..
Thanks
Hej Roberto,
Vi hade ett litet problem med vår databas mellan kl 9 och kl 10, men allt är
tilbake til normalt.
Mer informatijon om problemet får du på disse sider: http://www.gandibar.net/post/2007/0...