Posts tagged as “service-alert”
After months of work, the new Delicious is almost ready to come out of the oven. When we release it, you’ll be automatically logged out of your account and will have to log in again, due to some changes we’re making behind the scenes.
That means now is a good time to make sure you know your username and password. Your username is what you see in the address bar when you visit your bookmarks (http://del.icio.us/your_username, soon to become http://delicious.com/your_username). And what’s your password? If you don’t remember, you can use our password reset tool to get a reset link delivered to the email address associated with your account.
But wait, is that email address correct and valid? You can check by visiting “change email” in your account settings when you’re logged in. Be sure to keep this address up to date. If the day comes when you’re logged out, you’ve forgotten your password, and the email address associated with your account is inaccessible or mistyped, we won’t be able to help you recover the password. So check it!
While we’re on the subject, remember that nobody from Delicious will ever ask you for your password. Also, don’t give your password to third-party sites that you don’t trust.
As we move toward launch day, we’ll keep you updated. Thanks for your patience and support, everyone.
July 26th, 2008
As part of our efforts to make del.icio.us even faster, we’re moving to a new set of servers this Sunday (12/17). This will require a brief site outage, which will begin at 12:00 noon Pacific and is expected to last two hours. We will be posting updates to this blog throughout the process. We apologize for the inconvenience and appreciate your patience. We’ll get it done as fast as possible.
Updates:
12:10 PST We’ve brought the site down and have begun doing upgrades.
12:46 PST Adding more servers …
1:05 PST Reticulating splines
1:51 PST Almost done, working on a few problems
1:59 PST Getting ready to bring the site back up
2:06 PST Brought RSS back up
2:23 PST Brought API back up
2:38 PST Main site is back up. Doing some cleanup behind the scenes.
3:06 PST All done. Please let us know if you see any problems.
December 14th, 2006
After a whole lot of work, we’re finally ready to migrate the main website to a new facility on Saturday, January 21st at 12 midnight EST. The site should dissapear only briefly as we switch. Some features, such as tag pages and feeds have already been running on the new hardware for a few days.
We’re moving to more and bigger hardware (we lost a number of machines in our previous power outages.) I’m looking forward to moving out of damage-control mode and continuing to roll out new features and functionality.
Update: We’ve done the migration. We’re working on a few minor issues but most stuff works.
Update: Tagrolls are fixed. Still working on the intersection issues.
January 20th, 2006
Our colocation facility bounced the power again (apparently in order to deal with the failed UPS that caused our previous incident.) We are on route to the facility to bring servers back online now and that should be done shortly. We have been and will continue to work with Yahoo! to migrate to better facilities as fast as humanly possible.
(chronology moved inside the post)
Update (10:50 PM EST): We are at the facility and are bringing up machines now.
Update (11:14 PM EST): Bringing up slaves now. Should be done shortly.
Update (12:09 PM EST): All but one server up now. Bringing up inbox, search, etc.
Update (12:20 PM EST): The facility will be cutting power back over to the UPS at 1 AM. Supposedly this will not affect service, but neither was the test that brought everything down… cross your fingers.
Update (2:04 AM EST): Still waiting for the cutover back to the UPS. They’re planning to give us an hour warning, and have not done so yet. We’ll bring down the site beforehand so we can boot cleanly in case they drop power again.
Update (6:37 AM EST): They just cut over power to the UPS and bounced power again. We’re bringing stuff back online again, everything should be good in a few minutes.
Update (6:57 AM EST): Everything is back online.
December 27th, 2005
Due to the power outage earlier in the week, we are dealing with a number of continued hiccups. We’ve taken everything offline to properly rebuild and restore everything. I apologize and hope to have this resolved as soon as possible. Thank you for your continued patience.
(Chronology moved inside the post)
Update: Indexes are almost done rebuilding. When that is done, we can then copy the data to the various database servers and start the service back up. Almost done — hang in there.
Update: Still waiting for the last remaining index to build. No data has been lost — we just need to fix the tables so the databases can find things quickly. This appears to be largely due to a RAID failure after our power outage earlier in the week - one of the indexes became corrupted and crashed the master database; for some reason the slaves replicated bad data from the master and then ended up crashing infinitely.
Update: We’re done rebuilding databases and I am now pushing copies to the slave servers. When that is done I can bring the site up.
Update: We are back up! Now working on tag intersections, the search engine, and the inbox. Yahoo! has started helping out, so I hope to provide a higher level of service as soon as possible.
December 18th, 2005
Our datacenter has had full power outage, and we are now recovering from the aftermath. About half of the machines are still down and we are working on bringing them back as soon as possible. To keep things moving, I’ve turned off RSS and some other features so that posting will still work and so that you will still have access to your bookmarks.
5pm EST Update: Everything is back up. We apologize for the inconvenience. It looks like a number of slave servers are corrupted. We’re rebuilding them now and taken the site down so this goes as quickly as possible.
Update: Some servers are coming up. Should be going much faster from here on in.
PS — we are obviously not yet on the Yahoo! infrastructure, and this is exactly the kind of stuff they can do a lot better for us (and you.)
Update: Most stuff is up, finally. Tag intersections are currently not working, and search is not updating — a few servers would not come up. We’ll bring them up tomorrow when we return to the east coast.
December 14th, 2005
