Results 1 to 10 of 10

Thread: Extended Outage

  1. Cash0 Extended Outage


    Long story short, an entire street of data centers in Atlanta lost power and every host, and thereby every hosting company and every hosted site, went out. The outage was long enough that UPS' couldn't have sustained them but could've bought them time to do graceful shutdowns, had they had any, and of course any major host normally has actual backup generators to run indefinitely during outage, but apparently our latest had nothing whatsoever, so we went down hard, for a good six hours, and when we came up the database was understandably upset and had to be talked back down off a ledge before it'd run.

    Once the database was restored we were still dead though because the ipv6 bridge between our web server and db server stopped functioning. Somewhere in the provider's network is a piece of equipment someone forgot to turn back on I think, so that had to be hunted down and traced through to determine whether it was something that died in our configs or an actual network issue as it was, and then we had to reroute everything back to ipv4 until it can be corrected.

    Now we're back up and semi running while I try to find any gaping holes in our data other than whatever was occurring at the exact minute we died.

  2. Default Re: Extended Outage


    Oh I know that feel. My power went off yesterday as well.

  3. Default Re: Extended Outage


    Good timing! I was refreshing this site a few times and I'm glad is back up :) Waited a couple of minutes when it was down.

  4. Default Re: Extended Outage


    oh, so that's why I tried to access the site since 6 hours ago and failing miserably.
    Glad the site's back up!
    Last edited by SoR0XaS; 2013-06-30 at 03:28 AM. Reason: wtp is wrong with my grammar today


  5. Default Re: Extended Outage


    protip : to check if a site's down use www.isup.me

  6. Default Re: Extended Outage


    I prefer http://isitup.org/

  7. Default Re: Extended Outage


    A better explanation of how exactly this managed to happen for those who were as baffled as I;

    And as a nice relief;

    That'll definitely help us with the recent issues we've had with advertising outages and whatnot on top of this.


  8. Default Re: Extended Outage


    I hope they're shopping for a new generator.

  9.  

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •