PDA

View Full Version : Site outage: 1/18/2010



BDRyan
2010-01-18, 04:27 PM
As many of you had noticed, Southperry died approximately 5:15-5:45 AM CST or so and was completely inaccessible for most of the day.

This was due to the disk space running out on the server for an unknown reason. Whenever the disk fills up on the server, the webserver will refuse to answer all requests until the disk is sufficiently freed up (since it needs to be able to write the logfile and with the disk being full, it can't do that).

Unfortunately, this condition also locked the admins out of the remote terminal (since it needs disk space to log as well), which prevented us from clearing the disk out ourselves, and forced us to contact the host for assistance, which at that hour wasn't possible until around 8 AM CST or so, and since I had to go to work shortly thereafter, I was not available to restart anything once the issue was repaired.

I returned home from work shortly before 4 PM CST this afternoon, and found the server had been repaired and only needed to have its services restarted (web, IRC [terra.southperry.net], etc), so I promptly did just that.

So. If my count's correct...Southperry was down for about 11 hours...which I know to a lot of you is truly unacceptable and I do apologize for not being around to get this back up...but I can't simply call off going to work for this, I'd get fired if I did that.

Sorry you guys had to wait that long for me to get things going again. I'll be working on a few countermeasures in the background to ensure this doesn't happen again. Thanks for your patience and welcome back!

BDRyan
Southperry.net Systems Admin

Jon
2010-01-18, 04:29 PM
Thank you, Ryan.

Takebacker
2010-01-18, 04:31 PM
While in the meantime i heard rumors of DDoS attacks. >_>

Was worried.

Kawasari Mimoto
2010-01-18, 04:39 PM
Your life comes before your 'free' work as a message-boards administrator. Albeit, you have responsibilities as an admin, no one here on this forum would want you to 'call-off' work just to attend to a forum. If that was the case, any member here that thinks like that should go hang themselves. Point being, no biggie, BD. It happens. Glad the message boards are up and functional!

Kirov
2010-01-18, 04:39 PM
I think everyone will understand you have a job, or at least those of us that work will.

Mazz
2010-01-18, 04:45 PM
Ah, fair enough. I also heard rumours about the site having been hacked/DDoS attacked, but I'm glad it wasn't serious. Thanks for the update.

Heidi
2010-01-18, 06:49 PM
I wish I'd started a rumour about Nexon DDoS'ing Southperry now :(

Sarah
2010-01-18, 06:58 PM
I wish I'd started a rumour about Nexon DDoS'ing Southperry now :(

No one started a rumour, Takebacker is dumb and was eavesdropping on my conversation with Isaac on maple where I had said that I was worried that that was the cause.

edit: nevermind just read Mazz said he heard it too and obviously he's not on my BL

Takebacker
2010-01-18, 07:01 PM
Takebacker is dumb


nevermind just read Mazz said he heard it too and obviously he's not on my BL

Believe an appology is in order. :f3:

Greg
2010-01-18, 07:18 PM
I forgive you, BD.

Heidi
2010-01-18, 07:23 PM
I was joking. I never said anybody started a rumour like that.

Sarah
2010-01-18, 07:29 PM
Believe an appology is in order. :f3:

Nope, I saw your response on maple when I said it so I know your response here was at least partially prompted by what I said. Dumbface.

y0y0y0y0shi0
2010-01-18, 09:25 PM
That is an unacceptable amount of time that the forums were down for. I demand to have an 4 day 2x exp event.

Meh. It was fun hanging out in the IRC for most of the day. XD

SlayerZach
2010-01-18, 09:52 PM
Every time Southperry is down, I get worried. It's my home away from home. Anywho, I'm glad that the problem is resolved and I thank you, Ryan. :glitter:

TøbiasBlack
2010-01-18, 09:58 PM
i wasnt hit by it, as i was at work myself and woke up at noon. but people know work > SP.

Will
2010-01-18, 10:04 PM
It's okay. :f2:

IllegallySane
2010-01-18, 10:04 PM
I was worried those Vent hackers somehow hit SP. Thanks for the explanation and your help in starting up SP again BDog!

Dual
2010-01-18, 10:31 PM
I really need to favorite the irc channel, because I couldn't find my way back to it while the site was down.

Kalovale
2010-01-18, 11:06 PM
Hope the site stays, even after Maple *may* have died.