@joepie91 said:
And apparently [they were using water sprinklers, not gas suppression
The water based fire suppression system was probably just installed to comply with building fire code and keep the insurance company happy, but doubt they ever planned to use it as it would kill the servers.
It seem like OVH penny pinched their data centre build a little too much wooded floor and inadequate fire suppression systems.
I don't know much about fire suppression system just wondering dose anyone know roughly the cost of a proper gas based system.
Netcraft estimates 3.6 million websites across 464,000 distinct domains were taken offline because of this fire.
Some of those will of course return when parts of SGB1, SGB3, SGB4 are put back online. However many of those will be changed into a dark cloud of smoke!
@rajprakash said: 3.6 million websites, each losing millions in revenue every minute of downtime (/sarcasm) .... trillions of revenue loss might crash global markets.
it's rather press-bs to blow up the numbers. 460k domains is not dramatic enough.
if by websites they'd really mean different independent websites and not just (sub-)pages that means on average each domain needs to host 7 different independent websites.
instead for sure some smartarse probably meant 3.6m simple pages, even if they belong to the very same website.
but obviously it sounds much more dramatic if you tell the world 3.6 million websites are down. ?♂️
I saw something in one of the French news articles linked further up that the firefighters had trouble at first because they couldn't shut off the electricity to the DC, fwiw.
@willie said: because they couldn't shut off the electricity to the DC
didn't one of Olés twitter messages after they went there say something about finally being able to shutoff the gens for SBG3? that made it sound like the gens were running the whole time and obviously posing some risk then.
8 minute video of Oles speaking about the incident. I haven't watched it yet but he looks kind of stressed. Understandable of course. He does sound calm, at least in the first few seconds.
@willie said:
8 minute video of Oles speaking about the incident. I haven't watched it yet but he looks kind of stressed. Understandable of course. He does sound calm, at least in the first few seconds.
@dylightful said:
Poor guy probs hasn't slept in days.
It's really nice to see this sort of concern for the wellbeing of the folks dealing with this. It's easy to point fingers at what they could have done differently (I started thinking that way myself at first), but this must be an incredibly stressful time for all of the admins working to restore what they can.
One of the Game line servers used for VPS was destroyed in the fire.
Ouch, any news from OVH about replacement?
no, it is OVH, I don't expect anything, it's fine.
They should have taken care of your server, not burn it down...
Datacenters aren't supposed to burn down.
That whole thing should have been fire retarded.
I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.
Wooden floor dacatenter... This is not fire retarded it's totally retarded.
One of the Game line servers used for VPS was destroyed in the fire.
Ouch, any news from OVH about replacement?
no, it is OVH, I don't expect anything, it's fine.
They should have taken care of your server, not burn it down...
Datacenters aren't supposed to burn down.
That whole thing should have been fire retarded.
I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.
Wooden floor dacatenter... This is not fire retarded it's totally retarded.
Lol yeah, it's the first I heard that their pods or whatever they are had wood floors. Blows my mind but whatever, it's rented servers, obviously nobody in their right mind would colo equipment in a place like that.
And here we talk about not hosting the backups in the same DC as your live data.
It saddens me to read that they have different containers (DC) and still store their customers backup in the same as the live data.
@mikho said:
And here we talk about not hosting the backups in the same DC as your live data.
It saddens me to read that they have different containers (DC) and still store their customers backup in the same as the live data.
One of the Game line servers used for VPS was destroyed in the fire.
Ouch, any news from OVH about replacement?
no, it is OVH, I don't expect anything, it's fine.
They should have taken care of your server, not burn it down...
Datacenters aren't supposed to burn down.
That whole thing should have been fire retarded.
I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.
Wooden floor dacatenter... This is not fire retarded it's totally retarded.
Lol yeah, it's the first I heard that their pods or whatever they are had wood floors. Blows my mind but whatever, it's rented servers, obviously nobody in their right mind would colo equipment in a place like that.
And i'd bet that they put all cabling, power and network below that wood...
Comments
Neither did OVH.
FRAKVM2 is down for 1 day: https://status.extravm.com/?m=5ef8c084b648c772cb2ff2f4
Ympker's VPN LTD Comparison, Uptime.is, Ympker's GitHub.
It appears that this was the construction of SBG2:
And apparently they were using water sprinklers, not gas suppression.
So yeah, fire waiting to happen.
The water based fire suppression system was probably just installed to comply with building fire code and keep the insurance company happy, but doubt they ever planned to use it as it would kill the servers.
It seem like OVH penny pinched their data centre build a little too much wooded floor and inadequate fire suppression systems.
I don't know much about fire suppression system just wondering dose anyone know roughly the cost of a proper gas based system.
Netcraft estimates 3.6 million websites across 464,000 distinct domains were taken offline because of this fire.
Some of those will of course return when parts of SGB1, SGB3, SGB4 are put back online. However many of those will be changed into a dark cloud of smoke!
Got data on how many spammers taken offline?
OnePoundEmail (aff link)
I am guessing 3.5 million out of 3.6.
♻ Amitz day is October 21.
♻ Join Nigh sect by adopting my avatar. Let us spread the joys of the end.
3.6 million websites, each losing millions in revenue every minute of downtime (/sarcasm) .... trillions of revenue loss might crash global markets.
it's rather press-bs to blow up the numbers. 460k domains is not dramatic enough.
if by websites they'd really mean different independent websites and not just (sub-)pages that means on average each domain needs to host 7 different independent websites.
instead for sure some smartarse probably meant 3.6m simple pages, even if they belong to the very same website.
but obviously it sounds much more dramatic if you tell the world 3.6 million websites are down. ?♂️
I saw something in one of the French news articles linked further up that the firefighters had trouble at first because they couldn't shut off the electricity to the DC, fwiw.
didn't one of Olés twitter messages after they went there say something about finally being able to shutoff the gens for SBG3? that made it sound like the gens were running the whole time and obviously posing some risk then.
Sorry for thise without backups. Offsite backup should be a must for every important thing you have online.
I could find a shipping container that cannot be set ablaze like their data center.
omega fail if they used the free ftp space from OVH to store backups, and it was at SBG1 though..
RouteIX Networks :: Dedicated Servers in Fremont, California :: AS211954
Optix Transit :: Free IPv6 Transit :: AS209870
8 minute video of Oles speaking about the incident. I haven't watched it yet but he looks kind of stressed. Understandable of course. He does sound calm, at least in the first few seconds.
https://www.ovh.com/fr/images/sbg/Octave-Klaba-speaking-en-vid.mp4
Poor guy probs hasn't slept in days.
It's really nice to see this sort of concern for the wellbeing of the folks dealing with this. It's easy to point fingers at what they could have done differently (I started thinking that way myself at first), but this must be an incredibly stressful time for all of the admins working to restore what they can.
This is a reminder to always take backups offsite in another DC
Borg,encrypt,rclone ->(onedrive,gdrive,storage box) -> local/nas storage
Mine :
encrypted local/nas storage -> gdrive unlimited
I’m a simple man I see gifs, I press thanks
One of the Game line servers used for VPS was destroyed in the fire.
ExtraVM - High RAM Specials
Yours truly.
Ouch, any news from OVH about replacement?
OnePoundEmail (aff link)
no, it is OVH, I don't expect anything, it's fine.
ExtraVM - High RAM Specials
Yours truly.
They should have taken care of your server, not burn it down...
Datacenters aren't supposed to burn down.
That whole thing should have been fire retarded.
I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.
Wooden floor dacatenter... This is not fire retarded it's totally retarded.
Lol yeah, it's the first I heard that their pods or whatever they are had wood floors. Blows my mind but whatever, it's rented servers, obviously nobody in their right mind would colo equipment in a place like that.
ExtraVM - High RAM Specials
Yours truly.
And here we talk about not hosting the backups in the same DC as your live data.
It saddens me to read that they have different containers (DC) and still store their customers backup in the same as the live data.
https://clients.mrvm.net
that's how they managed to give 500GB free backup. right next door.
this is a classic case of why backupception is necessary.
I bench YABS 24/7/365 unless it's a leap year.
And i'd bet that they put all cabling, power and network below that wood...
Well, they had it running for a bit but then smoke appeared again.
Free NAT KVM | Free NAT LXC
probably not smoke but rather gas if it came from batteries and without fire. hydrogen tends to explode though... go figure.