OVH SBG Offline - SBG2 Completely Destroyed

124

Comments

  • @elliotc said:
    Honestly, I don't expect the whole datacenter to go down.

    Neither did OVH.

    Thanked by (1)ehab
  • YmpkerYmpker OGContent Writer
    edited March 2021

    @kuroneko23 said:
    Is ExtraVM France server in SBG? I hope it's not.

    FRAKVM2 is down for 1 day: https://status.extravm.com/?m=5ef8c084b648c772cb2ff2f4

    Thanked by (1)kuroneko23
  • joepie91joepie91 OGServices Provider

    It appears that this was the construction of SBG2:

    And apparently they were using water sprinklers, not gas suppression.

    So yeah, fire waiting to happen.

    Thanked by (1)Janevski
  • RazzaRazza OG
    edited March 2021

    @joepie91 said:
    And apparently [they were using water sprinklers, not gas suppression

    The water based fire suppression system was probably just installed to comply with building fire code and keep the insurance company happy, but doubt they ever planned to use it as it would kill the servers.

    It seem like OVH penny pinched their data centre build a little too much wooded floor and inadequate fire suppression systems.

    I don't know much about fire suppression system just wondering dose anyone know roughly the cost of a proper gas based system.

  • Netcraft estimates 3.6 million websites across 464,000 distinct domains were taken offline because of this fire.

    Some of those will of course return when parts of SGB1, SGB3, SGB4 are put back online. However many of those will be changed into a dark cloud of smoke!

  • @Groentjuh said:
    Netcraft estimates 3.6 million websites across 464,000 distinct domains were taken offline because of this fire.

    Got data on how many spammers taken offline?

    Thanked by (1)yoursunny
  • I am guessing 3.5 million out of 3.6.

    Thanked by (1)kuroneko23

    ♻ Amitz day is October 21.
    ♻ Join Nigh sect by adopting my avatar. Let us spread the joys of the end.

  • 3.6 million websites, each losing millions in revenue every minute of downtime (/sarcasm) .... trillions of revenue loss might crash global markets.

    Thanked by (3)Ympker willie ariq01
  • edited March 2021

    @rajprakash said: 3.6 million websites, each losing millions in revenue every minute of downtime (/sarcasm) .... trillions of revenue loss might crash global markets.

    it's rather press-bs to blow up the numbers. 460k domains is not dramatic enough.
    if by websites they'd really mean different independent websites and not just (sub-)pages that means on average each domain needs to host 7 different independent websites.
    instead for sure some smartarse probably meant 3.6m simple pages, even if they belong to the very same website.

    but obviously it sounds much more dramatic if you tell the world 3.6 million websites are down. ?‍♂️

  • I saw something in one of the French news articles linked further up that the firefighters had trouble at first because they couldn't shut off the electricity to the DC, fwiw.

  • @willie said: because they couldn't shut off the electricity to the DC

    didn't one of Olés twitter messages after they went there say something about finally being able to shutoff the gens for SBG3? that made it sound like the gens were running the whole time and obviously posing some risk then.

  • Sorry for thise without backups. Offsite backup should be a must for every important thing you have online.

  • @Aaron said:

    @yoursunny said:
    Stay away from WordPress and make static websites!

    Guide please :)

    @joepie91 said:
    It appears that this was the construction of SBG2:

    And apparently they were using water sprinklers, not gas suppression.

    So yeah, fire waiting to happen.

    I could find a shipping container that cannot be set ablaze like their data center.

  • omega fail if they used the free ftp space from OVH to store backups, and it was at SBG1 though..

  • williewillie OG
    edited March 2021

    8 minute video of Oles speaking about the incident. I haven't watched it yet but he looks kind of stressed. Understandable of course. He does sound calm, at least in the first few seconds.

    https://www.ovh.com/fr/images/sbg/Octave-Klaba-speaking-en-vid.mp4

  • @willie said:
    8 minute video of Oles speaking about the incident. I haven't watched it yet but he looks kind of stressed. Understandable of course. He does sound calm, at least in the first few seconds.

    https://www.ovh.com/fr/images/sbg/Octave-Klaba-speaking-en-vid.mp4

    Poor guy probs hasn't slept in days.

    Thanked by (1)lentro
  • @dylightful said:
    Poor guy probs hasn't slept in days.

    It's really nice to see this sort of concern for the wellbeing of the folks dealing with this. It's easy to point fingers at what they could have done differently (I started thinking that way myself at first), but this must be an incredibly stressful time for all of the admins working to restore what they can.

  • This is a reminder to always take backups offsite in another DC

  • @FrozenPvPs said:
    This is a reminder to always take backups offsite in another DC

    Borg,encrypt,rclone ->(onedrive,gdrive,storage box) -> local/nas storage

  • @isunbejo said:

    @FrozenPvPs said:
    This is a reminder to always take backups offsite in another DC

    Borg,encrypt,rclone ->(onedrive,gdrive,storage box) -> local/nas storage

    Mine :
    encrypted local/nas storage -> gdrive unlimited :joy:

    I’m a simple man I see gifs, I press thanks

  • MikeAMikeA Hosting ProviderOG

    @kuroneko23 said:
    Is ExtraVM France server in SBG? I hope it's not.

    One of the Game line servers used for VPS was destroyed in the fire.

    Thanked by (1)Janevski

    ExtraVM - High RAM Specials
    Yours truly.

  • @MikeA said:

    One of the Game line servers used for VPS was destroyed in the fire.

    Ouch, any news from OVH about replacement?

  • MikeAMikeA Hosting ProviderOG

    @kuroneko23 said:

    @MikeA said:

    One of the Game line servers used for VPS was destroyed in the fire.

    Ouch, any news from OVH about replacement?

    no, it is OVH, I don't expect anything, it's fine.

    Thanked by (1)kuroneko23

    ExtraVM - High RAM Specials
    Yours truly.

  • edited March 2021

    @MikeA said:

    @kuroneko23 said:

    @MikeA said:

    One of the Game line servers used for VPS was destroyed in the fire.

    Ouch, any news from OVH about replacement?

    no, it is OVH, I don't expect anything, it's fine.

    They should have taken care of your server, not burn it down...
    Datacenters aren't supposed to burn down.
    That whole thing should have been fire retarded.
    I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.

    Wooden floor dacatenter... This is not fire retarded it's totally retarded.

    Thanked by (1)uptime
  • MikeAMikeA Hosting ProviderOG

    @Janevski said:

    @MikeA said:

    @kuroneko23 said:

    @MikeA said:

    One of the Game line servers used for VPS was destroyed in the fire.

    Ouch, any news from OVH about replacement?

    no, it is OVH, I don't expect anything, it's fine.

    They should have taken care of your server, not burn it down...
    Datacenters aren't supposed to burn down.
    That whole thing should have been fire retarded.
    I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.

    Wooden floor dacatenter... This is not fire retarded it's totally retarded.

    Lol yeah, it's the first I heard that their pods or whatever they are had wood floors. Blows my mind but whatever, it's rented servers, obviously nobody in their right mind would colo equipment in a place like that.

    Thanked by (1)Janevski

    ExtraVM - High RAM Specials
    Yours truly.

  • mikhomikho AdministratorHosting ProviderOG

    And here we talk about not hosting the backups in the same DC as your live data.
    It saddens me to read that they have different containers (DC) and still store their customers backup in the same as the live data.

  • cybertechcybertech OGBenchmark King
    edited March 2021

    @mikho said:
    And here we talk about not hosting the backups in the same DC as your live data.
    It saddens me to read that they have different containers (DC) and still store their customers backup in the same as the live data.

    that's how they managed to give 500GB free backup. right next door.

    this is a classic case of why backupception is necessary.

    I bench YABS 24/7/365 unless it's a leap year.

  • @MikeA said:

    @Janevski said:

    @MikeA said:

    @kuroneko23 said:

    @MikeA said:

    One of the Game line servers used for VPS was destroyed in the fire.

    Ouch, any news from OVH about replacement?

    no, it is OVH, I don't expect anything, it's fine.

    They should have taken care of your server, not burn it down...
    Datacenters aren't supposed to burn down.
    That whole thing should have been fire retarded.
    I know of dirt cheap storage concrete only communist buildings, that is very hard to burn down.

    Wooden floor dacatenter... This is not fire retarded it's totally retarded.

    Lol yeah, it's the first I heard that their pods or whatever they are had wood floors. Blows my mind but whatever, it's rented servers, obviously nobody in their right mind would colo equipment in a place like that.

    And i'd bet that they put all cabling, power and network below that wood...

  • Well, they had it running for a bit but then smoke appeared again.

    Thanked by (2)yoursunny Janevski
  • @Neoon said:
    Well, they had it running for a bit but then smoke appeared again.

    probably not smoke but rather gas if it came from batteries and without fire. hydrogen tends to explode though... go figure.

Sign In or Register to comment.