Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

What happens when the datacenter catches fire? (OVH in 2021).

If you're running a site like this, it's fine to be down for a bit, people will forgive you as you restore from backup (looks like a very solid foundation the site has).



The nice bit about this is, that you can deploy the same thing everywhere.

on other bare metals, or on AWS, azure, ...

As long as you have database backup, git code, and build-scripts.

I run something similar (although smaller). My disaster recovery is: I have everything prepared, to go on AWS, if necessary. Would take less, than 1 hr to be back up (database size being the biggest time sink). If I wanted to minimize that time, I could have small DB replica running, so I would just have to run last day of wall files. But for my purposes everything less than a day is good enough.

And then you can take a few days, to find something cheaper, to migrate to.


Pretty much this. I can quickly set up an entire new environment for my SaaS in under an hour; on a good day probably in about 10 minutes. It will run on any Linux environment: AWS, DigitalOcean, Linode, Azure, what-have-you.

At my last job we had one of those hyperfancy devops setups with all the fancy devops tools. Literally no one in the company knew how to spin up a new environment. I'm not exaggerating: no one knew how to run a dev environment and when they had to set up a new region for legal purposes it took weeks for the team. All of that was initially set up in an age of legends in the mythical past of a year and a half ago.

Theoretically it would all failover and scale to the moon and back. Emphasis on theoretically because no one seemed to understand how it all worked, so who knows how well it would behave when it failed. There was actually some major downtime in my time there which was rationalized away as "growing pains", but in in my opinion a major factor was just that no one really understood how it al worked.

If something goes wrong with a simple system then often the diagnosis and fix is simple (in this case: just deploy a new environment). If something goes wrong with a complex system then all of this is much harder.

Not saying you can't use these tools correctly or that there isn't an appropriate use for it, but it's a good case study on how the complexity can spin out of control if you're not careful in how you apply it.


The bus factor is 1. It's much more likely the dev can't do something for some reason than the datacenter catch fire.


> What happens when the datacenter catches fire? (OVH in 2021).

He has daily backups for that reason - those can be changed to hourly or even every 15-mins if needed.


His servers are distributed over multiple datacenters at the Falkenstein location of hetzner.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: