3 ms·

Ops folks: do you have dedicated networking hardware you can push config changes to as a sandbox of prod? Does Facebook? Do they get simulated or shadowed traff

• notyourday 5y ago
  FB's mistake was using this kind of complicated over-engineered setup. It works great when it works... but when it does not, it blows up everything and its complexity means recovery is extremely complicated.
  • wolverine876 5y ago
    They've been pretty successful.
• pid-1 5y ago
  My first job was working in data centers for telecos and my impression was that everything was one cable trip away from never working again. Networks were really complex, nothing was documented nor deployed as code, most equipment were untestable black boxes, people who deployed stuff moved on, etc... Just thinking about working with on prem again gives me chills. But maybe FB knows better than telecos, IDK.