5 ms·

I wonder how many of this sort of FAANG project really get used where they are built. I went for an interview at a FAANG years ago to work on a very big consume

by sgt101 3y ago

I wonder how many of this sort of FAANG project really get used where they are built. I went for an interview at a FAANG years ago to work on a very big consumer product (when it was in relative infancy) and expected to find a hyper tech data backend to use... they told me that they were using mySQL. I didn't get the job so maybe they were just joking around with me - but the general despair that they evinced about their data situation makes me wonder!

bezosdontpipme 3y ago
I can neither confirm nor deny that S3’s global bucket database is actually just MySql (with a lil bit of special sauce)
- sgt101 3y ago
  tbh my general response to all data questions is "use postgres". It does happen that someone comes back with a good reason why that would be a bad idea, but it's not frequent! mySQL == Oracle now... so bad on theological grounds.
  - astrange 3y ago
    You can use MariaDB.
- nonrandomstring 3y ago
  And why ever not? It's a perfectly good solution, no? What the GP alludes to is interesting though - mythologising of organisations, brands and names. Spend enough time with "famous" people, "big names", centres of power and prominence and you quickly see everyone is just ordinary dudes doing ordinary things with ordinary gear. But for some reason there's fuck loads of money and attention, and sometimes cloying paranoia and adulation floating around. Sure, right out on the periphery are a noble few who play with particle accelerators, spaceships and bunker supercomputers. But then, that's just a day job too. True genius/exceptionalism is rare and found in the unexpected places. The rest is conjured out of thin air by marketing and PR people, the press, and commentators. They are the ones who need the big legend.
- influx 3y ago
  Yeah, but I bet you the S3 Keymap isn't MySQL....
ipsum2 3y ago
Facebook/meta uses mySQL, but with a completely different engine (myrocks) and sharding techniques. YouTube uses mySQL but they've also rewritten major portions for scalability. (Vitess) Just because a company is using a technology you've heard of doesn't mean it's what you expect.
- emptysea 3y ago
  YouTube uses Spanner now, they migrated off Vitess a while ago
  - wferrell 3y ago
    Can you share why they migrated? Vitess seemed to be working for them for a long time.
    - harshitgangal 3y ago
      When Vitess was donated to CNCF, there was an internal push from within Google to migrate everything to Spanner. I do not know any other reason. Disclaimer: Vitess Maintainer
- riku_iki 3y ago
  > YouTube uses mySQL but they've also rewritten major portions for scalability. (Vitess) I imagine this is some very old info(like 10 yo) and could change since then?
philjohn 3y ago
At Meta they probably don't get built unless they're impactful, and they're not impactful if they're not used in production to solve a real pain point.
- manzanarama 3y ago
  More like, everything gets build because someone wants to get promoted.
  - bigcat12345678 3y ago
    That's just some urban myth about promotion in big corp Yes There are a lot of vanity projects that get someone promoted for the wrong reasons That only get broadcasted because that's the newsworthy. You won't get up voted when you share a small story about someone did hard problem and get promoted. Overwhelmingly, people get promoted because they solve challenging problems with meaningful impact. That's how capitalism and modern corporation work. But above the baseline there is a lot of errors, exceptions, and manipulations. Because that's how people do everyday: they want to game the system for their own gains. Human nature. There are just so many of them because big corps are big. And that's why big corps eventually lost their vigor. The best way to combat promotion bullshit and other corporate bullshit, it's to recognize them, call them out in the right technique (being diplomatic and protect yourself) and don't practice yourself. Yes, don't practice the bullshit. That's extraordinarily difficult.
    - fshbbdssbbgdd 3y ago
      I think it’s true both that most promotions are legit and not based on vanity projects, and yet still the vanity projects are common and causing major problems. Let’s say you have 10k engineers at your megacorp. Maybe the ideal number of execution platform workflow framework engines your business needs to add this year is 30, but instead 300 are created by 3% of your engineers who wants a promotion. Eventually you have thousands of these frameworks, maintaining them is a drag, everyone is suffering, although the vast majority are good actors.
kgp7 3y ago
This is being actively used at Meta in Production across several engines ; the paper makes explicit references to this.
deleted 3y ago
[deleted]

by sgt101 3y ago

bezosdontpipme 3y ago

I can neither confirm nor deny that S3’s global bucket database is actually just MySql (with a lil bit of special sauce)

sgt101 3y ago
tbh my general response to all data questions is "use postgres". It does happen that someone comes back with a good reason why that would be a bad idea, but it's not frequent! mySQL == Oracle now... so bad on theological grounds.
- astrange 3y ago
  You can use MariaDB.
nonrandomstring 3y ago
And why ever not? It's a perfectly good solution, no? What the GP alludes to is interesting though - mythologising of organisations, brands and names. Spend enough time with "famous" people, "big names", centres of power and prominence and you quickly see everyone is just ordinary dudes doing ordinary things with ordinary gear. But for some reason there's fuck loads of money and attention, and sometimes cloying paranoia and adulation floating around. Sure, right out on the periphery are a noble few who play with particle accelerators, spaceships and bunker supercomputers. But then, that's just a day job too. True genius/exceptionalism is rare and found in the unexpected places. The rest is conjured out of thin air by marketing and PR people, the press, and commentators. They are the ones who need the big legend.
influx 3y ago
Yeah, but I bet you the S3 Keymap isn't MySQL....

ipsum2 3y ago

Facebook/meta uses mySQL, but with a completely different engine (myrocks) and sharding techniques. YouTube uses mySQL but they've also rewritten major portions for scalability. (Vitess) Just because a company is using a technology you've heard of doesn't mean it's what you expect.

emptysea 3y ago
YouTube uses Spanner now, they migrated off Vitess a while ago
- wferrell 3y ago
  Can you share why they migrated? Vitess seemed to be working for them for a long time.
  - harshitgangal 3y ago
    When Vitess was donated to CNCF, there was an internal push from within Google to migrate everything to Spanner. I do not know any other reason. Disclaimer: Vitess Maintainer
riku_iki 3y ago
> YouTube uses mySQL but they've also rewritten major portions for scalability. (Vitess) I imagine this is some very old info(like 10 yo) and could change since then?

philjohn 3y ago

At Meta they probably don't get built unless they're impactful, and they're not impactful if they're not used in production to solve a real pain point.

manzanarama 3y ago
More like, everything gets build because someone wants to get promoted.
- bigcat12345678 3y ago
  That's just some urban myth about promotion in big corp Yes There are a lot of vanity projects that get someone promoted for the wrong reasons That only get broadcasted because that's the newsworthy. You won't get up voted when you share a small story about someone did hard problem and get promoted. Overwhelmingly, people get promoted because they solve challenging problems with meaningful impact. That's how capitalism and modern corporation work. But above the baseline there is a lot of errors, exceptions, and manipulations. Because that's how people do everyday: they want to game the system for their own gains. Human nature. There are just so many of them because big corps are big. And that's why big corps eventually lost their vigor. The best way to combat promotion bullshit and other corporate bullshit, it's to recognize them, call them out in the right technique (being diplomatic and protect yourself) and don't practice yourself. Yes, don't practice the bullshit. That's extraordinarily difficult.
  - fshbbdssbbgdd 3y ago
    I think it’s true both that most promotions are legit and not based on vanity projects, and yet still the vanity projects are common and causing major problems. Let’s say you have 10k engineers at your megacorp. Maybe the ideal number of execution platform workflow framework engines your business needs to add this year is 30, but instead 300 are created by 3% of your engineers who wants a promotion. Eventually you have thousands of these frameworks, maintaining them is a drag, everyone is suffering, although the vast majority are good actors.

kgp7 3y ago

This is being actively used at Meta in Production across several engines ; the paper makes explicit references to this.

deleted 3y ago

[deleted]