4 ms·
Somehow FB has made all the common operations work in <6 seconds with millions of files...
by Lt_Riza_Hawkeye 6y ago
Somehow FB has made all the common operations work in <6 seconds with millions of files...
- gravypod 6y agoIt's an impressive feat but something I find even more impressive is the scale they need to be prepared for. The performance challenges of maintaining infrastructure for as many developers as Facebook/Google employ is constant and demanding. At my extremely small startup in the past ~6 months I've made about 1,000 files (@ HEAD, not including deletions). So, maybe, at the absolute worst case each engineer could produce ~150 files/month. Facebook likely has ~1,000 engineers. That's a worst case 1,800,000 files/year + an existing massive code base. Good luck to the engineers who are forever battling the scaling issues underlying these orgs! It's extremely impressive to even hear about overcoming these huge hurdles.
- tehlike 6y agoFacebook has way more than 1000 engineers :)
- tehlike 6y agoIt all breaks down when it does not because watchman decides to come to a halt and basic arc pull takes more than 10mins after a week of no action on the repo :)
- millstone 6y agoWatchman is gone!