4 ms·
There's nothing provided here other than Jeff Dean gave a stock entry-level presentation to students at Rice, therefore "The depth of institutional knowledge th
by refulgentis 3y ago
There's nothing provided here other than Jeff Dean gave a stock entry-level presentation to students at Rice, therefore "The depth of institutional knowledge that is going to be unlocked inside Google is actually frightening for me to consider."
You should see Google's turnover numbers from 4 years ago, much less now.
It's been years, it's broken internally, we see the results.
Here, we're in awe of 1KLOC of C++ code that runs inference on the CPU.
Nobody serious is running inference on CPU unless you're on the extreme cutting edge. (ex. I need to on Android and on the Chrome OS Linux VM, but I still use llama.cpp because it does support GPU everywhere else)
I'm not sure what else to say.
(n.b. i am a xoogler)
- janwas 3y agoWe understand that some teams prefer to use CPU even when mobile GPU would be available. This code is also intended to facilitate research & experimentation, which may not fall under your definition of 'serious' :)
- whitten 3y agoAre there any online transcripts or recordings of the Rice presentation from Jeff Dean ?
- refulgentis 3y agoYes, footer of parent: https://youtu.be/oSCRZkSQ1CE?si=Na1d1cK3TApDhkSO https://youtu.be/oSCRZkSQ1CE?si=Na1d1cK3TApDhkSO
- iaseiadit 3y ago> You should see Google's turnover numbers from 4 years ago, much less now. High turnover was industry-wide a few years back because pay went through the roof and job hopping was the best way to capture that. I suspect it’s lower now, following mass layoffs and substantially fewer openings.