3 ms·
> like having a single engineer spend 250k in tokens or he’d fire him; That’s not quite what was said there, he’s budgeting half a devs salary as token spend
by IanCal 3mo ago
> like having a single engineer spend 250k in tokens or he’d fire him;
That’s not quite what was said there, he’s budgeting half a devs salary as token spend in a podcast and that if he had a 500k engineer who spent 5k on it at the end of the year he’d go ape shit.
Now you can say that’s wild, and sure, but this is not a standard c suite exec talking it’s the ceo of Nvidia.
Even ignoring other hiring costs this is essentially an argument that Nvidia top engineers should get more than a 50% performance improvement with extremely heavy AI usage. To me, that doesn’t seem like such an enormous statement. For the head of a multi trillion dollar company entirely driven by AI sales arguing it gives a useful benefit to engineers isn’t that odd and betting on a 50% improvement within Nvidia seems kinda normal.
> Seriously have you ever actually talked to an average C-Level about AI?
Yes. Single digit percentage improvements over time would normally excite them, the idea of cappable cost performance improvements that last which your devs actually want to experiment with and a cultural and customer expectation that you’re doing this is pretty enticing. Particularly during a time when tokens were heavily subsidised - isn’t that the perfect time to do it? Now that has ended there’s a huge focus on roi.