9 ms·
Respect to Jensen, one of the OGs of the valley and a good dude. But LLMs (eventually) running on iphone hardware will crater this run
by sf4lifer 3y ago
Respect to Jensen, one of the OGs of the valley and a good dude. But LLMs (eventually) running on iphone hardware will crater this run
- haldujai 3y agoNot sure how much inference on the edge will impact things unless you think we’ll hit “peak training” in the near future. I would safely wager that most H100 nodes will be used for training rather than inference.