4 ms·
best inference silicon in the world generally or specialized to smaller models/edge?
by whereismyacc 9mo ago
best inference silicon in the world generally or specialized to smaller models/edge?
- properbrew 9mo agoNot even an Apple fan, but from what I've been testing with for my dev use case (only up to 14b) it absolutely rocks for general models.
- whereismyacc 9mo agoThat I can absolutely believe but the big competition is in enterprise gpt-5-size models.