5 ms·
If you burn a model to a chip what happens if there's a better model?
by david_shi 4mo ago
If you burn a model to a chip what happens if there's a better model?
- scarmig 4mo agoYou have a slightly less great model. Depending on your thesis on how fast AI will advance, that might be minimal, or it might be huge. However, "AI is advancing too fast for people to make obvious efficiency improvements economically worth doing" is rather hard to square with "AI is a lie and will never generate profits."
- nosioptar 4mo agoI had the same question. I wondered if it'd be possible to use a rewritable chip or a socketed chip...
- unknown_user_84 4mo agoNot sure about sockets but I've seen a company with a wafer sized TPU thing or whatever. They claim to have an approach to route around the defects and I had to scroll past some press release I didn't read about the stock market, so someone believes in them I guess. They sell a mini-fridge that can handle a model with trillions of parameters with a contact sales button. Cerberas is their name. I actually ended up misremembering the name name of Taalas as Cerberas and discovered them when I was researching the above comment. Taalas burns models to chips. Cerberas makes pizza sized chips.
- jv22222 4mo agoThey will come with corrective SSD and Ram that will enable stale models to get some amount of self correction. Then after that it will be a typical upgrade path. Actually a nice business model with upgrades built in.
- sameAsItEvrwas 4mo agoSame thing we do now given chips that do not have an OS and apps built in... write them to storage and load them into volatile memory at runtime.