4 ms·
How long until the language models stabilize enough that we can bake them into a low-cost, low-power chip for edge uses?
by 01100011 7y ago
How long until the language models stabilize enough that we can bake them into a low-cost, low-power chip for edge uses?
- foota 7y agoI think this is largely unnecessary, can't things like TPUs handle the inference?
- slashcom 7y agoThere’s lots of work on distillation, smaller models, approximations, etc. People already have simpler forms of these running on smartphones. Models seem to be growing faster than we can make them small though :D
- saurkt 7y agoYes, these things keep us up at night as well :-).