5 ms·
Consider a model like https://huggingface.co/nvidia/NVIDIA-Nemotron-Parse-2.0 https://huggingface.co/nvidia/NVIDIA-Nemotron-Parse-2.0 which just came out. 0.9B
by cmrdporcupine 2mo ago
Consider a model like https://huggingface.co/nvidia/NVIDIA-Nemotron-Parse-2.0 https://huggingface.co/nvidia/NVIDIA-Nemotron-Parse-2.0 which just came out. 0.9B parameters and very accurate for doing a very specific task: document features classification.
Now imagine you have a chip which is just that model, but can do it at absolutely insane speed. Like tens of thousands of documents a second.
Same for things like text-to-speech or speech-to-text. Think of the accessibility wins if subtitling becomes insanely accurate and fast and omnipresent.
There are all sorts of domains like that, and the trend has been such that smaller models are getting smarter and smarter. If you can stick them in parking meters, traffic lights / street crossings, mobility aids, etc etc I just see so much potential win.