2 ms·
Very cool to learn about that device. I want to see how small I can get. The main surprise for me was being able to run the 7B parameters version
by willmccollum 2y ago
Very cool to learn about that device. I want to see how small I can get. The main surprise for me was being able to run the 7B parameters version
- bigyabai 2y agoNvidia's Orin Nano Super is pretty recent and a very neat little piece of kit for the price: https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-orin/nano-super-developer-kit/ https://www.nvidia.com/en-us/autonomous-machines/embedded-sy... Basically a 25 watt Raspberry Pi with an integrated CUDA-capable GPU. Haven't got one myself, but this probably represents the greatest size/performance inflection point for consumers right now.
- willmccollum 2y ago[dead]