3 ms·
If we can print ASIC at low cost, this will change how we work with models. Models would be available as USB plug-in devices. A dense < 20B model may be the be
by brainless 8mo ago
If we can print ASIC at low cost, this will change how we work with models.
Models would be available as USB plug-in devices. A dense < 20B model may be the best assistant we need for personal use. It is like graphic cards again.
I hope lots of vendors will take note. Open weight models are abundant now. Even at a few thousand tokens/second, low buying cost and low operating cost, this is massive.