4 ms·
Another wakeup call to realize how desperately we need on-device LLMs to be fast and smart for daily use. Thankfully, every month there's progress made in that
by docheinestages 3mo ago
Another wakeup call to realize how desperately we need on-device LLMs to be fast and smart for daily use. Thankfully, every month there's progress made in that direction. Just imagine how your life as a developer would be if you had to use a cloud provider to run Python, and the provider's status page looked like the Christmas tree we see today.