3 ms·
You can run distilled LLMs on your phone today that are surprisingly good. In 3-4 years I think an individual could self host for much less than thousands a mon
by cyberlurker 2y ago
You can run distilled LLMs on your phone today that are surprisingly good. In 3-4 years I think an individual could self host for much less than thousands a month.
This wouldn’t be my biggest worry.