3 ms·
> Maybe someone can help me understand why people are investing into this. Buying a Mac for running LLMs is kinda like buying a Mac for gaming. Its thoeretical
by brucethemoose2 3y ago
> Maybe someone can help me understand why people are investing into this.
Buying a Mac for running LLMs is kinda like buying a Mac for gaming. Its thoeretically interesting, but I don't think thats a serious driver of Mac sales.
But:
- Finetuned local LLMs are good for specific niches, like roleplaying, text games, and helper bots for your own pile of data. And they are getting better at other niches like code completion for specific languages, or summarization.
- Remember that a huge selling point for Macs is iPhone/iPad development. The market for AI App Store apps is not small.This is also a reason to believe there will be some stability with the ML support.
- MuffinFlavored 3y ago> - Finetuned local LLMs are good for specific niches, like roleplaying, text games, and helper bots for your own pile of data. I can't see how they don't hallucinate/are leagues away from GPT-3.5 let alone GPT-4 level of quality of output. Am I mistaken?
- brucethemoose2 3y agoThey are better than GPT 3.5 (which I am generally not impressed with), but not as good as GPT4. Again, the specialized variants perform very well in their niches.
- gmerc 3y agoYou seem to assume hallucinations are a fatal flaw. You give it a document to summarize and see how often it hallucinates. Very little. Human performance. Now often does a human make random shit up about general knowledge questions?
- astrange 3y agoHallucinations are exactly what you want in a gaming model. That's another way of saying "creativity".
- deleted 3y ago[deleted]