2 ms·
>Max Junestrand has consistently said Legora treats the model layer as swappable, selecting across frontier providers rather than building the product around on
by TZubiri 8d ago
>Max Junestrand has consistently said Legora treats the model layer as swappable, selecting across frontier providers rather than building the product around one.
Vendor-neutrality for LLMs is such a weak thesis all around, whether for providers or consumers. It weakens the product by being promiscuous and gains no material benefit at all.
LLMs are magic byte(byte) functions, it doesn't make sense to say "we have different providers for magic".
- datadrivenangel 8d agoDifferent flavors of magic require different ritual components and in the name of all that is stable and production worthy, please don't get a necromancer to do your civil construction magic. Vendor-neutrality helps reduce lock-in, and OpenAI and Anthropic are big enough that the reduction is valuable.
- noisy_boy 8d agoReally? Even when the magic is differently priced across magicians?
- alansaber 8d agoThis is exactly how I would explain inference to a medieval peasant.