3 ms·
> plug in whatever agent you want Noob question: Does that include local models?
by zombot 9mo ago
> plug in whatever agent you want
Noob question: Does that include local models?
- vaxman 9mo agoOnly theoretically at this point, though they will tend to speak confidently enough about such untested capabilities so as to cause millions in investment losses to others. One would think a hardware manufacturer that's teetering on the abyss would go full out and implement a vLLM interface (maybe a folder of local models that can be downloaded as components in the Xcode-way and also a router too), but their NIH mentality has them tripping over their own Graydey's. There is nothing special about Apple Silicon except the head start they had and that they're squandering.