3 ms·
Options for accessing Llama 3 from the terminal using LLM
- deleted 3y ago[deleted]
- skeptrune 3y agoI tend to think openrouter is the most interesting and best choice for the majority of builders. It's incredibly easy to test and even offers convenient abstracted provider load balancing to reduce high latency events.
- simonw 3y agoHave you seen the load balancing feature work? It's neat on paper, I'd be interested to hear from people who it's kicked in for.