3 ms·

Selfhost LLMs like Mixtral 8x7B on the Edge & across devices.

• 3Sophons 3y ago
  Fully portable inference app only 2MB. Try it on your Mac with one single command: https://www.secondstate.io/run-llm/ https://www.secondstate.io/run-llm/