3 ms·
LlamaEdge is not just a tool to run chatbots. It is a dev platform for LLM apps with custom models and actions. It is lightweight and portable - you can create
by 3Sophons 3y ago
LlamaEdge is not just a tool to run chatbots. It is a dev platform for LLM apps with custom models and actions. It is lightweight and portable - you can create an LLM app on a Mac, compile to Wasm, and then run the binary app on Nvidia devices.