4 ms·
Portable LLM Across GPUs/CPUs/OSes: WASM for Cloud-Native and Edge AI [video]
- 3Sophons 2y agoLive demos start from 10:40, • Setting up LlamaEdge API server. • Packaging it as a Wasm container image. • Running the image using Docker. • Deploying in a Kubernetes cluster.