4 ms·
WasmEdge 0.13.5 is out. CUDA enabled on ggml/llama.cpp plugin on arm64/x86_64 Linux. The following video works on the Jetson AGX Orin 64GB developer kit.https:
by 3Sophons 3y ago
WasmEdge 0.13.5 is out.
CUDA enabled on ggml/llama.cpp plugin on arm64/x86_64 Linux.
The following video works on the Jetson AGX Orin 64GB developer kit.https://x.com/hydai_tw/status/1720682591790211412?s=46&t=H6NwBvskGjyjh8vuAko_KA https://x.com/hydai_tw/status/1720682591790211412?s=46&t=H6N...
TPS 14~17