4 ms·
Llama.cpp with CUDA Support on Original Jetson Nano (4GB)
- Abishek_Muthian 7mo agoOriginal title: Llama.cpp with CUDA support on a Jetson Nano Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.
- politelemon 7mo agoNice work, the benchmarks don't look terrible for what it is, especially the prompt processing.