3 ms·
>local inference hardware (NPU on Arm SoC). Okay the battle is already lost from the beginning.
by GaggiX 2y ago
>local inference hardware (NPU on Arm SoC).
Okay the battle is already lost from the beginning.
- walterbell 2y agoThere are alternatives to NVIDIAmaxing with brute force. See the Chinese paper on DeepSeek V3, comparable to recent GPT and Claude, trained with 90% fewer resources. Research on efficient inference continues. https://github.com/deepseek-ai/DeepSeek-V3/blob/main/DeepSeek_V3.pdf https://github.com/deepseek-ai/DeepSeek-V3/blob/main/DeepSee...