4 ms·
It this provides optimised hardware acceleration on Apple Silicon for low level machine learning libraries. PyTorch is supported for example, it’s a machine le
by simonh 4y ago
It this provides optimised hardware acceleration on Apple Silicon for low level machine learning libraries.
PyTorch is supported for example, it’s a machine learning library with GPU acceleration that’s been around for 6 years now. It’s used in a few commercial projects, including Tesla Autopilot. It can be used for natural language processing, image manipulation, and possibly to build an LLM I suppose, but as a low level library it just gives the base tech to build such systems from.
- JCharante 4y agoMy understanding is that llama.cpp is a port of meta’s llama release that uses PyTorch. Then I hope we can run llama with Apple Neural Engine.
- sebzim4500 4y agollama.cpp does not use PyTorch, it uses a niche ML library made by its creator that only runs on the CPU.
- JCharante 4y agoI’m under the impression that llama.cpp is a fork of llama (which uses pytorch)