4 ms·
Isnt Strix Halo and apple's m series a bit different. Iirc you need to choose how much ram will be allocated to the igpu, whereas on mac it is all handled dynam
by notenlish 9mo ago
Isnt Strix Halo and apple's m series a bit different. Iirc you need to choose how much ram will be allocated to the igpu, whereas on mac it is all handled dynamically.
- Tsiklon 9mo agoOn the Mac it's all dynamically handled. With Strix Halo there's two ways of going about it; either set how much memory you want allocated to GPU in BIOS (Less desirable), or set the memory allocation to the GPU to 512MB in the BIOS, and the driver will do it all dynamically much like on a Mac.
- adgjlsfhk1 9mo agostrix also does it dynamically, just with a limit (which is generally set to ~75% of your total RAM)
- einsteinx2 9mo agoYou can also change it manually on macOS [0], though yes by default it’s automatic but has a much lower limit (I think 2/3 is total RAM or something). [0]: https://github.com/ggml-org/llama.cpp/discussions/2182#discussioncomment-7698315 https://github.com/ggml-org/llama.cpp/discussions/2182#discu...