3 ms·
> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally. Framework Desktop! Half the memory
by nialv7 8mo ago
> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally.
Framework Desktop! Half the memory bandwidth of M4 Max, but much cheaper.
- thebruce87m 8mo agoDoes that equate to half the speed in terms of output? Any recommended benchmarks to look at?
- nialv7 8mo agohttps://kyuz0.github.io/amd-strix-halo-toolboxes/ https://kyuz0.github.io/amd-strix-halo-toolboxes/