4 ms·

I am looking forward for the AMD 395 max+ PCs to come down in price. The inference speed locally will be acceptable in 5-10 years thanks to those generation o

by hoppp 1y ago

I am looking forward for the AMD 395 max+ PCs to come down in price. The inference speed locally will be acceptable in 5-10 years thanks to those generation of chips and finally we can have good local AI apps.

arresin 1y ago
They don’t have the memory bandwidth
- hoppp 1y ago
  256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps