4 ms·
I'd love to see more Very-Large-Memory Mac Studio benchmarks for prompt processing and inference. The few benchmarks I've seem either missed to take prompt proc
by diggan 1y ago
I'd love to see more Very-Large-Memory Mac Studio benchmarks for prompt processing and inference. The few benchmarks I've seem either missed to take prompt processing into account, didn't share exact weights+setup that were used or showed really abysmal performance.
- chisleu 1y agoOh I plan to produce a ton of that. I'll post a blog on it to HN and /r/localllama when I'm done.