Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
jacobfnl
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
jacobfnl
2y ago
I have 70B at q4_0 running at 20 tokens/s inference using 2 Founders Edition RTX3090s with NVLink. It's an older AMD 5950x with a motherboard with 4-slot spacing between the PCI-e (iirc, the motherboard is an ASRock x570 Taichi).