Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
hamsterDog123
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
hamsterDog123
2y ago
Yes of course you can run it on your local machine... But the architecture of this specific model makes it extremely inefficient to run this locally for a single user. Here's why: - to LOAD the model, you need at least 768GB of VRAM, w