4 ms·
Yeah, llama runs acceptably on my server, but buying a GPU and setting it all up seems really unfun. Also much more expensive than my hobby budget
by calamari4065 3y ago
Yeah, llama runs acceptably on my server, but buying a GPU and setting it all up seems really unfun. Also much more expensive than my hobby budget
- brucethemoose2 3y agoYou don't need a big one, even an old 4GB GPU will massively accelerate the prompt ingestion.