3 ms·
Yeah, just clone the repo, download the model, and run the start script. If you don't have a GPU with ~14GB of RAM expect each response to take a few minutes to
by idle_zealot 7y ago
Yeah, just clone the repo, download the model, and run the start script. If you don't have a GPU with ~14GB of RAM expect each response to take a few minutes to be generated though.
- cjbprime 7y agoThanks! It's not that bad -- am on a 2080 8GB and it takes less than a minute for each response.