3 ms·

This works out of the box with oobabooga/text-generation-webui python .\download-model.py togethercomputer/GPT-NeoXT-Chat-Base-20B python server.py --l

by lxe 4y ago

This works out of the box with oobabooga/text-generation-webui python .\download-model.py togethercomputer/GPT-NeoXT-Chat-Base-20B python server.py --load-in-8bit --int8-threshold 0 --listen --model GPT-NeoXT-Chat-Base-20B --cai-chat