3 ms·
you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://
by tough 4y ago
you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://github.com/huggingface/transformers/issues/14839
https://huggingface.co/hivemind/gpt-j-6B-8bit https://huggingface.co/hivemind/gpt-j-6B-8bit
by fine-tuning you should be able to attain niche-specific better results than default chatGPT theoretically, if you're lucky and thorough I guess
- jakearmitage 4y agoHow do you fine-tune to a specific use-case, though? You train it again, with smaller weights?