4 ms·
In terms of models which are reasonably fast to run and easy to install, I think Flan-T5 is one of the best: https://huggingface.co/google/flan-t5-xxl https://h
by lopuhin 4y ago
In terms of models which are reasonably fast to run and easy to install, I think Flan-T5 is one of the best: https://huggingface.co/google/flan-t5-xxl https://huggingface.co/google/flan-t5-xxl - although out of the box it's more focused on giving short answers and it's very far from ChatGPT.
- baobabKoodaa 4y agoIt's not clear from the link if it's possible to fine tune Flan-T5 on consumer hardware?
- lopuhin 4y agoThey released different sizes from "small" to "xxl", and at least "base" should be small enough to fine-tune virtually anywhere.
- baobabKoodaa 4y agoI spent several hours on this today. Currently stuck at "out of memory" error trying to fine-tune the base model.
- baobabKoodaa 4y agoWorked a bit with the "small" version of Flan T5 today. I was able to fine tune it, and the results were not complete garbage. About half were non sensical but the other half were passable.