3 ms·
> One can take a great 70B model and have it run in only ~16GB with no loss in capability and the ability to keep training, but the last few years funding only
by krisoft 5mo ago
> One can take a great 70B model and have it run in only ~16GB with no loss in capability and the ability to keep training, but the last few years funding only went for "bigger".
Awesome. What is holding you back? What do you need the funding for?
- saulpw 5mo agoPresumably $100m to train the 70B model? I think you're assuming that the author meant you can take an existing 70B model and run it in 16GB. But it stands to reason that "no loss in capability" means it had to be trained under those constraints.
- antonvs 5mo agoWhen an AI says things like that we call it “hallucination”.