2 ms·
Yi 200K finetunes cover a lot for me. Its not just smart, but the ability to just dump a huge context on it and get something coherent (after a few retries may
by brucethemoose2 3y ago
Yi 200K finetunes cover a lot for me.
Its not just smart, but the ability to just dump a huge context on it and get something coherent (after a few retries maybe) is really cool.
- MacsHeadroom 3y agoWhat do you run it on?
- brucethemoose2 3y agoA single 3090. I can fit 40K-77K context depending on the severity of the quantization.