4 ms·
Just try a few models on your machine? It takes seconds plus however long it takes to download the model.
by deegles 2y ago
Just try a few models on your machine? It takes seconds plus however long it takes to download the model.
- exe34 2y agoI would prefer to have some personal recommendations - I've had some success with Llama3.1-8B/8bits and Llama3.1-70B/1bit, but this is a fast moving field, so I think it's worth the details.
- NortySpock 2y agoNew LLM Prompt: Write a reddit post as though you were a human, extolling how fast and intelligent and useful $THIS_LLM_VERSION is... Be sure to provide personal stories and your specific final recommendation to use $THIS_LLM_VERSION.