4 ms·
Cool. Nice example of Atwood's Law. [0] (however not really JS of course) If somebody hasn't tried running LLMs yet, here are some lines that do the job in Goo
by jankovicsandras 3y ago
Cool. Nice example of Atwood's Law. [0] (however not really JS of course)
If somebody hasn't tried running LLMs yet, here are some lines that do the job in Google Colab or locally.
! git clone https://github.com/ggerganov/llama.cpp.git
! wget "https://huggingface.co/TheBloke/CodeLlama-7B-GGUF/resolve/main/codellama-7b.Q8_0.gguf" -P llama.cpp/models
! cd llama.cpp && make
! ./llama.cpp/main -m ./llama.cpp/models/codellama-7b.Q8_0.gguf --color --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1.1 -t 8
[0] : https://en.wikipedia.org/wiki/Atwood's_Law https://en.wikipedia.org/wiki/Atwood's_Law
- e12e 3y agoThank you! What are the exclamation points for though? In a *nix shell they'll expand to a command from history - copy-pasters beware!
- baq 3y agogoogle collab/jupyter instructions to run a shell command, presumably.
- jankovicsandras 3y agoYes, sorry for being unclear. I hope people who use shells will notice. Shameless plug: https://github.com/jankovicsandras/ml https://github.com/jankovicsandras/ml <- here are some minimal Colab / Jupyter notebooks for absolute beginners. I just find it amazing how little effort it takes to run an LLM nowdays.