3 ms·
I just added Llama 2 support to my LLM CLI tool: https://simonwillison.net/2023/Jul/18/accessing-llama-2/ https://simonwillison.net/2023/Jul/18/accessing-llama-
by simonw 3y ago
I just added Llama 2 support to my LLM CLI tool: https://simonwillison.net/2023/Jul/18/accessing-llama-2/ https://simonwillison.net/2023/Jul/18/accessing-llama-2/
So you can now access the Replicate hosted version from the terminal like this:
pip install llm
# or brew install simonw/llm/llm
llm install llm-replicate
llm keys set replicate
# Paste in your Replicate API key
llm replicate add a16z-infra/llama13b-v2-chat \
--chat --alias llama2
# And run a prompt
llm -m llama2 "Ten great names for a pet pelican"
# To continue that conversation:
llm -c "Five more and make them more nautical"
All prompts and responses are logged to a SQLite database. You can see the logs using:
llm logs
This is using the new plugins mechanism I added to LLM last week: https://simonwillison.net/2023/Jul/12/llm/ https://simonwillison.net/2023/Jul/12/llm/
More on LLM here: https://llm.datasette.io/ https://llm.datasette.io/
- ipv6ipv4 3y agoIt doesn't work for me. brew install simonw/llm/llm ... ==> Installing llm from simonw/llm Error: Your Command Line Tools are too outdated. Update them from Software Update in System Settings. If that doesn't show you any updates, run: sudo rm -rf /Library/Developer/CommandLineTools sudo xcode-select --install Alternatively, manually download them from: https://developer.apple.com/download/all/. You should download the Command Line Tools for Xcode 14.3. I have 14.3.1 installed
- simonw 3y agoThat's frustrating. I recommend using `pip` or `pipx` to install it instead if Homebrew doesn't work - provided you have a working Python 3 installation it should work just fine.