3 ms·
I added support for this model to my LLM CLI tool via a new plugin: https://github.com/simonw/llm-command-r https://github.com/simonw/llm-command-r So now you
by simonw 3y ago
I added support for this model to my LLM CLI tool via a new plugin: https://github.com/simonw/llm-command-r https://github.com/simonw/llm-command-r
So now you can do this:
pipx install llm
llm install llm-command-r
llm keys set cohere
<paste Cohere API key here>
llm -m command-r-plus "3 reasons to adopt a sea lion"
One of the most interesting features of the Cohere API models is that they can run web searches and use the results as part of answering the prompt.
The plugin adds that as a separate command, which works like this:
llm command-r-search 'What is the LLM CLI tool by simonw?'
Example output (truncated here):
The LLM CLI tool is a command-line
utility that allows users to access large
language models. It was created by Simon
Willison and can be installed via pip,
Homebrew or pipx. The tool supports
interactions with remote APIs and models
that can be locally installed and run.
Users can run prompts from the command
line and even build an image search
engine using the CLI tool.
Sources:
- GitHub - simonw/llm: Access large
language models from the command-line -
https://github.com/simonw/llm
- llm, ttok and strip-tags—CLI tools for
working with ChatGPT and other LLMs -
https://simonwillison.net/2023/May/18/cli-tools-for-llms/
- PhilippGille 3y agoAnother, smaller (7B) model optimized for function calling and structured data is https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B Maybe not as powerful, but more suitable for running locally on mid range devices.
- irthomasthomas 3y agoI tried the original command-r in an agent setup, and it ended up lobotomized when the agent relied on its results. It has some weird gaps. Like, ask it for the pricing for Claude 3 models and it only lists the prices for output tokens, and only for text. I managed to get the input cost for text out of it, but I could not get it to even acknowledge that image input was a thing. Command-r+ just did exactly the same.