6 ms·
Command R+: A Scalable LLM Built for Business
- tosh 3y agoWeights available: https://huggingface.co/CohereForAI/c4ai-command-r-plus https://huggingface.co/CohereForAI/c4ai-command-r-plus
- artninja1988 3y ago>built for business Yet the license says: > License: CC-BY-NC Besides this snark, seems really good from the benchmark and I'm really glad and grateful people are releasing weights :)
- ilc 3y agoSounds like for business, by business.
- LoganDark 3y agoThey probably licensed it to Azure on different terms.
- leetharris 3y agoIt's because they go to enterprises and sell it to them directly with a different license. They open weight it so that any enterprise can download it and try it out in their various use cases first. It's a good strategy.
- htrp 3y agoWhat's the difference between this and their prior command R model? other than price Cohere API Pricing $ / M input tokens $ / M output tokens Command R $0.50 $1.50 Command R+ $3.00 $15.00 Command-R: RAG at production scale https://news.ycombinator.com/item?id=39671872 https://news.ycombinator.com/item?id=39671872
- simonw 3y agoIt's a whole lot bigger. Command R is a 35 billion parameter model: https://huggingface.co/CohereForAI/c4ai-command-r-v01 https://huggingface.co/CohereForAI/c4ai-command-r-v01 Command R Plus is 104 billion: https://huggingface.co/CohereForAI/c4ai-command-r-plus https://huggingface.co/CohereForAI/c4ai-command-r-plus
- htrp 3y agoWish they had led with that in their blog post. Thanks for the clarification!
- iAkashPaul 3y agoCC-by-NC still seems better than the DBRX's license prohibiting usage for improving other models- >2.3 Use Restrictions > You will not use DBRX or DBRX Derivatives or any Output to improve any other large language model (excluding DBRX or DBRX Derivatives).
- deleted 3y ago[deleted]
- xfalcox 3y agoTheir other license also prohibits that > Cohere For AI Acceptable Use Policy > generating synthetic data outputs for commercial purposes, including to train, improve, benchmark, enhance or otherwise develop model derivatives, or any products or services in connection with the foregoing.
- iAkashPaul 3y agoDamn
- RecycledEle 3y agoWe need vocabulary to clarify use cases where someone in the company uses an LLM to get an answer as opposed to a customer facing LLM.
- rabbits77 3y agoIs that an instance of a "human in the loop"? Suppose a customer calls customer service and the service agent uses an LLM iteratively to get a good answer rather than the customer frustrating or even misinforming themselves. That seems to be like what you are describing.
- notfried 3y agoTangential, but this is a horrible choice for a header font at this size. I thought something was wrong in the rendering as I noticed white random smudges in the text.
- simonw 3y agoI added support for this model to my LLM CLI tool via a new plugin: https://github.com/simonw/llm-command-r https://github.com/simonw/llm-command-r So now you can do this: pipx install llm llm install llm-command-r llm keys set cohere <paste Cohere API key here> llm -m command-r-plus "3 reasons to adopt a sea lion" One of the most interesting features of the Cohere API models is that they can run web searches and use the results as part of answering the prompt. The plugin adds that as a separate command, which works like this: llm command-r-search 'What is the LLM CLI tool by simonw?' Example output (truncated here): The LLM CLI tool is a command-line utility that allows users to access large language models. It was created by Simon Willison and can be installed via pip, Homebrew or pipx. The tool supports interactions with remote APIs and models that can be locally installed and run. Users can run prompts from the command line and even build an image search engine using the CLI tool. Sources: - GitHub - simonw/llm: Access large language models from the command-line - https://github.com/simonw/llm - llm, ttok and strip-tags—CLI tools for working with ChatGPT and other LLMs - https://simonwillison.net/2023/May/18/cli-tools-for-llms/
- PhilippGille 3y agoAnother, smaller (7B) model optimized for function calling and structured data is https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B Maybe not as powerful, but more suitable for running locally on mid range devices.
- irthomasthomas 3y agoI tried the original command-r in an agent setup, and it ended up lobotomized when the agent relied on its results. It has some weird gaps. Like, ask it for the pricing for Claude 3 models and it only lists the prices for output tokens, and only for text. I managed to get the input cost for text out of it, but I could not get it to even acknowledge that image input was a thing. Command-r+ just did exactly the same.
- neals 3y agoWould something like this allow me to insert the appstore user agreement (for example) and ask it questions about that?
- simonw 3y agoYes - or you could pipe it into one of the Claude 3 models, or probably gpt-4-turbo as well.