3 ms·
> While I haven't tested it extensively, 70B model is supposed to rival Chat GPT 3.5 in most areas, and there are now some new fine-tuned versions that excel at
by pyrophane 3y ago
> While I haven't tested it extensively, 70B model is supposed to rival Chat GPT 3.5 in most areas, and there are now some new fine-tuned versions that excel at specific tasks
That has been my experience. Having experimented with both (informally), Llama 2 is similar to GPT-3.5 for a lot of general comprehension questions.
GPT-4 is still the best amongst the closed-source, cutting edge models in terms of general conversation/reasoning, although 2 things:
1. The guardrails that OpenAI has placed on ChatGPT are too aggressive! They clamped down on it quite hard to the extent that it gets in the way of a reasonable query far too often.
2. I've gotten pretty good results with smaller models trained on specific datasets. GPT-4 is still on top in terms of general purpose conversation, but for specific tasks, you don't necessarily need it. I'd also add that for a lot of use cases, context size matters more.
- CodeCompost 3y agoCan it handle other languages besides English?
- e12e 3y agoNot anywhere near as well as ChatGPT 4 (for chat anyway - maybe the model is better)? Prompt: > Hvad tycks om at fika nu? ChatGPT 4 > Det låter som en trevlig idé! Fika är ju alltid gott. Vad skulle du vilja ha till din fika? (Oj, ursäkta för emojis! ) https://chat.openai.com/share/8e89a16f-f182-4f62-b9fa-f93cd5641fec https://chat.openai.com/share/8e89a16f-f182-4f62-b9fa-f93cd5... Llama2: > I apologize, but I don't understand what you mean by "fika nu." Could you please provide more context or clarify your question so I can better assist you? https://hf.co/chat/r/kOF2qst https://hf.co/chat/r/kOF2qst
- scarface_74 3y agoTo your first point, I was trying use ChatGPT to generate some examples of negative interactions with customer service to show sentiment analysis in action for a project I was working on. I had to do all types of workarounds for it to generate something useful without running into the guardrails.
- pseudosavant 3y agoI’ll second the context window too. I’ve been really impressed with Claude 2 because it can address such a larger context than I could feed into GPT4.
- jmorgan 3y agoRE 2 - neat! What are some tasks you've been using smaller models (with perhaps larger context sizes) for?
- ramraj07 3y agoCould you give examples of smaller models trained on specific datasets?
- antupis 3y agoit can be almost anything like your HN comments or some corporate wiki, then get colab pro 10$ month or some juicy gaming machine and fine-tune that using eg this tutorial https://www.philschmid.de/instruction-tune-llama-2 https://www.philschmid.de/instruction-tune-llama-2 but https://www.reddit.com/r/LocalLLaMA/ https://www.reddit.com/r/LocalLLaMA/ is full of different fine tuned models.