5 ms·
Yi 1.5
- wg0 3y agoSomeday, "OpenAI" will open up their models too.
- ThaRedah 3y agohttps://www.youtube.com/watch?v=q6EoRBvdVPQ&pp=ygUDWWVl https://www.youtube.com/watch?v=q6EoRBvdVPQ&pp=ygUDWWVl
- htrp 3y agowere they the ones you had to publicly apologize for basically training on top of the llama 2 series models?
- qustrolabe 3y agoVersion in repository name feels wrong
- xhevahir 3y ago"Yi-1.5 is an upgraded version of Yi" is not a very informative beginning.
- kkzz99 3y ago"It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples. Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension. Yi-1.5 comes in 3 model sizes: 34B, 9B, and 6B. For model details and benchmarks, see Model Card." Literally after that...
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- gardnr 3y agoYi is led by Dr. Kai-Fu Lee. They have been releasing a lot of really good models over the last ~6 months. Their previous (1.0?) Yi-34B-Chat model ranks similar to GPT-3.5 on Chatbot Arena. [1] A quantized version of that model can be run on a single consumer video card like the RTX 4090. This new set of models should raise the bar again by adding more options to the open source LLM ecosystem. If you inspect the config.json[2] in the model repo on HuggingFace, you can see that the model architecture is LlamaForCausalLM (the same as Meta's Lllama). The difference between the Yi models and a simple fine-tuning is that Yi models have had a different set of data, configuration, and process going back to the pre-training stage. Their models perform well in Chinese and in English. There are a lot of good models coming out of China, some of which are only published to ModelScope. I haven't spent much time on ModelScope because I don't have a Chinese mobile number to use to create an account. Fortunately, Yi publish to HuggingFace as well. [1] https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar... [2] https://huggingface.co/01-ai/Yi-1.5-34B-Chat/blob/fa695ee438bfcd0ec2b378fa1c7e0dea1b40393e/config.json#L3 https://huggingface.co/01-ai/Yi-1.5-34B-Chat/blob/fa695ee438...
- option 3y agoTry asking their "chat" variants about topics sensetive to CCP, like what has happened on Tiananmen square. Same for Baichan models. What other values and biases have been RLHFed there and for what purpose?
- HKH2 3y agoOf course, otherwise it wouldn't be allowed in China. Where can I find LLMs that are uncensored and accessible (without logging in)?
- fzzzy 3y agomixtral, miqu q5, llama 3 (still seem to be bugs running llama 3 locally as gguf, unclear if this is resolved yet)
- happypumpkin 3y ago
- tosh 3y agoBenchmark charts on model card: https://huggingface.co/01-ai/Yi-1.5-34B-Chat#benchmarks https://huggingface.co/01-ai/Yi-1.5-34B-Chat#benchmarks Yi 34b with results similar to Llama 3 70b and Mixtral 8x22b Yi 6b and 9b with results similar to Llama 3 8b
- GaggiX 3y agoWe need to wait for LMSYS Chatbot Arena to actually see the performance of the model.
- tosh 3y agoI had good results with the previous Yi-34b and its fine tunes like Nous-Capybara-34B. Will be interesting to see what Chatbot Arena thinks but my expectations are high. https://huggingface.co/NousResearch/Nous-Capybara-34B https://huggingface.co/NousResearch/Nous-Capybara-34B
- zone411 3y agoNo, Lmsys is just another very obviously flawed benchmark.
- aubanel 3y agoPlease elaborate on this: how is it flawed?
- BoorishBears 3y agoIt's horribly useless for most use cases since half of it is people probing for riddles that don't transfer to any useful downstream task, and the other half is people probing for morality. Some tiny portion is people asking for code, but every model has its own style of prompting and clarification that works best, so you're not going to be able to use a side-by-side view to get the best result. The "will it tell me how to make meth" stuff is a huge source of noise, which you could argue is digging for refusals which can be annoying, and the benchmark claims to filter out... but in reality a bunch of the refusals are soft refusals that don't get caught, and people end up downvoting the model that's deemed "corporate". Honestly the fact that any closed source model with guardrails can even place is a miracle, in a proper benchmark the honest to goodness gap between most closed source models and open source models would be so large it'd break most graphs.
- mountainriver 3y agoIs it the same bad license?
- tosh 3y agoIt looks like they switched to Apache 2.0 for the weights.
- Havoc 3y agoNever had any luck with the Yi family of models. They tend to get sidetracked and respond in Chinese. Maybe my setup is somehow flawed
- Oranguru 3y agoYou can easily fix this using a grammar constraint with llama.cpp. Add this to the command: --grammar "root ::= [^一-鿿ぁ-ゟァ-ヿ가-힣]*" This will ban Chinese characters from the sampling process. Works for Yi and Qwen models.
- segmondy 3y agoYour setup is flawed.
- qeternity 3y agoNo, it's not. This is a common issue with Yi models.
- segmondy 3y agoI have no issue with it.
- numpad0 3y agoEarlier Yi paper indicates it's trained with less than 25% Chinese dataset, contrast to GPT-3 which was 93% English[1][2]. Is that a bug or could there be something inherent to current LLM architecture - like dataset must be 90%+ English to not fall apart? 1: https://arxiv.org/html/2403.04652v1 https://arxiv.org/html/2403.04652v1 2: https://github.com/openai/gpt-3/blob/master/dataset_statistics/languages_by_word_count.csv https://github.com/openai/gpt-3/blob/master/dataset_statisti...
- famouswaffles 3y agoThe pretraining might not matter here so much as the instruct fine-tuning. The small GLM models were like 50-50 English-Chinese in pretraining but much more Chinese in instruct training. Had the same issue until they balanced that.
- 999900000999 3y agoIs 16 GB of ram enough to run these locally? I'm considering a new laptop later this year and the ram is now fixed to 16GB on most of them. I plan on digging deep into ML during my coming break from paid work.
- coolestguy 3y agoNo - 16gb of ram is barely enough to run regular applications if you're a power user let alone the most breakthrough computationally heavy workloads ever invented
- 999900000999 3y agoThe price difference is about 150$ give or take for the laptops I'm looking at. I'll keep this in mind!
- Zambyte 3y ago16 GB of system memory vs 16 GB of VRAM / unified memory (? I think this is the case for recent Apple machines) makes a huge difference. The former is more of a neat party trick (depending on who you hang out with) and the latter is actually something you can use as a tool to be more efficient. I recently bought a 7900 XTX with 24 GB of VRAM, but the model I currently run can easily run in 16 GB (6 bit llama 3 8b). It's fast enough and high enough quality that I can use it for processing information that I don't feel comfortable sharing with hosted services. It's definitely not the best of the best as far as what models are able to do right now, but it's surprisingly useful.
- pinusc 3y agoAlso keep in mind: 32GB of RAM is more than enough for normal usage, but it's useless for (this kind of state-of-the-art-) ML unless you also have a graphics card of the kind that won't fit in a laptop. Unless of course you were talking about VRAM, in which case 16GB is still not great for ML (to be fair, the 24GB of an RTX 4090 aren't either, but there's not much more you can do in the space of consumer hardware). I don't think the other commenter was talking about VRAM, because 16GB VRAM are very overkill for everyday computing... and pretty decent for most gaming.
- adt 3y agohttps://lifearchitect.ai/models-table/ https://lifearchitect.ai/models-table/
- Hugsun 3y agoThis page is confusing to me. How is it useful to you? I can see some utility but am curious if there's something I'm missing.
- smcleod 3y agoWhile interesting, Yi 1.5 only has a 4K context window, which means it's not going to be useful for a lot of use cases.
- ukuina 3y agoRemember when they claimed Yi had 200k context length despite it having 16k of usable context? I remember, because I spent non-trivial effort trying to make it work for long-form technical summarization. My lackluster findings were validated by RULER. https://github.com/hsiehjackson/RULER https://github.com/hsiehjackson/RULER
- Hugsun 3y agoThis test is very helpful. Thanks for sharing!