6 ms·
Qwen: chat and pretrained large language model by Alibaba Cloud
- version_five 3y agoI briefly played with this a couple months ago and it looked promising. Have there been more developments?
- euclaise 3y agoThere's a new 7B version that was trained on more tokens, with longer context, and there's now a 14B version that competes with Llama 34B in some benchmarks.
- redwood 3y agoWhat happens when you ask about Tiananmen Square and 1989?
- euclaise 3y agohttps://www.reddit.com/r/LocalLLaMA/comments/16sw4na/qwen_is_aligned_just_as_you_would_expect/ https://www.reddit.com/r/LocalLLaMA/comments/16sw4na/qwen_is...
- class4behavior 3y agoI get that someone would do it anyway, but why would the poster want to be the one helping an authoritarian entity fix these loopholes? smh
- hashtag-til 3y agoWhy is this flagged? Honest question.
- dnd_was_evil 3y ago[flagged]
- version_five 3y agoTo be fair, it's a stupid distraction from discussing the model. If every thread just turns into politics it would not make for good discussions. People can start threads about specific ideologies that language models have and they can be discussed there (and have been). Bringing that up every time a model is discussed feels off topic and legit to flag (I didn't flag it) Edit: but now I see the thread has basically been ruined and it's going to be about politics instead of anything new and interesting about the model, congrats everyone.
- chpatrick 3y agoIs it a distraction? AI alignment is a huge topic, especially if the model is from an authoritarian country.
- hashtag-til 3y agoMany people are just don’t get that theses models are going to be integrated in all sorts of everyday stuff. Questioning whether all this tech innovation should be shared with authoritaria regimes is a damn valid question to be asked and often as possible.
- version_five 3y agoAlignment is also a distraction, its OpenAI marketing and something people who don't understand ML talk about, not a serious topic. Like I said, discussing model politics have a place but bringing it up every time a model is mentioned is distracting and prevents adult discussion. It would be like if every time a company comes up, the thread gets spammed with discussion about the worst thing that company has ever done instead of discussing it in context.
- chpatrick 3y agoArtificial ways the model is restricted are an absolutely relevant and important thing to discuss.
- 3y ago
- jauzj 3y ago[flagged]
- dnd_was_evil 3y ago[flagged]
- olddustytrail 3y agoChina could learn from Western examples. If you ask "what happened in the Chagos islands?" of Google Bard, you get a decent summary, even though it's an ongoing situation.
- behnamoh 3y agoDidn't the chinese also have a model with >1 trillion parameters when GPT-3 came out? Didn't the chinese also tweak the lmsys leaderboard to make their model appear on top? It's sad but unfortunately as with so many other things coming from china, one has to take their claims with a pinch of salt.
- booleandilemma 3y agoIt's funny and heartening to me that despite their larger population size, we still out-innovate them.
- chpatrick 3y agoDon't get used to it.
- deleted 3y ago[deleted]
- rafram 3y ago> the chinese This terminology makes you sound antiquated and prejudiced, FWIW.
- hashtag-til 3y agoIt’s a nationality last time I checked.
- olddustytrail 3y agoSure, in a "Didn't the Americans claim they'd have self driving cars by now? One has to take their claims with a pinch of salt" sense. Attributing particular people's claims to an entire country doesn't really make sense for the most part.
- 3y ago
- b1n 3y agoWhat happens when you ask about Tiananmen Square? (Asking for redwood, who's comment was inexplicably flagged).
- anonymouslambda 3y agoWe have such a weird fascination with Tiananmen, like it’s some sort of big gotcha. You can ask actual Chinese citizens and they know about it, and care about it about as much as an American citizen cares about the Kent State massacre.
- deleted 3y ago[deleted]
- scelerat 3y agoMassively different, from the size of the protests (Beijing was not the only city which was experiencing student protests) to the scale of the carnage, to the all-stops attempts to erase the memory of the event. So for an LLM it's an interesting question about what comprises its training model. How massaged/edited/censored is the input data, in whose service is the cleansing being performed?
- chpatrick 3y agoThe difference is that GPT will talk to you about the Kent State massacre.
- aragonite 3y agoThat's because Kent State massacre is not a politically incorrect topic in the West. What happens when you ask ChatGPT about a genuinely politically incorrect topic in the West? So at best the complaint boils down to this: China has the wrong politically incorrect topics and we have the right politically incorrect topics. And of course, once the complaint is reduced to this form, its irrelevance to the topic at hand (LLMs) is evident.
- 3y ago
- Havoc 3y agoLooks like the mistral model beats this slightly at 7b. Though this has a 14b and a chat tuned one so may be better for some uses. Qwen models had compatibility issues last time I tried it though.
- ninjin 3y agoGlad to see more models made available. Sadly it has the same kind of licensing problems as Facebook's LLaMa [1]: * "If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, You shall request a license from Us." * "You can not use the Materials or any output therefrom to improve any other large language model (excluding Tongyi Qianwen or derivative works thereof)." [1]: https://github.com/QwenLM/Qwen/blob/main/LICENSE https://github.com/QwenLM/Qwen/blob/main/LICENSE So, thanks Facebook for setting a truly awful precedence that other corporate lawyers will now copy. We may not be entitled to your work, but your awful behaviour seem to cause Alibaba as well to claim that their model is open rather than what it really is: available. I need to come up with a t-shirt design mocking the appropriation going on (well, outright violation when Facebook says that LLaMa is compatible with open science) so that I can wear it at upcoming conferences.