7 ms·
It appears there is this genre of articles pretending that LLAMA or its RL-HF tuned variants are somehow even close to an alternative to ChatGPT. Spending more
by whimsicalism 4y ago
It appears there is this genre of articles pretending that LLAMA or its RL-HF tuned variants are somehow even close to an alternative to ChatGPT.
Spending more than a few moments interacting even with the larger instruct-tuned variants of these models quickly dispels that idea. Why do these takes around open-source AI remain so popular? What is the driving force?
- matrix_overload 4y agoChatGPT being an ultra-hot topic, so every article tangentially related to it gets twice the views?
- anonzzzies 4y agoIt is vastly better than anything else so far though. The rest will catch up but openai is not sleeping and they are well funded.
- jhbadger 4y agoI thought that was the case before trying Vicuna. I agree that LLaMA and Alpaca are inferior to ChatGPT but I'm really not sure Vicuna is. It even (unfortunately) copies some of ChatGPT's quirks, like getting prudish when asking it to write a love scene ("It would not be appropriate for me to write...")
- nabakin 4y agoI've tried Vicuna but it still seems inferior to ChatGPT imo. Maybe if it was applied to a version of LLaMA with a number of parameters matching GPT-4 but I'm not sure of that either
- whimsicalism 4y agoI admittedly have not interacted with Vicuna yet.
- deleted 4y ago[deleted]
- seydor 4y agois gpt4Xalpaca better?
- int_19h 4y agoIt's definitely inferior once you start giving it non-trivial tasks. the same goes for all instruction- and chat-tuned forks of LLaMA. Maybe that'll be different on larger model sizes; we haven't seen vicuna-30b or 65b yet. But if it really is that easy, I'd expect there to be a lot more commercial offerings on par with ChatGPT already.
- whimsicalism 4y agoWell except you can't legally offer fine-tuned LLaMA as a commercial offering like that.
- tyfon 4y ago> Why do these takes around open-source AI remain so popular? I can only speak for myself, but I have a great desire to run these things locally, without network and without anyone being able to shut me out of it and without a running cost except the energy needed for the computations. Putting powerful models behind walls of "political correctness" and money is not something that fits well with my personal beliefs. The 65B llama I run is actually usable for most of the tasks I would ask chatgpt for (I have premium there but that will lapse this month). The best part is that I never see the "As a large language model I can't do shit" reply.
- itake 4y agoI think it’s hard to verify and those articles get clicks. Similar to vein of articles promising self driving cars in 202x
- kristianp 4y agoHow do you run it locally? llama.cpp + 64GB RAM + 4bit quantized?
- tyfon 4y agoI have a 5950x with 64 gb ram and they are quantized to 4 bit yes :) The weights are stored on a samsung 980 pro so the load time is very fast too. I get about 2 tokens/second with this setup. edit: forgot to confirm, it is llama.cpp edit2: I am going to try the FP16 version after easter as I ordered 64 GB of additional ram. But I suspect the speed will be abyssal with the 5950x having to calculate through 120 gb of weights. Hopefully some smart person will come up with a way to allow the GPU to run off system memory via the amd infinity fabric or something.
- barbariangrunge 4y agoI thought it needed 64gb of vram. 64gb of ram is easy to obtain
- 4y ago
- micimize 4y agoI had the same reaction after seeing lots of "chatgpt on a phone" etc hype around alpaca. Like I knew it wouldn't be close, but was surprised at just how useless it was given the noise around it. Nobody who was talking about it had used it for even five minutes. This article is almost criminally imprecise around the "leak" and "Open Source model" discussion as well.
- digitallyfree 4y agoPrivacy and security is a big desire for the people running these lower-quality local models. These assistants are becoming more and more powerful and people want to use them for personal tasks. For instance someone might want to chat about their inner feelings or ask the AI to pen a confidential letter, things that they wouldn't want to send to a cloud service. We saw the same thing with Stable Diffusion and how people would spend a lot of effort getting it to run on their machines so they wouldn't have to rely on a public instance. I'm talking about individual people here as the fact that this is a leak means that corps probably won't take the legal risk of trying this out (maybe some are doing so in secret). In the business world there definitely is a want for locally hosted models for employees that can safely handle confidential inputs and outputs. The Llama models are not as good as ChatGPT but there are new variants like Alpaca and Vicuna with improved quality. People are actively using them already to help with writing and as chatbots.
- whimsicalism 4y ago> there are new variants like Alpaca and Vicuna with improved quality Yeah, but still not even remotely close to ChatGPT. I can't use Vicuna for work. I heavily use ChatGPT & variants.
- seydor 4y ago> Why do these takes around open-source AI remain so popular? What is the driving force? people like to tinker with things until they break and fix again. that's how we find their limits People constantly try to break chatGPT too (i d wager they spend more time on that than real work). However talking to an opaque authoritarian chatbot, no matter how smart, gets boring after a while
- ec109685 4y agoThis part is flat out wrong: “ Researchers from UC Berkeley, CMU, Stanford, and UC San Diego open sourced Vicuna, a fine-tuned version of LLama that matches GPT-4 performance.” They used gpt 4 to evaluate answers between GPT-3 and Vicuna. Also, if the weights are from llama, it’s not open source since it’s based on a leak and only allowed for non commercial use.
- mirekrusin 4y agoYou can't get clearance for company work to use those closed models (due to leaking of confidential data).
- whimsicalism 4y agoOh, but you can get clearance for using pirated models against license? I want to work at your employer!
- ChatGTP 4y agoI’m scared of AI, very scared, but I am way way more scared of authoritarianism + AI. If I lose my job to AI, I’ll be at least able to create new things using open source and free AI so I can hopefully be able to feed my family. If I’m locked out of it all together, I’m toast. The other thing is, OpenAI is collecting all data and using it for training, this is a disaster on many levels. I can’t be a party to it. All our IP with one company? Absolutely no thank you. The last important point for me is that it probably seems more dangerous to have open source AI research but I think the opposite will happen. If there is less moats, less money will be invested and it might slow down the “arms race” a little. So for me, there is only one way to go , Open AI :) I have a feeling the open source community will unlock the mysteries of these things and very quickly start to workout how we can build devices to help enhance or own cognitive abilities, I think that would be the happiest ending I can imagine?
- mrshadowgoose 4y agoI've thought about this a ton lately. Given the unexpectedly rapid pace of development towards AGI, if progress is sustained, I don't see how this ends well in the vast majority of cases. The game theory is identical to that of nuclear weapons development, even if one's intents are good. On the road to AGI, there exists a development gap (the size of which is unknowable ahead of time) where a single actor that has achieved AGI first could, should they wish to and play their cards right, completely suppress all other AI development and permanently subjugate (and/or eliminate) the rest of humanity. Although it's easy to dismiss such a scenario as ludicrous, people so easily forget that "aggregate semi-aligned general cognitive capability" is the sole reason that the human animal owns the planet. Knowing this, it is in the interest in any competing actor to pursue their own R&D as rapidly as possible, giving nothing to others, and even acting in a way that sabotages/delays/frustrates other actors. This seems to be the way that OpenAI is behaving now that they have a model that is practically relevant, and I don't blame them at all for working this way. It just makes sense. > I have a feeling the open source community will unlock the mysteries of these things and very quickly start to workout how we can build devices to help enhance or own cognitive abilities, I think that would be the happiest ending I can imagine? As much as I'd love to believe in this, the evidence to date does not support this hope. The practically relevant models seem to require vast amounts of well-connected computational power to train, which puts them solely in the hands of corps and governments. Although the open-source efforts into fine-tuning LLama have been incredible, this is not at all equivalent to being able to train a foundational model. We only have LLama because it leaked from a corp. Although it's my personal (completely hopeless) desire that every human ends up having private access to AGI, free of restrictions and any externally imposed alignment. This is also a nightmare scenario. Humanity is unaligned with itself. That scenario quickly devolves into molecular warfare and other horrors. But the starting conditions would at least be "fair". My best guess is that a few powerful nations will achieve AGI roughly at the same time, and then suppress private development (if not already legally suppressed by that point in time) within their domains of control. What happens after that, or how those governments choose to wield that power is unknowable.