7 ms·
Stanford Alpaca web demo suspended “until further notice”
- wsgeorge 4y agoThe last thing I did was try to get Alpaca to invent a new language and say something in it. Midway through my experiment it returned an error. Refreshing showed a server error page, and now it displays this message [0] It's been a fun web demo of a lightweight LLM doing amazing stuff. :') Alpaca really moved the needle on democratizing the recent advancements in LLMs [1] [0] https://imgur.com/a/njKE1To https://imgur.com/a/njKE1To [1] https://simonwillison.net/2023/Mar/13/alpaca/ https://simonwillison.net/2023/Mar/13/alpaca/
- meghan_rain 4y agoOk wow this is big news, did Facebook or OpenAI threaten them with a lawsuit?
- russellbeattie 4y agoGiven that Alpaca violated the TOS of both services, this is not surprising. It could also have been Stanford’s legal office trying to preempt a lawsuit, or a “friendly” email from one of the companies expressing displeasure and pointing out Stanford’s liability. So more of a veiled threat rather than an official one. Either way, the toothpaste is out of the tube. We now know that a model’s training can essentially be copied using the model itself cheaply. Now that the team at Stanford showed it was possible, and how relatively easy it was, it will bound to be copied everywhere.
- rdtsc 4y agoThat could be a sneaky strategy by competitors -- make the service say something naughty or illegal then call the media with screenshots and act very offended by it.
- syntaxfree 4y agoYou can make any page say anything by messing in the Developer pane.
- 3np 4y ago> Given that Alpaca violated the TOS of both services, this is not surprising. I don't think so? They are not competing.
- adt 4y agoOpenAI Terms of Use (14/Mar/2023) 2. Usage Requirements c. Restrictions You may not (iii) use output from the Services to develop models that compete with OpenAI; https://openai.com/policies/terms-of-use https://openai.com/policies/terms-of-use
- viininnk 4y agoOn their GitHub repo (https://github.com/tatsu-lab/stanford_alpaca https://github.com/tatsu-lab/stanford_alpaca) they've added a notice: "Note: Due to safety concerns raised by the community, we have decided to shut down the Alpaca live demo. Thank you to everyone who provided valuable feedback." So probably this was the usual type of people complaining about the usual type of thing.
- safety1st 4y ago[flagged]
- throwawayacc5 4y agoSafety concerns? What was it doing that could be considered "unsafe"?
- makestuff 4y agoPeople prompting it to get around the safe gaurds in place. Ex: "How do you do some illegal/harmful thing?" Normally the LLM would answer I don't respond to illegal questions or whatever. However, people have figured out if you prompt it in a specific way you can get it to answer questions that it normally would not.
- thewataccount 4y ago> Finally, we have not designed adequate safety measures, so Alpaca is not ready to be deployed for general use. This is from their blog, I doubt they intended for this to be ran for long. Did they have safety guards on the demo? If so they couldn't have been great as it would have had to be made by them which I can't image they had a ton of resources for. I know the self hosted LLaMa has 0 safeguards and the Alpaca LoRA also has 0 safeguards.
- unshavedyak 4y agoIs that different than what LLaMA would already give? I suppose redistributing "harmful things" is still bad, but if it's roughly equivalent to what's already out there i struggle to think it's worth pulling. Side question, how is this a surprise to them? If this was due to safeguards, then pulling it now implies there's some new form of information. What new information could occur? That people were going to use it to generate a bunch of harmful contents? Seems obvious.. wonder what we're missing
- __initbrian__ 4y agoAre there estimates for how much it cost to run?
- ugjka 4y agoI suspect it was on a budget because the web demo never loaded for me
- londons_explore 4y agoAbout 2 words generated per second with a desktop CPU. More with a GPU.
- meowmeow20 4y agoThankfully we can run Alpaca locally now.
- aftbit 4y agoWhere do you get the weights?
- craftyguy98 4y ago4chan!
- gtoubassi 4y agohttps://github.com/antimatter15/alpaca.cpp https://github.com/antimatter15/alpaca.cpp has links
- 2bitencryption 4y agoIs this an indication that the biggest impact from LLMs will be on the edge? It's almost a certainty that a model as good (or better) than Alpaca's fine-tuned LLaMA 7B will be made public within the next or two. And it's been shown that a model of that size can run on a Raspberry Pi with decent performance and accuracy. With all that being the case, you could either use a service (with restrictions, censorship, etc) or you could use your own model locally (which may have a license that is essentially "pretty please be good, we're not liable if you're bad"). For most use cases the service may provide better results. But if self-hosting is only ~8months behind on average (guesstimate), then why not just always self-host? You could say "most users are not evil, and will be happy with a service." Makes sense. But what about users who are privacy-conscious, and don't want every query sent to a service?
- eh9 4y agoI just saw a project that lets you input an entire repo into GPT. Coincidentally, my place of employment just told us not to input any proprietary code into any generator with a retention policy. Even then, I feel like the play will be an enterprise service instead of licensing.
- miketery 4y agoLink?
- eh9 4y agohttps://github.com/mpoon/gpt-repository-loader https://github.com/mpoon/gpt-repository-loader
- joshka 4y agoIf it's the product I think it is (I don't recall the exact name), it's not putting the repo into GPT. It's calculating embeddings on the code in the repo, storing those in a vector db and providing context from the store when processing questions about the repo. Effectively when you ask "how does foo work" becomes 1. lookup code items related to foo getting 1-N copies of code. 2. ask GPT "here is code related to foo <result from 1>. Now answer the following question: how does foo work"
- andrewmcwatters 4y agoI think it's only a matter of time until one of these models gets into the hands of a hacker who wants unfettered ability to interact with a LLM without moral concerns. I think there's tremendous value in end user facing LLMs being trained against moral policies, but for internal or private usage, if these models are trained on essentially raw WWW sourced data, I would personally want raw output. I'm also finding it particularly interesting to see what ethical strategies OpenAI comes up with considering that if you train a model on the raw prejudices of humanity, you're getting at least one category of "garbage in" that requires a lot of processing to avoid getting "garbage out."
- cwkoss 4y agoisn't llama in the wild now?
- andrewmcwatters 4y agoI was under the impression that LLaMA was also trained against a series of moral policies, but perhaps I'm mistaken. It seems Meta chose their words carefully to imply that LLaMA does in fact, not have moral training: > There is still more research that needs to be done to address the risks of bias, toxic comments, and hallucinations in large language models. Like other models, LLaMA shares these challenges. As a foundation model, LLaMA is designed to be versatile and can be applied to many different use cases, versus a fine-tuned model that is designed for a specific task. By sharing the code for LLaMA, other researchers can more easily test new approaches to limiting or eliminating these problems in large language models. We also provide in the paper a set of evaluations on benchmarks evaluating model biases and toxicity to show the model’s limitations and to support further research in this crucial area.
- jfowief 4y ago"Moral training" Just as dystopian it sounds. Fixing current subjective moral norms into the machine.
- 4y ago
- macrolime 4y agoUse this Alpaca replication instead https://github.com/tloen/alpaca-lora https://github.com/tloen/alpaca-lora
- garbagecoder 4y agoI grew out of my cyberpunk phase in the early 90s, but I think it's good that there are lots of leaks of all of this stuff. I don't really have a problem with it being blocked from saying the n-word or whatever and I'm sure that there is always going to be some tuning by the purveyor, but I feel like we have the right to know more of the details with these than, say, how magic select tools work in Photoshop
- lee101 4y ago[dead]