5 ms·
This is absolutely huge. LLaMA weights leaking was a big deal, but you couldn’t actually use them without attracting Meta’s ire. Would love to see some benchmar
by dougmwne 4y ago
This is absolutely huge. LLaMA weights leaking was a big deal, but you couldn’t actually use them without attracting Meta’s ire. Would love to see some benchmarking vs. LLaMA and GPT.
- pyinstallwoes 4y agoWhat is IRE?
- jwineinger 4y agoanger. probably a lawsuit in this context
- jmiskovic 4y agoThere were no lawsuits around LLaMA. They used DCMA requests to take down some GitHub and HuggingFace releases but the majority of releases (Alpacas and other animals) was left alone. It was enough to prevent commercial use, though. Edit: a lawsuit would be quite interesting, to clear up many things around how copyright works for LLMs.
- MacsHeadroom 4y agoThey're going to court with the guy who made llamaDL actually.
- inportb 4y agoIre is the result of irritation.
- sangnoir 4y agoIt's a department at meta: Intellectual Rights Enforcement. /s "Ire" is a synonym for "anger" or "wrath"
- pyinstallwoes 4y agoThat's actually what I thought it might be. Thanks lol.
- sangnoir 4y agoYour initialization hinted it. I must say, if Meta had a IP-litigation department called "IRE" or "MIRE" (Meta Intellectual Rights Enforcement), that would be a little on the nose.The unofficial motto would be "We will bog you down in the courts for years"
- vineyardmike 4y agoIt’s a noun meaning anger or wrath. Usually it’s specific not just to triggering anger the emotion, but an angry response. So attracting Meta’s ire means attracting an angry response from meta - like the legal response users of LLaMA have triggered. It’s not an acronym.
- antibasilisk 4y agoInternal recurrent expenditure
- dougmwne 4y agoThe real thing we should be asking is if the 3B or 7B model is capable of correctly answering this question.
- jacooper 4y agoDo we even know if model weights are copyrightable or not?
- sebzim4500 4y agoNo but unless you enjoy being sued by Meta you have to act as if they are.
- janmo 4y agoI was asking myself the same question and am 99% sure it isn't protected by IP laws. It is another story for the training data and the source code used to run the model.
- Invictus0 4y agoA JPG is copyrightable and that's just an array of numbers. Model weights seem pretty similar as a class.
- AustinDev 4y agoCouldn't you just transform the weights in some predictable way and then untransform them before use in runtime? The weights at rest would be completely distinct from the meta weights.
- dougmwne 4y agoIt's not the JPG data you can copyright, but the recognisable image it produces. Every time you re-save or resize the image, the data changes, but the recognizable image remains. It's not clear how this process applies to model weights. Once you run another training epoch on them, the data has changed. What is the essential copyrightable, trademarkable or patentable thing that remains? A legally untested question for sure.
- jacooper 4y agoBut the data inside the jpg isn't generated by a machine, model weights are.
- MacsHeadroom 4y ago
- brucethemoose2 4y agoAll sorts of llama weights are on huggingface now.