14 ms·
Note that what they released are the delta weights from the og LLaMa model. To play around with it, you'll need to grab the original LLaMA 13B model and apply t
by a5huynh 4y ago
Note that what they released are the delta weights from the og LLaMa model. To play around with it, you'll need to grab the original LLaMA 13B model and apply the changes.
> We release Vicuna weights as delta weights to comply with the LLaMA model
> license. You can add our delta to the original LLaMA weights to obtain
> the Vicuna weights.
Edit: took me a while to find it, here's a direct link to the delta weights: https://huggingface.co/lmsys/vicuna-13b-delta-v0 https://huggingface.co/lmsys/vicuna-13b-delta-v0
- swyx 4y agoso an extra licensing issue to get around the original non commercial license... this is just a research curiosity is it not?
- F2hP18Foam 4y agoSeems that way, it would probably be a bad idea to use this for anything commercial at the very least.
- 0cf8612b2e1e 4y agoNot a lawyer, but that still feels like dubious territory. I would still be on the hook for acquiring the original download, which Facebook has been launching dmca takedown requests for the llama-dl project.
- zhisbug 4y agohttps://github.com/facebookresearch/llama/pull/184 https://github.com/facebookresearch/llama/pull/184
- 0cf8612b2e1e 4y agoNobody at Facebook approved it? Given the attention it has received, hard to imagine it has slipped through the cracks, but a deliberate decision to not address.
- capableweb 4y agoVery unlikely you'd face any legal action for usage of anything. If you share it, then it becomes less unlikely. Edit: Also, judging by a comment from the team in the GitHub repository (https://github.com/lm-sys/FastChat/issues/86#issuecomment-1491358353 https://github.com/lm-sys/FastChat/issues/86#issuecomment-14...), they seem to at least hint about been in contact with the llama team.
- sebzim4500 4y agoThe llama-dl project actually helped you download the weights, whereas this just assumes you already have them. That feels like a pretty massive difference to me.
- gaogao 4y agoIt's fairly similar to a ROM patch in the video game space, which has mostly stood the test of time.
- 0cf8612b2e1e 4y agoWith a ROM, you could at least make a claim that it was your backup copy. I have no such claims to Facebook’s model.
- SargeZT 4y agoResearchers unaffiliated with Facebook are allowed to possess and use the original weights though, and they can make use of these weights.
- muyuu 4y agolike that but requiring 60GBs of CPU RAM for some reason :-P one has to wonder how did they implement the storage of those deltas to require that sort of RAM
- wongarsu 4y agoFor perspective, that's about $200-$250 of RAM on a desktop computer. They might just not have cared. Though I expect somebody to write a patch to make this more accessible to people on laptops.
- sillysaurusx 4y ago(I work on llama-dl.) We’re fighting back against the DMCA requests on the basis that NN weights aren’t copyrightable. This thread has details: https://news.ycombinator.com/item?id=35393782 https://news.ycombinator.com/item?id=35393782 I don't think you have to worry about Facebook going after you. The worst that will happen is that they issue a DMCA, in which case your project gets knocked offline. I don’t think they’ll be going the RIAA route of suing individual hackers. The DMCAs were also launched by a third party law firm, not Meta themselves, so there’s a bit of “left hand doesn’t know what the right hand is doing” in all of this. I’ll keep everyone updated. For now, hack freely.
- meghan_rain 4y agokeep up god's work!
- knodi123 4y ago> god's work creating sentient life?
- oh_sigh 4y agoThat can't be his work, since he only picked up that hobby about 0.000625% of the universe's timespan ago.
- stcredzero 4y agoFor many humans, some "hobbies" involve "projects" which may involve seemingly infinite degrees of procrastination. (This certainly applies to me!)
- oh_sigh 4y agoYou're not wrong - but for perspective this is equivalent to a 90 year old picking up a hobby 5 hours ago.
- superkuh 4y agoThat's what they say but I just spent 10 minutes searching the git repo, reading the relavent .py files and looking at their homepage and the vicuna-7b-delta and vicuna-13b-delta-v0 files are no where to be found. Am I blind or did they announce a release without actually releasing?
- zhwu 4y agoIf you follow this command in their instruction, the delta will be automatically downloaded and applied to the base model. https://github.com/lm-sys/FastChat#vicuna-13b https://github.com/lm-sys/FastChat#vicuna-13b: `python3 -m fastchat.model.apply_delta --base /path/to/llama-13b --target /output/path/to/vicuna-13b --delta lmsys/vicuna-13b-delta-v0`
- deleted 4y ago[deleted]
- viraptor 4y agoThis can be then quantized to the llama.cpp/gpt4all format, right? Specifically, this only tweaks the existing weights slightly, without changing the structure?
- hotpathdev 4y agoI may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.
- zhwu 4y agoYes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llama https://huggingface.co/docs/transformers/main/model_doc/llam...
- MMMercy2 4y agoYou can use this command to apply the delta weights. (https://github.com/lm-sys/FastChat#vicuna-13b https://github.com/lm-sys/FastChat#vicuna-13b) The delta weights are hosted on huggingface and will be automatically downloaded.
- stcredzero 4y agoVicuna at huggingface.com? This keeps making me think of "facehuggers" from Aliens and Vecna from Stranger Things. (I know a vicuna is a llama like animal.)