4 ms·
Vicuña in my experience is by far the best training for llama models [1]. Way way better than alpaca or base llama. Recently I tried the wizard+vicuña uncensor
by bhouston 3y ago
Vicuña in my experience is by far the best training for llama models [1]. Way way better than alpaca or base llama. Recently I tried the wizard+vicuña uncensored on llama and it was excellent. Can not wait to try that combination on llama2.
my favourite leaderboard is this one as it compares open source and closed source:
https://tatsu-lab.github.io/alpaca_eval/ https://tatsu-lab.github.io/alpaca_eval/
[1] https://news.ycombinator.com/item?id=36975048 https://news.ycombinator.com/item?id=36975048
- azeirah 3y agoWhat do you mean by wizard+vicuna? I use wizardlm myself right now and have used vicuna in the past. Do you mean there's a model trained on the datasets of both wizardlm and vicuna?
- bhouston 3y agoI do not know. I just know that this model I found and used is very excellent: Vicuna + Wizard - Censoring: https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored-GGML https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored... Seems to be based upon this: https://github.com/melodysdreamj/WizardVicunaLM https://github.com/melodysdreamj/WizardVicunaLM
- Dig1t 3y ago"Wizard's dataset + ChatGPT's conversation extension + Vicuna's tuning method"
- capableweb 3y agoHow accurate do you think that leaderboard is? It puts LLaMA2 Chat 70B at 92.66% and GPT-4 at 95.28%, only a ~3% difference.
- bhouston 3y agoI don't know exactly, and all benchmarks are subject to problems. But in my experience the ordering in this list is roughly right for the models I've tried.