famouswaffles

611 ms·

3031.
by famouswaffles 4y ago
Smaller models are typically dumber. Sure you could fine-tune a smaller model on say the medical domain and they might even perform better on some benchmarks but they won't reason or generalize as well. domain finetuned large models &g
3032.
by famouswaffles 4y ago
GPT 3.5 is definitely not comparable to Palm. You can see some benchmarks here. https://crfm.stanford.edu/helm/latest/?group=core_scenarios For example, text-davinci-3 is 56.9 on MMLU, Flan-Palm is 75. https:&#x2
3033.
Large language models generate functional protein sequences across diverse fams(nature.com)
1 points by famouswaffles 4y ago|0 comments
3034.
by famouswaffles 4y ago
LLMs can pilot robots just fine lol https://innermonologue.github.io/ https://sites.research.google/palm-saycan https://www.microsoft.com/en-us/research/group/autonomous-sy...
3035.
by famouswaffles 4y ago
That's a good point. I was just kind of randomly plowing through so i didn't pick any dialogue scene specifically. Don't think it'll fail there though.
3036.
by famouswaffles 4y ago
If https://arxiv.org/abs/2301.03728 And https://arxiv.org/abs/2302.00923 Is anything to go by then Large Scale + Language + Multimodality + RLHF + Toolformers
3037.
by famouswaffles 4y ago
AI systems have gotten far more capable. And our understanding of them is continuously decreasing. So it's really fucking bizarre the reaction is to downplay the achievements. Humanity is weird.
3038.
by famouswaffles 4y ago
Only if you're hellbent on the nonsensical "parrot" argument. It's fairly obvious right now all the major pieces for Human Level AGI are here. Just needs to be put it together and that's going to happen in the next
3039.
by famouswaffles 4y ago
I tested Chinese-English translations on a properly bilingual LLM and the results are amazing. You might be interested in seeing https://github.com/ogkalu2/Human-parity-on-machine-translati...
3040.
by famouswaffles 4y ago
I think it's a matter of training corpus. Here's how a bilingual equally corpus bilingual LLM does on Chinese-English translations. https://github.com/ogkalu2/Human-parity-on-machine-translati...
3041.
by famouswaffles 4y ago
Hey you might this. Bilingual LLMs really are human level translators. I don't know why this frankly mindblowing fact isn't discussed or researched more but they are. https://github.com/ogkalu2/Human-parity-on
3042.
by famouswaffles 4y ago
Bilingual LLMs are human level translators. I don't know why this frankly mindblowing fact isn't discussed or researched more but they are. https://github.com/ogkalu2/Human-parity-on-machine-translati...