3 ms·
It's frankly amazing how bad it is. On benchmarks and human comparisons, ChatGPT obliterates the small but growing open LLM community--but Bard is right in ther
by Miraste 3y ago
It's frankly amazing how bad it is. On benchmarks and human comparisons, ChatGPT obliterates the small but growing open LLM community--but Bard is right in there with the open models. It's insane to me that Google, with the people who basically invented transformers and LLMs and basically unlimited TPUs, can't do better than a few hobbyists with like three A100s between them.
- deleted 3y ago[deleted]
- tehsauce 3y agoNo one has trained a LLM of the open source level quality with just 3 gpus. Fine tuning sure, but pretraining the even the smaller models takes more than that.
- whimsicalism 3y agoWhat it really shows is how far ahead Meta got in front of Google.
- cubefox 3y agoTheir big new model will be Gemini ("twins") apparently a DeepMind / Google Brain joint project already before they merged.