4 ms·
Wonder why no Llama-3.1-8B based variant if the new training method has such good results. UPDATE: didn't work well https://x.com/mattshumer_/status/18317754364
by imjonse 2y ago
Wonder why no Llama-3.1-8B based variant if the new training method has such good results.
UPDATE: didn't work well https://x.com/mattshumer_/status/1831775436420083753?t=flm41D8Ru9Zld2bjsmvs0A https://x.com/mattshumer_/status/1831775436420083753?t=flm41...
- viraptor 2y agoIt's answered on Twitter. Not much improvement over other similar models at that size.
- famouswaffles 2y agoHe said it didn't improve as much https://x.com/mattshumer_/status/1831775436420083753 https://x.com/mattshumer_/status/1831775436420083753
- safoex 2y agoImagine if it was the reason in big corporations to not to investigate further some similar technique :)