4 ms·
sama is best match with today's LLM because of the "scaling law" like Zuckerberg described. Everyone is burning cash to race to the end, but the billion dollar
by est 2y ago
sama is best match with today's LLM because of the "scaling law" like Zuckerberg described. Everyone is burning cash to race to the end, but the billion dollar question is, what is the end for transformer based LLM? Is there an end at all?
- vbezhenar 2y agoThe end is super-human reasoning along with super-human intuition, based on humanity knowledge.
- plaidfuji 2y agoSure, and the end of biotech is perfect control of the human body from pre-birth until death, but innovation has many bottlenecks. I would be very surprised if the bottlenecks to LLM performance are compute and model architecture. My guess is it’s the data.
- Mistletoe 2y agoAre you sure you can get to that with transformers? https://www.lesswrong.com/posts/SkcM4hwgH3AP6iqjs/can-you-get-agi-from-a-transformer https://www.lesswrong.com/posts/SkcM4hwgH3AP6iqjs/can-you-ge...
- meroes 2y agoAnd some Mongols, Romans, etc probably said continually expanding their boarders would give them comparable contemporary heights.