MP_1729

5 ms·

31.
by MP_1729 2y ago
I am just talking about scaling laws and the level of capex that big tech companies are doing. One hundred billion dollars are being invested this year to pursue AI scaling laws. You can be excited, as I am, while also being bearish, as I a
32.
by MP_1729 2y ago
I read Simon Sigh during high schools and that was such a beautiful story of perseveration that I decided to do Math.
33.
by MP_1729 2y ago
This thing continues to stress my skepticism for AI scaling laws and the broad AI semiconductor capex spending. 1- OpenAI is still working in GPT-4-level models. More than 14 months after the launch of GPT-4 and after more than $10B in capi
34.
by MP_1729 2y ago
Simmons is one of the greatest people and a true inspiration as a mathematician, even though my career drifted from academia. He and Andrew Wiles are the reason why I always say I am a mathematician, even though I work elsewhere. RIP
35.
by MP_1729 2y ago
Beware Goodheart's Law: "when a measure becomes a target, it ceases to be a good measure". If your goal is stopping to waste time solving bugs, I'm sure you're going to be able to do that. You should have an importa
36.
by MP_1729 2y ago
Financial market applications of "transformers", not LLMs
37.
by MP_1729 2y ago
It seems hard for people to take a nuanced approach that GPT-4 level models have in the present the potential to improve many people's lives and corporations' bottom lines while still being cautiously pessimists on the next genera
38.
by MP_1729 2y ago
Mark said in a podcast they are currently at MMLU 85, but it's still improving.
39.
by MP_1729 3y ago
OpenAI is not the worst, ChatGPT is used by 100M people weekly, sort of insulated from benchmarks. The best of the rest, Anthropic, should be really scared.
40.
by MP_1729 3y ago
Definitely not the case. Shareholders got back what was theirs of right. Dozens of CEOs, including CEOs of much larger companies like Satya Nadella and Tim Cook, got $2.2B in stock options that ended up being worth $55B. But I want to stres