3 ms·

One large model is not how the brain works. It’s not how org charts work. That LLMs are capable of what they are at the compute density they are strongly signa

One large model is not how the brain works. It’s not how org charts work. That LLMs are capable of what they are at the compute density they are strongly signals to me that the task of making a productive knowledge worker is in overhang territory. The missing piece isn’t LLM advancement, it’s LLM management. Building trust in an inwardly-adversarial LLM org chart that reports to you.

PBnFlash 3y ago
The way these systems work feel massively inefficient. We don't re-evaluate our astrophysics models when reading a cooking book.
- DavidSJ 3y ago
  Neither does GPT-4 or other sparse mixtures of experts, such as e.g. switch transformers [1]. [1] https://arxiv.org/abs/2101.03961 https://arxiv.org/abs/2101.03961
- rini17 3y ago
  Speak for yourself :)