4 ms·
Because the black box is shrinking, does it mean we might ge able to get similar quality results with smaller models?
by miohtama 4y ago
Because the black box is shrinking, does it mean we might ge able to get similar quality results with smaller models?
- wongarsu 4y agoEventually better understanding of the mechanisms should allow us to make better models. Right now OpenAI is still exploring the boundaries of "how much does it get better if we just make it bigger", but that is just the first phase of making LLMs. Remember that transformer models are basically brand new, having been invented just six years ago. There are bound to be lots of improvements left that will later be described as low-hanging fruit.