6 ms·
Given the rate of improvement wrt to llms, this may not hold true for long
by gnatolf 1y ago
Given the rate of improvement wrt to llms, this may not hold true for long
- yunwal 1y agoThe rate of improvement with LLMs seems to have halted since Claude3.5, which was about a year ago. I think we’ve probably gone as far as we can go with tweaks to transformer architectures, and we’ll need a new academic discovery which could take years to do better