3 ms·
Can we expect that the 1M version has the same level of intelligence as the vanilla version? Across the whole 1M tokens without degradation? What are the trade
by haolez 2y ago
Can we expect that the 1M version has the same level of intelligence as the vanilla version? Across the whole 1M tokens without degradation? What are the trade offs?
- haolez 2y agoWell, according to LocalLLaMa, it's surprisingly good: https://www.reddit.com/r/LocalLLaMA/s/ypFd2Xlnvf https://www.reddit.com/r/LocalLLaMA/s/ypFd2Xlnvf