3 ms·
Disappointed to note that the 8k context length is far short of Mixtral 8x22B's 64k context length. Still, the published performance metrics are impressive. K
by loudmax 2y ago
Disappointed to note that the 8k context length is far short of Mixtral 8x22B's 64k context length.
Still, the published performance metrics are impressive. Kudos to Meta for putting these models out there.
- rising-sky 2y agoThey’re going to increase the context window https://www.threads.net/@zuck/post/C56MOZ3xdHI/?xmt=AQGzjzazsycd7hUW10eWagOXTUp4Tq351z9JKlDvMU0JKA https://www.threads.net/@zuck/post/C56MOZ3xdHI/?xmt=AQGzjzaz...