4 ms·
seems like it's not a new 671 B behemoth, just the V3 MoE engine with long-context RoPE + FA2, retargeted at theorem proving. see [1,2]: [1]: https://arxiv.org
by dvrp 1y ago
seems like it's not a new 671 B behemoth, just the V3 MoE engine with long-context RoPE + FA2, retargeted at theorem proving. see [1,2]:
[1]: https://arxiv.org/abs/2405.14333 https://arxiv.org/abs/2405.14333
[2]: https://arxiv.org/abs/2408.08152 https://arxiv.org/abs/2408.08152