3 ms·
Team behind Hailuo release 1M context LLM competitive with Claude and GPT 4o
- logicchains 2y agoNotable it's a hybrid model, 7 linear attention layers for every traditional O(n^2) attention layer. They claim this allows it to outperform other LLMs (including Gemini) on long context benchmarks.