5 ms·
According to that recent The Information report, Orion is supposed to be just a regular LLM except trained with synthetic data generated via Strawberry. Anthrop
by krackers 2y ago
According to that recent The Information report, Orion is supposed to be just a regular LLM except trained with synthetic data generated via Strawberry. Anthropic et al. have also been working on ways to generate synthetic data (as seen in the success of Sonnet 3.5) so I don't really know if that's going to be a big lead.
And of course the ever-hyped strawberry is supposed to be some sort of tree-of-thought type thing I think, or maybe it's related to https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2203.14465. Either way, nothing so far has come out that it's a completely novel training technique or architecture, just a gpt-4 scale model with different post-processing.
- CuriouslyC 2y agoI'm not sure why people act so mystified about Q*, the name gives it away, it's an obvious reference to A*, the only question is what the nodes in the graph are and what they're using as a Heuristic function.
- fzzzy 2y agoIt's not. It's Quiet STaR.
- imtringued 2y agoIt is in reference to this: https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2203.14465 https://arxiv.org/abs/2403.09629 https://arxiv.org/abs/2403.09629
- Eliezer 2y agoQ* is also a term from reinforcement learning.
- llmfan 2y ago"just a regular LLM except [trained on very different data]." I'm not saying there's some big moat, anyone can read https://arxiv.org/pdf/2305.20050 https://arxiv.org/pdf/2305.20050, but not all synthetic data is created equal. Strawberry I'm sure generates beautiful, valid chain-of-thought reasoning data. Wouldn't surprise me if OpenAI is just significantly ahead of the competition.