3 ms·

Would be good to include Fable and Opus. Based on the results with Astra vs GLM (not even in the same ballpark), these are probably the realistic alternatives t

• bensyverson 25d ago
  Yes, I'd be really interested to see Fable / Opus / Sonnet. GLM 5.3 Flash Max had an interesting showing. Its Codex version was bad [0], and it completed in 9 minutes. The OpenCode version was much richer [1] and more detailed, completed in 20 minutes. And the OMP version was arguably the most complete [2], completing in 30 minutes. This is probably the strongest argument for the effect of a harness, and I'd be interested to learn the differences in the prompts and tools between these three. [0]: https://alvins82.github.io/hangar-harness-model-tests/hangar-codex-glm53flash-max/sci-fi-hangar.html https://alvins82.github.io/hangar-harness-model-tests/hangar... [1]: https://alvins82.github.io/hangar-harness-model-tests/hangar-opencode-glm5.7flash/opencode-glm57-flash-max.html https://alvins82.github.io/hangar-harness-model-tests/hangar... [2]: https://alvins82.github.io/hangar-harness-model-tests/hangar-omp-glm53-flash/omp-glm57-flash-max.html https://alvins82.github.io/hangar-harness-model-tests/hangar...
  • alvins82 25d ago
    I have posted all the transcripts on github so you can point your AI at it and prompt away. https://github.com/alvins82/hangar-harness-model-tests/ https://github.com/alvins82/hangar-harness-model-tests/
  • deleted 25d ago
    [deleted]