4 ms·

DeepSeek V4 Flash 0731: 82.7% on Terminal-Bench 2.1 with a public harness

• freakynit 2mo ago
  Keeps throwing forbidden after logging-in to the dashboard and goes back to login screen. Tried 4 times.
  • swrrt 2mo ago
    Oh, it seems fine for me. I can login actually. Maybe network/server instability?
    • freakynit 2mo ago
      No idea..
• kimjune01 2mo ago
  an audit for the bench for the curious: https://www.june.kim/terminal-bench-frame https://www.june.kim/terminal-bench-frame
  • ubermon 2mo ago
    yeah, that bench has a lot of room to improve, but it is the best we can find now
• polymer8563 2mo ago
  From README for Ante: "The core harness itself is developed in a private repository during the alpha" lost all interest after that sentence, sad thing