4 ms·

Both Opus 4.6 and GPT-5.3 one shot a Gameboy emulator for me. Guess I need a better benchmark.

• paxys 8mo ago
  As coding agents get "good enough" the next differentiator will be which one can complete a task in fewer tokens.
  • tgtweak 8mo ago
    Or quicker, or more comprehensively for the same price.
  • nlh 8mo ago
    Or the same number of tokens in less time. Kinda feels like the CPU / modem wars of the 90s all over again - I remember those differences you felt going from a 386 -> 486 or from a 2400 -> 9600 baud modem. We're in the 2400 baud era for coding agents and I for one look forward to the 56k era around the corner ;)
• well_ackshually 8mo ago
  There's hundreds of gameboy emulators available on Github they've been trained on. It's quite literally the simplest piece of emulation you could do. The fact that they couldn't do it before is an indictment of how shit they were, but a gameboy emulator should be a weekend project for anyone even ever so slightly qualified. Your benchmark was awful to begin with.
  • plantain 8mo ago
    Your expectations are wild. Most software engineers could not write a game boy emulator - and now you need zero programming skills whatsoever to write one.
    • randyrand 8mo ago
      Ctrl-C + Ctrl-V. There. Done!
  • nasreddin 8mo ago
    "a gameboy emulator should be a weekend project for anyone even ever so slightly qualified" do you really believe something so ridiculous?
• gf000 8mo ago
  Is such an emulator not part of their training data sets?