3 ms·
Author here. To be upfront about what this is: I'm not a Rust developer or a PHP internals person. This is an experiment in whether the "point the AI at the or
by ekinertac 3mo ago
Author here.
To be upfront about what this is: I'm not a Rust developer or a PHP internals person. This is an experiment in whether the "point the AI at the original project's test suite" methodology (the way Bun was driven against real-world suites) holds up when the human can't review the code. The oracle is php-src's own .phpt corpus, ~22k tests I didn't write. Current honest score: 3,844 passing (17.4%), with a realistic ceiling around 40-45% since the rest tests C extensions (GD, curl, intl, etc.) that are out of scope.
"Renders WordPress" means: fresh install completes into SQLite, the front page renders with real posts, a real theme and /wp-admin/ renders without issues. The REST API is untested, and it's currently ~55x slower than PHP on the front page (a bytecode VM is in progress, micro-benchmarks are already at 1-3x of PHP 8.5).
The scoreboard auto-generates into the repo after every run, whether the number went up or down.
Happy to answer anything.
- bbg2401 3mo agoWill you answer questions yourself, or will you simply pass on what your LLM of choice writes for you? Edit: On further inspection, the blog design, the blog build, the blog articles and even the anecdotes used in the articles are entirely Claude generated. Stop being so lazy. Get Claude to do something interesting and use your own intellect to assess and challenge the work in your write up. Or the other way around. Inject some amount of human work, at least. Otherwise, what's the point in sharing?
- ShinyLeftPad 3mo ago> will you simply pass on what your LLM of choice writes for you? But it will be as least 17% correct!
- cataphract 3mo agoThe "honest score" is the most annoying claudism of the comment, with the short disjoint sentences a close second.
- superdisk 3mo agoIt was "I need you to sit with:" that immediately made me close the article. I like LLM programming, but I really don't understand why so many people just post LLM-generated articles. What did the human even do at that point, press the start button?
- ekinertac 3mo agowell, thanks for the tips on how to run my own blog :) but the post already tells you this, the last paragraph literally says an LLM drafted it and i edited it. the whole project is an experiment in what a non rust/php guy plus AI can ship, so hiding the AI in the writing while disclosing it in every commit would be a weird place to draw the line.
- deleted 3mo ago[deleted]
- adamtaylor_13 3mo agoThis is a pretty cool experiment. Thanks for sharing!
- ekinertac 3mo agothanks! the devlog in the repo has the longer war stories if you enjoy this kind of thing.
- pluc 3mo agoCompare with FrankenPHP?
- ekinertac 3mo agoI'm not there yet but I'll run the benchmarks against FrankenPHP and include it in the project when we get at least %60 test parity.