4 ms·

It's your choice, but it's definitely not ,,just another tool''. Most of my LLMs made lots of mistakes, but Codex with $200 subscription changed my workflow t

It's your choice, but it's definitely not ,,just another tool''. Most of my LLMs made lots of mistakes, but Codex with $200 subscription changed my workflow totally, and now I'm having 40 pull requests/day merged. Treat LLMs as interns, increase your test coverage with them to the point that they can't ruin your codebase and get really good at reviewing code and splitting tasks up to smaller digestible ones, and promote yourself as team leader.

fmbb 1y ago
Can you share your source?
- xiphias2 1y ago
  Sure, it's an open source reactive web framework, the pull requests are public. I want to announce it here on HN soon, I just still have a few serious bugs to fix: https://github.com/adamritter/pageql https://github.com/adamritter/pageql
  - fmbb 1y ago
    Awesome. There is a lot of discussion around coding agents but I don’t find a lot of real world examples. This will be interesting to look at, thanks for sharing!
moltar 1y ago
What kind of tasks you give Codex? I gave it an honest chance, but couldn’t get a single PR out of it. It would just continue to make mistakes. And even when it got close I asked it a minor tweak and it made things worse. I iterated 7 times on the same small problem.
- diggan 1y ago
  > What kind of tasks you give Codex? Currently in the stage of evaluating Codex (mostly comparing it to Aider and my own homegrown LLM setup). I'm able to get changes out of it, that mostly make sense, but you really need to take whatever personal guidelines you have for coding and "encode" them into the AGENTS.md, and really focus on asking the right question/request changes in the right way. Without AGENTS.md, it seems to go of the wrong end really quickly, and end up with subpar code. But with a little bit of guidance, I do get some results at least. This is the current AGENTS.md I'm using for some smaller projects: https://gist.github.com/victorb/1fe62fe7b80a64fc5b446f82d3137398 https://gist.github.com/victorb/1fe62fe7b80a64fc5b446f82d313... With that said, it does get mislead sometimes, and the UX isn't great for the web version. It's really slow, you can't customize the environment, the UI seems to load data in a really weird way leading to slowdowns and high latencies, and overall it's just cumbersome. My homegrown version is way faster for the iterations, + has stateful PRs it can iterate on and receive line comment feedback on, but the local models I'm using are obviously worse than the OpenAI ones, so I'd still say Codex is probably overall better, sadly.
lispisok 1y ago
You can review and approve 40 PR's a day from intern quality work?
- v3ss0n 1y ago
  Sure, LGTMx40 and call it a day .What could possibly go wrong.
risyachka 1y ago
Ia this a personal project or prod startup with clients?
- xiphias2 1y ago
  Personal
lelanthran 1y ago
I'm sceptical of 40 PRs per day. In an 8 hour workday you are merging one new PR every 12 minutes? I'm very sceptical that anyone can review a significant chunk of code that fast, unless these are all one and two liners that pass review on the first go. In this best case scenario, where no review results in reworking the PR, and you can review and merge every 12 minutes, without any breaks of any sort, why is your review even required?
- xiphias2 1y ago
  It's not 8 hour work day, I just did it all day long from waking up to sleeping. And of course it contains lots of corrections. sometimes it's 30 lines with some bug that I see, then I ask codex to fix the bug in a separate pull request. It's an open source web framework I have been working on ( https://github.com/adamritter/pageql https://github.com/adamritter/pageql). To tell you the truth it slowed down yesterday as most of the features were done and I had to fix memory/signal/callback leaks, but even that was done much faster than if I did it by hand. I had done coding on my phone while buying flowers in a gardening store, in my bed waking up without getting out my laptop etc... so yeah, it's not for those people who take the 8 hour work day strictly.

fmbb 1y ago

Can you share your source?

xiphias2 1y ago
Sure, it's an open source reactive web framework, the pull requests are public. I want to announce it here on HN soon, I just still have a few serious bugs to fix: https://github.com/adamritter/pageql https://github.com/adamritter/pageql
- fmbb 1y ago
  Awesome. There is a lot of discussion around coding agents but I don’t find a lot of real world examples. This will be interesting to look at, thanks for sharing!

moltar 1y ago

What kind of tasks you give Codex? I gave it an honest chance, but couldn’t get a single PR out of it. It would just continue to make mistakes. And even when it got close I asked it a minor tweak and it made things worse. I iterated 7 times on the same small problem.

diggan 1y ago
> What kind of tasks you give Codex? Currently in the stage of evaluating Codex (mostly comparing it to Aider and my own homegrown LLM setup). I'm able to get changes out of it, that mostly make sense, but you really need to take whatever personal guidelines you have for coding and "encode" them into the AGENTS.md, and really focus on asking the right question/request changes in the right way. Without AGENTS.md, it seems to go of the wrong end really quickly, and end up with subpar code. But with a little bit of guidance, I do get some results at least. This is the current AGENTS.md I'm using for some smaller projects: https://gist.github.com/victorb/1fe62fe7b80a64fc5b446f82d3137398 https://gist.github.com/victorb/1fe62fe7b80a64fc5b446f82d313... With that said, it does get mislead sometimes, and the UX isn't great for the web version. It's really slow, you can't customize the environment, the UI seems to load data in a really weird way leading to slowdowns and high latencies, and overall it's just cumbersome. My homegrown version is way faster for the iterations, + has stateful PRs it can iterate on and receive line comment feedback on, but the local models I'm using are obviously worse than the OpenAI ones, so I'd still say Codex is probably overall better, sadly.

lispisok 1y ago

You can review and approve 40 PR's a day from intern quality work?

v3ss0n 1y ago
Sure, LGTMx40 and call it a day .What could possibly go wrong.

risyachka 1y ago

Ia this a personal project or prod startup with clients?

xiphias2 1y ago
Personal

lelanthran 1y ago

I'm sceptical of 40 PRs per day. In an 8 hour workday you are merging one new PR every 12 minutes? I'm very sceptical that anyone can review a significant chunk of code that fast, unless these are all one and two liners that pass review on the first go. In this best case scenario, where no review results in reworking the PR, and you can review and merge every 12 minutes, without any breaks of any sort, why is your review even required?

xiphias2 1y ago
It's not 8 hour work day, I just did it all day long from waking up to sleeping. And of course it contains lots of corrections. sometimes it's 30 lines with some bug that I see, then I ask codex to fix the bug in a separate pull request. It's an open source web framework I have been working on ( https://github.com/adamritter/pageql https://github.com/adamritter/pageql). To tell you the truth it slowed down yesterday as most of the features were done and I had to fix memory/signal/callback leaks, but even that was done much faster than if I did it by hand. I had done coding on my phone while buying flowers in a gardening store, in my bed waking up without getting out my laptop etc... so yeah, it's not for those people who take the 8 hour work day strictly.