4 ms·

I still get the full source code back at the end, I tell it to include code it wrote in the PR. I also wrote my own tool to extract and format the complete tra

by simonw 10mo ago

I still get the full source code back at the end, I tell it to include code it wrote in the PR. I also wrote my own tool to extract and format the complete transcript, it gives me back things like this where I can see everything it did including files and scripts it didn't commit. Here's an example: https://gistpreview.github.io/?3a76a868095c989d159c226b7622b092/index.html https://gistpreview.github.io/?3a76a868095c989d159c226b7622b...

scubbo 10mo ago
Oh fascinating - so you're reviewing "your own" code in-PR, rather than reviewing it before PR submission? I can see that working! Feels weird, but I can see it being a reasonable adaptation to these tools - thanks! What about running services locally for manual testing/poking? Do you open ports on the Anthropic VM to serve the endpoints, or is manual testing not part of your workflow?
- simonw 10mo ago
  Yeah, I generally use PRs for anything a coding agent writes for me. If something is too fiddly to test within the boundaries of a cloud coding agent I switch to my laptop. Claude Code for web has a "claude --teleport" command for this, or I'll sometimes just do a "gh pr checkout X" to get the branch locally.
  - scubbo 10mo ago
    Much obliged, thank you!
- bakies 10mo ago
  Yeah the commits that claude code generate are co-authored by claude@anthropic.com so i just open a PR to see the code. I have automatic per-PR dev environments for manual testing.
  - mewpmewp2 10mo ago
    What hosting do you use for automatic per PR dev environments?
    - bakies 10mo ago
      i run it in my homelab k8s cluster
      - mewpmewp2 10mo ago
        What kind of homelab do you have? And how do you do routing, do you have some sort of DNS setup too?
        bakies 10mo ago
        just some old pcs, pfsense and tailscale for routing, and external-dns in kubernetes to manage that
        mewpmewp2 10mo ago
        These are all some excellent ideas, I need to setup these things asap since I've been going back and forth on having more homelab vs cloud providers, but I'm only hearing about tailscale right now so I got to go for it. Cloud providers all of sudden becoming costly just for my side projects and/or not providing the exact PR environments like I would like etc. I've been wasting so much time on trying to automate AI Agents vs cloud providers with limited conf.. It would be great if AI Agents can just write the config for all deployments, pipelines, standards, without me having to go to any UI to tweak things manually etc. Even with GitHub CI now all of sudden it wasted $50 on few days of CI actions. Should have everything run on my home server. But I think I may need more powerful home server, I have a cheap Dell refurbished one now. I don't want to ever have to touch a UI again (except in places like Hackernews or the like) and the ones I specially built (read: vibecoded) for myself.
        10mo ago

by simonw 10mo ago

scubbo 10mo ago

Oh fascinating - so you're reviewing "your own" code in-PR, rather than reviewing it before PR submission? I can see that working! Feels weird, but I can see it being a reasonable adaptation to these tools - thanks! What about running services locally for manual testing/poking? Do you open ports on the Anthropic VM to serve the endpoints, or is manual testing not part of your workflow?

simonw 10mo ago
Yeah, I generally use PRs for anything a coding agent writes for me. If something is too fiddly to test within the boundaries of a cloud coding agent I switch to my laptop. Claude Code for web has a "claude --teleport" command for this, or I'll sometimes just do a "gh pr checkout X" to get the branch locally.
- scubbo 10mo ago
  Much obliged, thank you!
bakies 10mo ago
Yeah the commits that claude code generate are co-authored by claude@anthropic.com so i just open a PR to see the code. I have automatic per-PR dev environments for manual testing.
- mewpmewp2 10mo ago
  What hosting do you use for automatic per PR dev environments?
  - bakies 10mo ago
    i run it in my homelab k8s cluster
    - mewpmewp2 10mo ago
      What kind of homelab do you have? And how do you do routing, do you have some sort of DNS setup too?
      - bakies 10mo ago
        just some old pcs, pfsense and tailscale for routing, and external-dns in kubernetes to manage that
        mewpmewp2 10mo ago
        These are all some excellent ideas, I need to setup these things asap since I've been going back and forth on having more homelab vs cloud providers, but I'm only hearing about tailscale right now so I got to go for it. Cloud providers all of sudden becoming costly just for my side projects and/or not providing the exact PR environments like I would like etc. I've been wasting so much time on trying to automate AI Agents vs cloud providers with limited conf.. It would be great if AI Agents can just write the config for all deployments, pipelines, standards, without me having to go to any UI to tweak things manually etc. Even with GitHub CI now all of sudden it wasted $50 on few days of CI actions. Should have everything run on my home server. But I think I may need more powerful home server, I have a cheap Dell refurbished one now. I don't want to ever have to touch a UI again (except in places like Hackernews or the like) and the ones I specially built (read: vibecoded) for myself.
        10mo ago