3 ms·
I have ran 5 “test cases” where I would jump on a video call with some friends that are not software engineers but are very technically savvy, and would give th
by tymscar 3y ago
I have ran 5 “test cases” where I would jump on a video call with some friends that are not software engineers but are very technically savvy, and would give them a simple-ish task.
They are allowed to use ChatGPT as well as Google. None managed to do it in 4 hours each, and that was with me giving them hints when the AI would inevitably get into a loop.
The task was to install docker and using docker compose host a reverse proxy with Træfik with self signed SSL, as well as web-server in Rust. All the rust app had to do was read the kernel version of the host machine and return it as html.
I have then ran the same exact test, but this time around, all you had to do was install docker, and with docker compose run a Træfik reverse proxy with self signed SSL, and two other containers, UptimeKuma and Audiobookshelf. No dice, nobody managed to do it.
- jackconsidine 3y agoWow kudos to you for running such a controlled and extensive experiment
- rolisz 3y agoAre they still friends with you? Are they still returning your calls? I've been coding for 15 years, but on my NAS I still use the Synology reverse proxy so I don't have to deal with Traefik and self signed SSL.
- tymscar 3y agoNow that you mention it, they haven’t really answered my calls in weeks. Joking aside, we actually had a lot of fun and they thought it was very eye opening, not only about AI, but also about what my work life is like.