3 ms·
Thanks! We all dogfood Claude every day to do our own work here, and solving our own pain points is more exciting to us than abstract benchmarks. Getting thing
by eschluntz 2y ago
Thanks! We all dogfood Claude every day to do our own work here, and solving our own pain points is more exciting to us than abstract benchmarks.
Getting things done require a lot of booksmarts, but also a lot of "street smarts" - knowing when to answer quickly, when to double back, etc
- LouisSayers 2y agoCould you tell us a bit about the coding tools you use and how you go about interacting with Claude?
- catherinewu 2y agoWe find that Claude is really good at test driven development, so we often ask Claude to write tests first and then ask Claude to iterate against the tests
- Kerrick 2y agoWrite tests (plural) first, as in write more than one failing test before making it pass?
- zarmin 2y agoTime to look up TDD, my friend.
- DrammBA 2y agoOne of today's lucky 10,000. His mind is about to expand beyond imagination.
- Kerrick 2y agoTime to actually read Test-Driven Development By Example, my friend. Or if you can't stomach reading a whole book, read this: https://tidyfirst.substack.com/p/canon-tdd https://tidyfirst.substack.com/p/canon-tdd TL;DR - If you're writing more than one failing test at a time, you are not doing Test-Driven Development.
- zarmin 2y agooh my god, your comment was just a setup for you to be pedantic? all discourse on the internet is worthless. i don't know why i keep engaging.
- jasonjmcghee 2y agoJust want to say nice job and keep it up. Thrilled to start playing with 3.7. In general, benchmarks seem to very misleading in my experience, and I still prefer sonnet 3.5 for _nearly_ every use case- except massive text tasks, which I use gemini 2.0 pro with the 2M token context window.
- martinald 2y agoI find the webdev arena tends to match my experience with models much more closely than other benchmarks: https://web.lmarena.ai/leaderboard https://web.lmarena.ai/leaderboard. Excited to see how 3.7 performs!
- jasonjmcghee 2y agoAn update: "code" is very good. Just did a ~4 hour task in about an hour. It cost $3 which is more than I usual spend in an hour, but very worth it.