JoshPurtell

5 ms·

31.
by JoshPurtell 1y ago
Looks really good!
32.
by JoshPurtell 1y ago
50% is not a vast majority, so that's a red herring
33.
by JoshPurtell 1y ago
34% are between 18 and 65
34.
by JoshPurtell 1y ago
Yeah, exactly, same prompt. I agree, it's more complex. But, I feel like the potential with a claude code wrapper is precisely in enabling workflows that are a pain to self-implement but nonetheless are incredibly powerful
35.
by JoshPurtell 1y ago
Something I'd consider a game-changer would be making it really easy to kick off multiple claude instances to tackle a large researched task and then to view the results and collect them into a final research document. IME no matter ho
36.
by JoshPurtell 1y ago
FWIW, if this sounds like arcane academic musing ... applied mechanism design for a while was essentially just the study of google ad auctions, and Google invested very very heavily in researchers to figure out how to do this for them
37.
by JoshPurtell 1y ago
The basic idea is this. The customer has some "curve" that represents how much he values different outcomes. Maybe he values good outcomes at $1, and great outcomes at $100. The supplier also has a cost curve - by definition, it w
38.
by JoshPurtell 1y ago
This is a really great idea! It sounds like your first approach is to verify that events met an agreed-upon threshold. Have you looked into Mechanism Design and getting customers to e.g. pay more for great outcomes, and a little for ok outc
39.
by JoshPurtell 1y ago
RL is not about delayed reward. Multi-armed bandit problems have no credit assignment component, but are often the first RL problem taught. In its most general, RL is about learning a policy (state -> action mapping). Which often require
40.
by JoshPurtell 1y ago
Awesome! I have one eval in mind that I think might demonstrate each of these capabilities, at least to a fair extent
41.
by JoshPurtell 1y ago
Open request to skeptics or curious minds - do you have a task that's at least somewhat less difficult for me to set up than swe-bench? I'd be happy to create you a base agent, and a fine-tuned agent, and OSS the traces for you to
42.
by JoshPurtell 1y ago
Hey Simon, I'm happy to oblige here. What would be the most exciting, definitive demonstration? Do you have a dataset or task in mind?