5 ms·
Open request to skeptics or curious minds - do you have a task that's at least somewhat less difficult for me to set up than swe-bench? I'd be happy to create
by JoshPurtell 1y ago
Open request to skeptics or curious minds - do you have a task that's at least somewhat less difficult for me to set up than swe-bench?
I'd be happy to create you a base agent, and a fine-tuned agent, and OSS the traces for you to look at differently.
And if it's really compelling, visualize them in a hosted frontend :-)
- elliotto 1y agoA really simple blog post for any task that you think is worthwhile would be enough to move the field forward. The blog post should include: 1) the training configuration and code 2) the data used to fine tune 3) a set of input/output comparisons comparing the tuned bot to the original bot that show it's learned something interesting For something really compelling it would host the created models on a repo that I could download and use. The gold standard would be to host them and provide a browser interface, but this could be expensive for gpu costs. This blog post currently doesn't exist, or if it does I haven't been able to find it in the sea of medium articles detailing an outdated hugging face api