2 ms·
Thank you for making this available! Check out https://github.com/OpenAdaptAI/OpenAdapt https://github.com/OpenAdaptAI/OpenAdapt for a cross platform (Mac and
by abrichr 2y ago
Thank you for making this available!
Check out https://github.com/OpenAdaptAI/OpenAdapt https://github.com/OpenAdaptAI/OpenAdapt for a cross platform (Mac and Windows) open source library that learns to perform tasks in desktop apps by observing human demonstrations.
We believe a major shortcoming with conventional approaches to AI agents is expecting them to be able to figure tasks of arbitrary complexity from first principles. While understandable from an academic perspective, this is unnecessary for practical utility, since humans perform these tasks constantly.
With OpenAdapt you can demonstrate to a model how to perform a task, then have it take over the task, with additional user-supplied natural language instructions.
I have created an issue to evaluate OpenAdapt on OSWorld: https://github.com/OpenAdaptAI/OpenAdapt/issues/642 https://github.com/OpenAdaptAI/OpenAdapt/issues/642. Contributions welcome!
Edit: from https://github.com/xlang-ai/OSWorld/tree/main/evaluation_examples https://github.com/xlang-ai/OSWorld/tree/main/evaluation_exa...:
> The ./trajectories file contains the annotated trajectories for each data item in ./examples for finishing the task.
Unfortunately this file does not appear to be included in the repo. I have submitted an issue here: https://github.com/xlang-ai/OSWorld/issues/30 https://github.com/xlang-ai/OSWorld/issues/30