3 ms·
Like which elements to select? Similar to the doom and wikipedia runs?
by Gecko4072 18d ago
Like which elements to select? Similar to the doom and wikipedia runs?
- postalcoder 18d agoYeah. Computer use is essentially a model navigating the OS-provided accessibility tree. I imagine a model trained on it would operate the computer exactly as we saw it control Doom. https://developer.apple.com/library/archive/documentation/Accessibility/Conceptual/AccessibilityMacOSX/OSXAXmodel.html https://developer.apple.com/library/archive/documentation/Ac...