3 ms·
This has the potential to be huge for computer use. OpenAI has been teasing how fast computer use is with their models running on Cerebras chips but the differ
by postalcoder 19d ago
This has the potential to be huge for computer use.
OpenAI has been teasing how fast computer use is with their models running on Cerebras chips but the difference here is a burning hole in your pocket.
- Gecko4072 19d agoLike which elements to select? Similar to the doom and wikipedia runs?
- postalcoder 19d agoYeah. Computer use is essentially a model navigating the OS-provided accessibility tree. I imagine a model trained on it would operate the computer exactly as we saw it control Doom. https://developer.apple.com/library/archive/documentation/Accessibility/Conceptual/AccessibilityMacOSX/OSXAXmodel.html https://developer.apple.com/library/archive/documentation/Ac...
- nowittyusername 17d agoI can think of many uses for this thing, robotics being one that could really benefit from something like this. A hybrid approach with this and action models and vllms could be really good mix, also agents inside simulated virtual environments, etc... basically anywhere where latency is important but you need some intelligence this will fill those gaps. Weave it with other systems and you have a nervous system as jev with other models like vllm or even text as the slower deeper thinker.