3 ms·

> There's some early exploration of using accessibility APIs to empower LLM's. any examples come to mind?

• simonw 9mo ago
  The popular Playwright MCP uses the Chrome accessibility tree to help agents navigate websites: https://github.com/microsoft/playwright/blob/ed176022a63add8574405499ca84b0131e531cc3/packages/playwright/src/mcp/browser/tools/snapshot.ts#L27 https://github.com/microsoft/playwright/blob/ed176022a63add8...
  • wincy 9mo ago
    I tried to have Cursor use the playwright MCP to click a few buttons on my project as a test and while it did do what I asked successfully, it burned through like 150 premium requests in 5 minutes. I guess if you’re totally insensitive to the cost you can use this.
  • quinnjh 9mo ago
    thanks, somehow have used this and also been working in a11y and didnt put 2 and 2 together that its the same tech
• jauntywundrkind 9mo ago
  Chris Shank & Orion Reed's work is always excellent. https://bsky.app/profile/chrisshank.com/post/3m3q23xpzkc2u https://bsky.app/profile/chrisshank.com/post/3m3q23xpzkc2u