Show HN: macOS/Windows AI app that sees, performs actions, and suggests files

Hey Hacker News, my name is Vlad: https://twitter.com/Fortune_VY https://twitter.com/Fortune_VY We’ve been working on IDEs AI assistants for a few years https://www.machinet.net/ https://www.machinet.net/. Yeah, years :) before chatGPT came along. We have learned a lot about AI models, and how the autoregressive nature coupled with the inability to switch an abstraction level throws a wrench in the works of a possible truly autonomous AI assistant, even OpenAI has featured us on their blog. The more we tinkered with the assistant problem for IDEs, the more we realized the gap between our dream assistant and chatGPT is huge. Moreover, we want to put our ideas faster into code, but not only code, into actions, and words too. So we decided to drop the IDEs part in our product and make a general version aka J.A.R.V.I.S. - here came mateOS or mate. Besides, we have already done a few exploration demos for voice and action: https://twitter.com/Fortune_VY/status/1721949622149538189 https://twitter.com/Fortune_VY/status/1721949622149538189 Mate is still an mvp, but it's already simple to use: - Each time you make a query, mate can see your screen. It opens up a new dimension as you don't have to explain what is happening. - It can perform simple actions on your computer, for example, ask it to “list all processes in the terminal, or draft an email in Gmail” and it will do it. - It can also ask ChatGPT about your problem by providing detailed context. - Mate senses open files in IDEs and other applications; it will suggest them so you can include them in the prompt. Very handy for chatting with PDFs and debugging the front end. - And, it's completely secure, so you can feel safe. We do not store, see, or train on your data. The screenshot is taken only in the event of a query. I still think it’s a crazy competitive market with small and large players, but I hope to find a space under the sun. If you'd like to give mate a spin, here it is for macOS and Windows: https://www.mate-os.com/ https://www.mate-os.com/ Happy to hear what you think and what we missed in mate.