3 ms·
Automatically take a screenshot and feed it to https://github.com/vikhyat/moondream https://github.com/vikhyat/moondream or similar? Doable. But while very impr
by column 3y ago
Automatically take a screenshot and feed it to https://github.com/vikhyat/moondream https://github.com/vikhyat/moondream or similar? Doable. But while very impressive, the results are a bit of mixed bag (some hallucinations)
- cristyansv 3y agoI'm sure something like the accessibility API will have a smaller latency. https://developer.apple.com/library/archive/samplecode/UIElementInspector/Introduction/Intro.html https://developer.apple.com/library/archive/samplecode/UIEle...
- summarity 3y agorewind.ai seems to be moving in this direction
- cristyansv 3y agothis looks equally scary and incredible, especially the "summarize what I worked on today" examples.
- fragmede 3y agoit works really well, and locally too!