abrichr

8 ms·

61.
by abrichr 2y ago
We use SAM to segment GUI elements in https://github.com/OpenAdaptAI/OpenAdapt
62.
by abrichr 2y ago
https://gist.github.com/abrichr/455f0e569bf1bd104c696a7ad9e6...
63.
by abrichr 2y ago
The paper links to their code: https://github.com/muslehal/xLSTMTime And their data, which includes daily exchange rates: https://drive.google.com/drive/folders/1nuMUIADOc1BNN-uDO2N7...
64.
by abrichr 2y ago
Thanks! Unfortunately same result
65.
by abrichr 2y ago
> We're sorry, but something went wrong. > If you are the application owner check the logs for more information. Console: cable_stream_source_element.js:22 GET https://usefind.ai/searches/are-unhappy-
66.
by abrichr 2y ago
Related: https://github.com/OpenAdaptAI/OpenAdapt
67.
by abrichr 2y ago
> Any true human-level (or even rat-level for that matter) AGI would need to have actual innate traits such as curiosity to drive lifelong exploration and learning. While perhaps not "true" intelligence (whatever that is), with
68.
by abrichr 2y ago
I wonder how they will extend this to business processes that are not in their training set. At https://openadapt.ai we rely on users to demonstrate tasks, then have the model analyze these demonstrations in order to automate th
69.
by abrichr 2y ago
> With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time. For example, if a friend texts a user their new address in Messages, the receiver can say, “Add this address to his co
70.
by abrichr 2y ago
> GLM-4V-9B possesses dialogue capabilities in both Chinese and English at a high resolution of 1120*1120. In various multimodal evaluations, including comprehensive abilities in Chinese and English, perception & reasoning, text reco
71.
by abrichr 2y ago
> It seems aws focus is now at https://github.com/aws-powertools/powertools-lambda-python
72.
by abrichr 2y ago
We have not had success with that unfortunately.
73.
by abrichr 2y ago
Thank you for the link! Our initial testing suggests MiniCPM outperforms InternVL for GUI understanding: https://github.com/OpenAdaptAI/OpenAdapt/issues/637#issuecom... (InternVL appears to hallucinate more.)
74.
by abrichr 2y ago
It's very reliable for GUI segment understanding; see e.g. https://github.com/OpenAdaptAI/OpenAdapt/pull/610 (scroll down to `gpt-4-vision-preview`).
75.
by abrichr 2y ago
> you shouldn't attribute to malice what could be attributed to stupidity It's worth noting that Hanlon’s razor was not originally intended to be interpreted as a philosophical aphorism in the same way as Occam’s: > The term
76.
by abrichr 2y ago
We have Linux support on the roadmap in https://github.com/OpenAdaptAI/OpenAdapt . OpenAdapt has similar functionality, except: - it's open source - it only records when you explicitly tell it to - it has multiple
77.
by abrichr 2y ago
https://openadapt.ai has similar functionality, except: - it's open source - it only records when you explicitly tell it to - it has multiple PII/PHI scrubbing providers built in (see https://github.com&#x2F
78.
by abrichr 2y ago
ViTs also have proven to be more effective for zero-shot generalization tasks due to their ability to capture global context and relationships in the input data, which CNNs struggle with. https://arxiv.org/abs/2304.0264
79.
by abrichr 2y ago
Agreed. Also worth noting that Hanlon’s razor was not originally intended to be interpreted as a philosophical idea in the same way as Occam’s: > The term ‘Hanlon’s Razor’ and its accompanying phrase originally came from an individual na
80.
by abrichr 2y ago
FTA: > A widespread misconception about mortgage securitization is that it was created to make Wall Street rich. … > Mortgage securitization, and secondary sales of loans, and other mechanisms cause mortgages to migrate from the banki
81.
by abrichr 2y ago
The second half of the following sentence clears it up: > The analogy is less about providing visibility into the contents of pipes (though mortgages must do that) and more “highly specialized manufactured widget that the entire world si
82.
by abrichr 2y ago
Excited to test how this performs compared to MiniCPMv2, especially when analyzing GUI images: https://github.com/OpenAdaptAI/OpenAdapt/issues/637
83.
by abrichr 2y ago
Congratulations on shipping! In https://github.com/OpenAdaptAI/OpenAdapt/blob/main/openadapt... we use FastSAM to first segment the UI elements, then have the LLM describe each segment individually. This
84.
by abrichr 2y ago
> where are my agents? https://github.com/OpenAdaptAI/OpenAdapt/
85.
by abrichr 2y ago
Primary author here. Thanks for submitting this to HN! Lots of updates in the pipeline based on all the great feedback we’ve been getting. Hopefully next time generates more interest. Happy to answer any questions!
86.
by abrichr 2y ago
If anyone is interested in running "teach mode" directly on their desktop, we're building this over at https://github.com/OpenAdaptAI/OpenAdapt .
87.
by abrichr 2y ago
> teach mode We're building this over at https://github.com/OpenAdaptAI/OpenAdapt . OpenAdapt learns to automate tasks in desktop apps by observing human demonstrations. Early demo: https://twitter.co
88.
by abrichr 2y ago
> traditional rpa doesn’t use them for all the cases I’ve seen That's because traditional RPA relies on humans to create the automations. Our goal is to create the automation automatically by observing human demonstrations.
89.
by abrichr 2y ago
> Rabbit has said the device will be able to learn any app, if you teach it. We're building this over at https://github.com/OpenAdaptAI/OpenAdapt . OpenAdapt learns to automate tasks in desktop apps by observing
90.
by abrichr 2y ago
The goal is to have a deterministic representation of a process that can be traversed in order to accomplish a task. There's a lot of literature around process mining, e.g.: - https://en.wikipedia.org/wiki/Process_

More ›