theredsix

6 ms·

31.
Show HN: Open-source browser for AI agents(github.com)
155 points by theredsix 7mo ago|55 comments
32.
by theredsix 7mo ago
Exactly, the harness or protocol can matter just as much!
33.
by theredsix 7mo ago
The difference is that we make browser use turn-based and return a single structured result per action. With most other tools, the model is interacting with a live browser and effectively has to reason through a stream of low-level events w
34.
by theredsix 7mo ago
Hi HN, op here! This is an open source browser protocol for LLM agents. The browser shows the model the current page, the model chooses the next action, and the browser returns the new state. Between steps, JavaScript and time are frozen so
35.
Show HN: Deterministic browser control for AI agents (~90% on Mind2Web)(github.com)
12 points by theredsix 7mo ago|7 comments
36.
by theredsix 8mo ago
This is one of those hacker news posts that you stumble upon and see 2 genius ideas within the span of as many paragraphs. Thanks again for sharing the diffusion based labeling algorithm. Truly demonstrates a mastery and understanding of wh
37.
by theredsix 2y ago
If you need to test in production, have a family relative or friend buy the product/subscription and then make them whole offline. Also, do not reverse or refund the transaction.
38.
by theredsix 2y ago
I had an older version that used simplified HTML, and it got to decent performance with GPT-4o and Gemini but at the cost of 10x token usage. You are right, identifying the interactable elements and pulling out their values into a prompt st
39.
by theredsix 2y ago
Awesome project, starred! Here are some other projects for agentic browser interactions: * Cerebellum (Typescript): https://github.com/theredsix/cerebellum * Skyvern: https://github.com/Skyvern-AI/
40.
WebRL: Training LLM Web Agents via Self-Evolving Online Reinforcement Learning(arxiv.org)
23 points by theredsix 2y ago|1 comments
41.
by theredsix 2y ago
Update: We had a contributor start a Python port, stay tuned!
42.
by theredsix 2y ago
It's on the roadmap! A few other priorities are higher at the moment, but we'll be excited to see a PR for it in the meantime.
43.
by theredsix 2y ago
They don't discuss this at all on their blog other than "Training Claude to count pixels accurately was critical." My speculation on how they accomplished it is either explicit tokenizer support with spacial encoding similar
44.
by theredsix 2y ago
I think if you added additional function calls to detect visual bugs or breaking flows, tools such as this could automate much of QA in addition to detecting non-intuitive UI design patterns.
45.
by theredsix 2y ago
Selenium works on webdriver v4 and the screenshot is transferred as an image by the webdriver protocol. Perhaps modifying DOM before triggering the screenshot and then reverting the changes can work. PRs are welcome!
46.
by theredsix 2y ago
The next step will be adding functionality to convert and save a BrowserStep[] into a portable file format and addition conversation functions to turn those files into .jsonl that can be fed into the transformers library etc. For the PII pi
47.
by theredsix 2y ago
Not at the moment, since you need a local model with strong segmentation capabilities (x, y) and none exist ATM. We hope to train one in the future and one of Cerebellum's roadmap items is to create a the ability to save your sessions
48.
by theredsix 2y ago
OP here, happy to answer any questions you may have!
49.
Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use(github.com)
42 points by theredsix 2y ago|17 comments
50.
by theredsix 2y ago
Hi OP here, happy to answer any question!
51.
Show HN: Lightweight browser automation powered by Claude 3.5 Sonnet(github.com)
10 points by theredsix 2y ago|1 comments
52.
by theredsix 2y ago
You get the partner something shiny too!
53.
Company renting SF sleeping pods for $700 a month gains city approval(abc7news.com)
14 points by theredsix 2y ago|12 comments
54.
by theredsix 2y ago
what's your website?
55.
by theredsix 2y ago
You should evaluate the FOSS software features AS IS and ask if you're okay with the current feature set if all future features are behind an "enterprise" tier. If you are, and the hosting of the current version is manageable
56.
by theredsix 2y ago
The author's tone is condescending, angry and entitled. If everyday interactions with him followed the same tone, I would argue that he is the exact type of person behavioral interviews are meant to screen out (technically competent bu
57.
Everybody wants a piece of Marc Andreessen(woodfromeden.substack.com)
2 points by theredsix 3y ago|0 comments
58.
Neo4J Aura locks private IP connectivity behind Enterprise tier
2 points by theredsix 3y ago|0 comments
59.
by theredsix 3y ago
Congrats on the release!
60.
Where ambition goes to die': These tech workers flocked to Austin(businessinsider.com)
10 points by theredsix 3y ago|4 comments

More ›