4 ms·
This is by far the most practical piece of writing I've seen on the subject of "agents" - it includes actionable definitions, then splits most of the value out
by simonw 2y ago
This is by far the most practical piece of writing I've seen on the subject of "agents" - it includes actionable definitions, then splits most of the value out into "workflows" and describes those in depth with example applications.
There's also a cookbook with useful code examples: https://github.com/anthropics/anthropic-cookbook/tree/main/patterns/agents https://github.com/anthropics/anthropic-cookbook/tree/main/p...
Blogged about this here: https://simonwillison.net/2024/Dec/20/building-effective-agents/ https://simonwillison.net/2024/Dec/20/building-effective-age...
- 3abiton 2y agoI'm glad they are publishing their cookbooks recipes on github too. Openai used to be more active there.
- FrustratedMonky 2y ago[flagged]
- refulgentis 2y agoEh, let's nip this in the bud: we could end up in a "it feels like...", coupled to free association, cycle. :) More substantively, we can check our vibe. OpenAI is just as active as it ever was w/notebooks. To an almost absurd degree. 5-10 commits a week. https://github.com/openai/openai-cookbook/activity https://github.com/openai/openai-cookbook/activity
- NeutralForest 2y agoThanks for all the write-ups on LLMs, you're on top of the news and it makes it way easier to follow what's happening and the existing implementations by following your blog instead.
- th0ma5 2y agoProbably the least critical and most myth pushing content imo.
- herecomethefuzz 2y ago> most myth pushing content Care to elaborate?
- th0ma5 2y agoLots of lists of the myths of LLMs out there https://masterofcode.com/blog/llms-myths-vs-reality-what-you-need-to-know-before-the-invest https://masterofcode.com/blog/llms-myths-vs-reality-what-you... Every single post glosses over some aspect of these myths or posits they can be controlled or mitigated in some way, with no examples of anyone else finding applicability of the solutions to real world problems in a supportable and reliable way. When pushed, a myth in the neighborhood of those in the list above is pushed like the system will get better, or some classical computing mechanism will make up the difference, or that the problems aren't so bad, the solution is good enough in some ambiguous way, or that people or existing systems are just as bad when they are not.
- simonw 2y agoI've written extensively about myths and misconceptions about LLMs, much of which overlaps with the observations in that post. Here's my series about misconceptions: https://simonwillison.net/series/llm-misconceptions/ https://simonwillison.net/series/llm-misconceptions/ It doesn't seem to me that you're familiar with my work - you seem to be mixing me in with the vast ocean of uncritical LLM boosting content that's out there.
- th0ma5 2y agoI'm thinking of the system you built to watch videos and parse JSON and the claims of that having a general suitability, which is simply dishonest imo. You seem to be confusing me with someone that hasn't been asking you repeatedly to address these kinds of concerns and the above series are a kind of potemkin set of things that don't intersect with your other work.
- th0ma5 2y agoHow do you protect from compounding errors?
- tlarkworthy 2y agoread the article, close the feedback loop with something verifiable (e.g. tests)
- th0ma5 2y agoAnd who tests the tests, etc
- Animats 2y agoYes, they have actionable definitions, but they are defining something quite different than the normal definition of an "agent". An agent is a party who acts for another. Often this comes from an employer-employee relationship. This matters mostly when things go wrong. Who's responsible? The airline whose AI agent gave out wrong info about airline policies found, in court, that their "intelligent agent" was considered an agent in legal terms. Which meant the airline was stuck paying for their mistake. Anthropic's definition: Some customers define agents as fully autonomous systems that operate independently over extended periods, using various tools to accomplish complex tasks. That's an autonomous system, not an agent. Autonomy is about how much something can do without outside help. Agency is about who's doing what for whom, and for whose benefit and with what authority. Those are independent concepts.
- solidasparagus 2y agoThat's only one of many definitions for the word agent outside of the context of AI. Another is something produces effects on the world. Another is something that has agency. Sort of interesting that we've coalesced on this term that has many definitions, sometimes conflicting, but where many of the definitions vaguely fit into what an "AI Agent" could be for a given person. But in the context of AI, Agent as Anthropic defines it is an appropriate word because it is a thing that has agency.
- Animats 2y ago> But in the context of AI, Agent as Anthropic defines it is an appropriate word because it is a thing that has agency. That seems circular.
- Nevermark 2y agoIt would only be circular if agency was only defined as “the property of being an agent”. That circle of reasoning isn’t being proposed as the formal definitions by anyone. Perhaps you mean tautological. In which case, an agent having agency would be an informal tautology. A relationship so basic to the subject matter that it essentially must be true. Which would be the strongest possible type of argument.
- dmezzetti 2y agoIf you're looking for a lightweight open-source framework designed to handle the patterns mentioned in this article: https://github.com/neuml/txtai https://github.com/neuml/txtai Disclaimer: I'm the author of the framework.
- threecheese 2y agoHi David; I’ve seen txtai floating around, and just took a look. Would you say that it fits in a similar niche to something like llamaindex, but starting from a data/embeddings abstraction rather than a retrieval one (building on layers from there - like workflows, agents etc)?
- dmezzetti 2y agoHello - This is a great and accurate description. The idea is that out of the box there is a pipeline but each component is also customizable.
- adeptima 2y ago100% agree. I did a research on workflows, durable execution engines in context of Agents and RAGs. Put some links in a comment to the article below