4 ms·
I must be missing something: isn’t this just describing a queue? The fact that the workload is a LLM seems irrelevant, it’s just async processing of jobs?
by williamdclt 2y ago
I must be missing something: isn’t this just describing a queue? The fact that the workload is a LLM seems irrelevant, it’s just async processing of jobs?
- deleted 2y ago[deleted]
- lawlessone 2y agoeverything's a queue in software if you think about it :-). But does sound more like queue than most things
- soci 2y agoor a stack!
- cheesyFish 2y agoIt being a queue is one part of it yes. But the key is trying to provide tight integrations and take advantage of agentic features. Stuff like the orchestrator, having an external service to execute tools, etc.
- conceptme 2y agoIt does not sound very specific "stuff" like the orchestration, any other queues needs to deal with assigning work?
- mountainriver 2y agoYeah this is just a queue system, lots of agent versions of these already. There’s nothing special about agents that they need their own queue system