2 ms·
Sure, but if I ask the LLM a question, I'd like it to respond now, instead of tonight.
by stavros 8mo ago
Sure, but if I ask the LLM a question, I'd like it to respond now, instead of tonight.
- toomuchtodo 8mo agoCertainly, interactive workloads aren’t realistic for time shifting, but agentic coding likely is. Package everything up and ship it as a job, getting a bundle back asynchronously.
- stavros 8mo agoI don't know, my agentic coding is pretty interactive. Maybe once the plan is done, sure. That would be interesting, though OpenAI already does this with batch workloads.