3 ms·

I think it would be even more wasteful to continue inference in background for nothing if the user decided to leave without pressing the stop button. Saving th

I think it would be even more wasteful to continue inference in background for nothing if the user decided to leave without pressing the stop button. Saving the partial answer at the exact moment the client disappeared would be better.

verdverm 10mo ago
What if I want to have the agent go off and work on something for a while and I'll check back tomorrow?