5 ms·
"You most likely can't utilize the workstation 24/7. Your work hours will be concentrated into 6-10 hours per day." I have agents running 24/7 doing research,
by hellohello2 1mo ago
"You most likely can't utilize the workstation 24/7. Your work hours will be concentrated into 6-10 hours per day."
I have agents running 24/7 doing research, in fact I would argue this how they will be used for most programming tasks in the near future. For chatting, I agree local inference makes no sense. But for tasks that run continually, I'm not so sure. Personal computers took a while, local inference will too, but I think it will happen.
- manmal 1mo agoSorry for the snark, but are you trying to cure cancer? What could possibly need 24/7 research in our domain, that doesn’t need your input every 30 minutes?
- hellohello2 1mo agoNormal boring CS scientific work. Just running running my experiments, reproducing other papers, etc. A lot of it does involve the agent waiting for some computation, but the fact that it resumes independently when I'm sleeping is kind of the point (+ usually I have several running in parallel). I'm not trying to cure cancer, although I do hope people who are use LLMs. ;)
- manmal 1mo agoI didn’t expect an answer I can actually agree with - keep up the good work ;)