4 ms·
I did experiment with local LLM running on my machine, most solutions were generated within the time of 30-60seconds. My overhead was really copying part 1 of
by segmondy 2y ago
I did experiment with local LLM running on my machine, most solutions were generated within the time of 30-60seconds. My overhead was really copying part 1 of the problem, generating the code, copying and pasting the code, running it, copying the input data, running it. Entering the result, repeating for part 2 and for most of them that was about 5 minutes from start to finish. If I automated the process, it would probably be 1 minute or less for the problems it could solve.
Not the OP, but I was able to zero shot 27 solutions correctly without any back and forth, and 5 more with a little bit back and forth. Using local models.