28 ms·
Code review could also be run as an unattended/batched task though, possibly with at least some use of on-prem inference (which excels at this). That would be a
by zozbot234 5mo ago
Code review could also be run as an unattended/batched task though, possibly with at least some use of on-prem inference (which excels at this). That would be a major saving compared to the usual cloud inference scenario.
- jwnin 5mo agowith which models, though?
- becomevocal 5mo agoYeah wasn’t there a report recently on how local models after energy costs didn’t weren’t actually more efficient to complete the same task?