3 ms·
It's not really about the speed of getting something, rather energy necessary. Inherently searching for discrete things that are already indexed properly (a lar
by endisneigh 3y ago
It's not really about the speed of getting something, rather energy necessary. Inherently searching for discrete things that are already indexed properly (a large one time cost) will always be faster than inferencing a XXB parameter model.
There are contrived examples one could conjure where using AI is slower but ultimately uses less energy than due to the complexity involved, since searching is well, searching preexisting things. If you need something new and you're not good at searching it might require less time and compute in the end to just ask a model than potentially wasting days, weeks or years flailing about.