3 ms·
given what we know about how AI inference works, I think we can assume that the mechanism will be running locally What do you know about AI inference that I do
by tremon 3y ago
given what we know about how AI inference works, I think we can assume that the mechanism will be running locally
What do you know about AI inference that I don't? I thought most LLM models ran in the cloud because they are too power-hungry to run purely locally. If that's already true for text analysis and synthesis, doesn't that apply doubly so to 3D vision and motion analysis?
- monksy 3y agoTraining happens on the servers, existing trained models can be small enough to run locally and on embedded systems