3 ms·
Local inference is a pipe dream. There's no way any of these companies will allow consumers to interact with their flagship models on anything but a black box a
by atleastoptimal 4y ago
Local inference is a pipe dream. There's no way any of these companies will allow consumers to interact with their flagship models on anything but a black box api.
- kergonath 4y agoThe black box could well be a local library. Functionally, what would be the difference between using something like AIKit and using a REST API over the network? Local has a lot of advantages as well (latency, privacy, etc).