3 ms·
The main LLM is only 1.5 GB so it should only take a half second to load. Or they could keep it loaded. The other models may be even smaller.
by wmf 2y ago
The main LLM is only 1.5 GB so it should only take a half second to load. Or they could keep it loaded. The other models may be even smaller.
- glial 2y agoMaybe they use the "Siri is waking up and the screen wabbles" animation time for loading the model. That would be clever.
- mholm 2y agoThey'll have plenty of time to load the model; It still needs to wait for the user to actually voice/type their request. Invoking Siri happens well before the request is ready.