4 ms·
Aren't those generally burned into the model itself so not really configurable?
by rtkwe 3y ago
Aren't those generally burned into the model itself so not really configurable?
- creatonez 3y agoAside from the prompt and any embeddings, yes. But Mozilla's LLM runtime supports running arbitrary llama models, with a vision-capable chatbot interface. So it will be interesting to see if models are swappable in the Firefox AI.