3 ms·
These are smaller scale model that you can export and run anywhere. Even the smallest multimodal LLM would be wayyyyyyy bigger than an exported model from this
by navanchauhan 3y ago
These are smaller scale model that you can export and run anywhere.
Even the smallest multimodal LLM would be wayyyyyyy bigger than an exported model from this
- jatins 3y agoHow small are these models? can I export a model here and embed it in an Android/ios app?
- vineyardmike 3y agoYou can supposedly embed them for Arduinos, so an app should be no problem.
- jzombie 3y agoThe website says they can be embedded in a web app, and export to a format called TensorFlow Lite. I am sure you could embed it. https://www.tensorflow.org/lite https://www.tensorflow.org/lite
- pona-a 3y agohttps://www.tensorflow.org/lite/android https://www.tensorflow.org/lite/android TF Lite has first-class Android support with hardware acceleration if I'm not mistaken.