2 ms·
I'm really surprised TF lite is being used. Do they train models or is this (my assumption) just inference? Do they have a talent constraint? I would have expec
by andy99 3y ago
I'm really surprised TF lite is being used. Do they train models or is this (my assumption) just inference? Do they have a talent constraint? I would have expected handwritten C inference in order to make these as small and efficient as possible.
- synergy20 3y agoit's all inference
- cyberninja15 3y agoMakes sense. And, TF Lite is excellent for on-device models and inference.
- liuliu 3y agoI think TinyML has pretty close tie to Pete Warden / Useful Sensors, who led TF Lite back in Google.
- dansitu 3y agoIt's mostly inference: typically on-device training is with classical ML, not deep learning, so no on-device backprop. For inference there's a whole spectrum of approaches that let you can trade off flexibility for performance. TF Lite Micro is at one end, hand-written Verilog is at the other. Typically, flexibility is more important at the start of a project, while deep optimization is more important later. You wanna be able to iterate fast. That said, the flexible approaches are now good enough that you will typically get better ROI from optimizing your model architecture rather than your inference code. I think the sweet spot today is code-generation, when targeting general purpose cores. There's also increasing numbers of chips with hardware acceleration, which is accessed using a compiler that takes a model architecture as input.