3 ms·

If you're interested in this stuff and wanna try it yourself, check out our product, Edge Impulse: https://edgeimpulse.com/ai-practitioners https://edgeimpulse

If you're interested in this stuff and wanna try it yourself, check out our product, Edge Impulse: https://edgeimpulse.com/ai-practitioners https://edgeimpulse.com/ai-practitioners We work directly with vendors to perform low level optimization of deep learning, computer vision, and DSP workloads for dozens of architectures of microcontrollers and CPUs, plus exotic accelerators (neuromorphic compute!) and edge GPUs. This includes ESP32: https://docs.edgeimpulse.com/docs/edge-ai-hardware/mcu/espressif-esp32 https://docs.edgeimpulse.com/docs/edge-ai-hardware/mcu/espre... You can upload a TensorFlow, PyTorch, or JAX model and receive an optimized C++ library direct from your notebook in a couple lines of Python. It's honestly pretty amazing. And we also have a full Studio for training models, including architectures we've designed specifically to run well on various embedded hardware, plus hardware-aware hyperparameter optimization that will find the best model to fit your target device (in terms of latency and memory use).

TheMagicHorsey 2y ago
Yo! This is awesome stuff!
- dansitu 2y ago
  Thank you! We're trying to bring embedded ML in reach of all engineering teams and domain experts. Previously you needed a crazy mixture of ML knowledge and low-level embedded engineering skills even to get started, which is not a common occurrence!
RobotToaster 2y ago
I don't think the output from this can be used in any open source project due to the community plan restrictions, FYI.
- dansitu 2y ago
  That's definitely not our intention: the output of all Community projects is by default Apache 2.0 licensed, unless the developer specifies a different one. The community plan does have commercial use restrictions; it's designed for education, demos, and research. We have a pretty good presence in the academic community with tons of papers, code, and projects developed using our community version. Here's a Google Scholar search showing a bunch of papers: https://scholar.google.com/scholar?start=0&q=%22edge+impulse%22&hl=en&as_sdt=0,41 https://scholar.google.com/scholar?start=0&q=%22edge+impulse... We also have our own public sharing platform: https://edgeimpulse.com/projects/overview https://edgeimpulse.com/projects/overview
qiqitori 2y ago
Why C++? Does the C++ code use any difficult C++ features or is it more C with classes?
- dansitu 2y ago
  We use C++11 because we depend on some source that relies on it, but you can of course compile the library and then link to a C program: https://docs.edgeimpulse.com/docs/run-inference/cpp-library/running-your-impulse-locally#using-the-library-from-c https://docs.edgeimpulse.com/docs/run-inference/cpp-library/...

TheMagicHorsey 2y ago

Yo! This is awesome stuff!

dansitu 2y ago
Thank you! We're trying to bring embedded ML in reach of all engineering teams and domain experts. Previously you needed a crazy mixture of ML knowledge and low-level embedded engineering skills even to get started, which is not a common occurrence!

RobotToaster 2y ago

I don't think the output from this can be used in any open source project due to the community plan restrictions, FYI.

dansitu 2y ago
That's definitely not our intention: the output of all Community projects is by default Apache 2.0 licensed, unless the developer specifies a different one. The community plan does have commercial use restrictions; it's designed for education, demos, and research. We have a pretty good presence in the academic community with tons of papers, code, and projects developed using our community version. Here's a Google Scholar search showing a bunch of papers: https://scholar.google.com/scholar?start=0&q=%22edge+impulse%22&hl=en&as_sdt=0,41 https://scholar.google.com/scholar?start=0&q=%22edge+impulse... We also have our own public sharing platform: https://edgeimpulse.com/projects/overview https://edgeimpulse.com/projects/overview

qiqitori 2y ago

Why C++? Does the C++ code use any difficult C++ features or is it more C with classes?

dansitu 2y ago
We use C++11 because we depend on some source that relies on it, but you can of course compile the library and then link to a C program: https://docs.edgeimpulse.com/docs/run-inference/cpp-library/running-your-impulse-locally#using-the-library-from-c https://docs.edgeimpulse.com/docs/run-inference/cpp-library/...