3 ms·

I work on deployed embedded ML products using NVidia Jetson, and while there are C++ portions, a lot of it (dare I say most of it?) is written in Python. It's f

I work on deployed embedded ML products using NVidia Jetson, and while there are C++ portions, a lot of it (dare I say most of it?) is written in Python. It's fast enough for our embedded processors, and Docker containers makes such things very deployable -- even in relatively resource-constrained environments. No, we're not on a Raspberry Pi or an Arduino, but I don't think that SAM2 is going to squeeze down reasonably onto something that size anyways. If the inference code (TensorRT, Tensorflow, Pytorch, whatever) is fast, then what does it matter what the glue code is written in? Python has become the common vulgate as a trade language between various disciplines, and I'm all 'bout that. I've only been working in computer vision for 10-ish years, but even when I started, most research projects were in Matlab. The fact that universities have shifted away from Matlab and into Python is a breath of fresh air, lemme' tell ya'.

stefan_ 2y ago
> a lot of it (dare I say most of it?) is written in Python I guess ignorance is bliss once someone has done the work for you of getting it all down into TRT.
Grosvenor 2y ago
TIL Vulgate was a Latin version of the bible. From Apple dictionary: "the principal Latin version of the Bible, prepared mainly by St. Jerome in the late 4th century, and (as revised in 1592) adopted as the official text for the Roman Catholic Church."
IshKebab 2y ago
It matters because Python tooling is terrible enough that you need to resort to Docker, and Docker is only a viable solution in some circumstances - deploying on Linux servers. Think about deploying this in a desktop application. You aren't going to ship a Docker container there.
- steinvakt2 2y ago
  I think the upside of using Python as a general language for AI (discussion, development, ship fast, constant iteration...) is bigger than the downside of more hassle when deploying
  - IshKebab 2y ago
    Yeah the REPL / notebook feature of Python is one of the few genuine advantages it has. Even though the actual REPL was pretty awful until very recently, it did at least exist and work which is more than most languages can say.

stefan_ 2y ago

> a lot of it (dare I say most of it?) is written in Python I guess ignorance is bliss once someone has done the work for you of getting it all down into TRT.

Grosvenor 2y ago

TIL Vulgate was a Latin version of the bible. From Apple dictionary: "the principal Latin version of the Bible, prepared mainly by St. Jerome in the late 4th century, and (as revised in 1592) adopted as the official text for the Roman Catholic Church."

IshKebab 2y ago

It matters because Python tooling is terrible enough that you need to resort to Docker, and Docker is only a viable solution in some circumstances - deploying on Linux servers. Think about deploying this in a desktop application. You aren't going to ship a Docker container there.

steinvakt2 2y ago
I think the upside of using Python as a general language for AI (discussion, development, ship fast, constant iteration...) is bigger than the downside of more hassle when deploying
- IshKebab 2y ago
  Yeah the REPL / notebook feature of Python is one of the few genuine advantages it has. Even though the actual REPL was pretty awful until very recently, it did at least exist and work which is more than most languages can say.