4 ms·
Orin has support for FP16 of course, it would be insane not to have it when INT8 isn't viable for a lot of models anyway. There are some preliminary benchmarks
by aseipp 4y ago
Orin has support for FP16 of course, it would be insane not to have it when INT8 isn't viable for a lot of models anyway. There are some preliminary benchmarks that can confirm this that weren't hard to find.[1] The number juicing by way of using "TOPS" to mean "Sparse INT8" or whatever has been going on since the beginning of the Ampere line, though, so yes you should take that with a grain of salt (Ampere being the gen they added sparse tensor cores.) But not including FP16 support would just be a ridiculous move, frankly.
According to this table on this page[2], the lack of the NVENC support is due to the "Nano" vs "NX" product lines which they are introducing. NX started with Xavier, there was never a Xavier Nano, to my knowledge (since you could just buy the original Jetson Nano.) Xavier NX still has NVENC support, and now you can buy separate Orin NX modules with even more RAM. So they're just segregating their products further, it looks like. (Hit "Specifications" then expand the table and look at Video Encode/Decode support.)
So for people like us, we just want the Orin NX series. But yes, no more ultra cheap cameras.
I'm guessing they're eventually going to gear for Orin as an eventual successor to the original Nano, but who knows. It'll take a few price cuts to get there.
[1] https://www.edge-ai-vision.com/2022/04/is-the-new-nvidia-jetson-agx-orin-really-a-game-changer-we-benchmarked-it/ https://www.edge-ai-vision.com/2022/04/is-the-new-nvidia-jet...
[2] https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-orin/ https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
- csdvrx 4y ago> the lack of the NVENC support is due to the "Nano" vs "NX" product lines Translated into plain English: "we're crimping the regular product because we want to extract more cash from consumers: we didn't like that they enjoyed so much this hardware encoding support. Let's make them cough up a few extra hundreds by cutting it out!"
- fxtentacle 4y agoYour link [1] doesn't seem to mention the Orin Nano anywhere? It says that the bigger SOMs with DLA have FP16. But the Orin Nano doesn't have DLA.