These get a lot of use in limited-run industrial applications where you need something custom and smaller/lower power than a desktop computer but you aren't man

These get a lot of use in limited-run industrial applications where you need something custom and smaller/lower power than a desktop computer but you aren't manufacturing thousands of devices and you don't have millions of dollars to develop custom hardware. You can take pretty much any model you trained on a desktop GPU and run it on the board without any changes which is nice for the right kind of project. And they sell a range of modules with a spectrum of price/performance/power draw depending on how much processing power you need. If you are manufacturing something in larger volume, they will sell you production modules without the dev boards that you can mount on your own boards. But those are still aimed at more expensive products. So this isn't a solution for low-cost high volume consumer products, but there is definitely a market for it.