4 ms·
Neural Networks in iOS 10 and macOS
- taliesinb 10y agoIt's worth noting than BNNS (the CPU library Apple released) defines just 3 layer types. It's clear they are for now targeting just convolutional networks (the kind you'd use for computer vision), and even then just the simplest possible kind (for example Alexnet, now ~4 years old). There needs to be much more functionality to build a state-of-the-art vision network, such as Google's Inception v3, at least if you want to avoid writing your own layer definitions. Hopefully they'll expand this out later. In the foundation keynote they did mention using LSTMs for predictive text, so hopefully more advanced things are in the pipeline and just haven't been API-ified yet. For reference, the deep learning library I'm working on will contain 17 layer types in its first version, with later versions probably asymptoting to double that. There are a LOT of things out there that deserve their own layer types. EDIT: to be fair to Apple, since convolution, pooling, and fully connected layers are among the most costly layers, they are the most valuable to have efficient platform implementations for.
- daveguy 10y agoLooking up info on the inception architecture. Here is a paper if others are wondering: http://arxiv.org/pdf/1512.00567v3 http://arxiv.org/pdf/1512.00567v3 From late 2015, so I guess the most up to date info? It only mentions v2. Is there a paper for v3? Edit: Sure enough v3 is right there. I saw the early focus on v2 and jumped to the big dumb assumption that v3 wasn't in there.
- taliesinb 10y agoThat's the right paper. On page 8 you'll see the line "The last line is referring to all the changes is what we refer to as “Inception-v3” below".
- embiggen 10y agoThanks, Apple, but no thanks. I'd rather stick with the completely open-source Google Tensor Flow rather than lock myself into any more of Apple's proprietary shit.
- taliesinb 10y agoYou can stick to TensorFlow for training your networks, but if you want to deploy a trained network to iOS or macOS devices (and your network is expressible in terms of Apple's primitives), you'd be doing your users a disservice not to use the fastest and most energy efficient backend to do the actual inference. I'll add that at this point, there's isn't much 'lock in' between different frameworks. Once you've trained, and if your primitives are available in the target framework, porting is just a matter of getting your weights and topology into the right format. Not too hard compared to the nitty gritty of gathering data, designing a network, and doing training and hyperparameter optimization.
- embiggen 10y agoThank you for your thoughtful comment, you've convinced me to take a moment and think more carefully about this. The energy efficiency is an excellent point. Ultimately I am still extremely leery of the apple lock in factor in general and their arbitrary rulings of what is and is not okay within the garden. I am still pretty upset and maybe even somewhat traumatized about all the previous times they've fucked me over in scenarios like this. It starts out great and then gets ruined. edit It looks like I've hit the HN rate limiter, so I'm merging my reply: Unfortunately I can't go into detail about these scenarios because I don't want to get into trouble with my employer. Suffice it to say that I no longer place trust in Apple keeping anything of value "open".
- taliesinb 10y ago> I am still pretty upset and maybe even somewhat traumatized about all the previous times they've fucked me over in scenarios like this. It starts out great and then gets ruined. I haven't done much development using Apple frameworks. I'm curious, where has this happened to you before?
- emcq 10y agoThis feels like a hardware play to me. Start off getting developers to use your inference library, determine the common cases and killer apps, then build an ASIC that does it all using far less power. Perhaps the front facing camera might get a bit more interesting in the future for more than just selfies.
- imh 10y agoI really hope that BNNS is pronounced "bananas." But more substantially, I'm not totally convinced neural nets have quite as well defined required subroutines yet. Because of backprop, it's not just about what the blocks are, but also about how you combine them. Adding recursion changes the problem. Or a paper like the one on stochastic computation graphs comes along and does the same. I like the idea, but I expect it's still too early to expect something analogous to BLAS to stick.
- spiderfarmer 10y agoDoes Android support this as well? I think it's a great decision for Apple to make sure developers use this functionality. Apple is still very much a hardware company. By pushing the hardware to it's limits, Apple makes sure you'll want to upgrade to the latest and greatest. Also, by doing the heavy lifting locally instead of in the cloud, Apple saves money on servers and infrastructure. And to top it off, they can make some privacy claims.
- deleted 10y ago[deleted]