3 ms·

CreateML is getting really impressive. I just went through the process of using it to train an Object Detection model to detect sharks and fish at an aquarium (

CreateML is getting really impressive. I just went through the process of using it to train an Object Detection model to detect sharks and fish at an aquarium (and deploying the model to an iPhone) last week. Final result: https://twitter.com/braddwyer/status/1330654868839784451 https://twitter.com/braddwyer/status/1330654868839784451 The full walkthrough video: https://www.youtube.com/watch?v=kBn7Cd8Z8yE https://www.youtube.com/watch?v=kBn7Cd8Z8yE

wil421 6y ago
Do you think it would be possible to detect the species of shark? I was thinking about trying to detect what breed of dog or maybe species of fish someone caught.
- dagmx 6y ago
  It's possible but you'd need more training data IMHO the more similar things get.
- nkristoffersen 6y ago
  Could probably detect if it was a hotdog or not hotdog.
  - tosh 6y ago
    this might be a vc-case!
  - ceejayoz 6y ago
    Train it, then test it on https://www.reddit.com/r/hotdogsorlegs/ https://www.reddit.com/r/hotdogsorlegs/.
- yeldarb 6y ago
  With the right training data, definitely. Check out the Oxford Pets dataset as a starting point (you can download in Create ML format from here): https://public.roboflow.com/object-detection/oxford-pets https://public.roboflow.com/object-detection/oxford-pets
criddell 6y ago
That's really neat. Once your model is complete, does it work offline?
- yeldarb 6y ago
  Yep, in this example the weights are compiled into the app and inference is done locally on the iPhone processor.
  - criddell 6y ago
    Is the app available anywhere? I'd love to see if it works on my aquarium.
    - yeldarb 6y ago
      I didn't clean it up and submit for app review but if you have XCode you can compile and run it by tweaking the sample app (start at 22:25 in the YouTube video above). Here are the weights: https://www.dropbox.com/s/c49a5zqqt1ml89o/Aquarium%202.mlmodel?dl=0 https://www.dropbox.com/s/c49a5zqqt1ml89o/Aquarium%202.mlmod...
crb002 6y ago
What apps do you use for drawing the labeling/bounding boxes?
- yeldarb 6y ago
  There are a handful of free tools you can use. We have write-ups of most of them in the "Labeling Your Images Yourself" section here: https://blog.roboflow.com/object-detection/ https://blog.roboflow.com/object-detection/ Roboflow (our startup) can import the annotation files from all of those tools and convert them to Create ML's format for you.

wil421 6y ago

Do you think it would be possible to detect the species of shark? I was thinking about trying to detect what breed of dog or maybe species of fish someone caught.

dagmx 6y ago
It's possible but you'd need more training data IMHO the more similar things get.
nkristoffersen 6y ago
Could probably detect if it was a hotdog or not hotdog.
- tosh 6y ago
  this might be a vc-case!
- ceejayoz 6y ago
  Train it, then test it on https://www.reddit.com/r/hotdogsorlegs/ https://www.reddit.com/r/hotdogsorlegs/.
yeldarb 6y ago
With the right training data, definitely. Check out the Oxford Pets dataset as a starting point (you can download in Create ML format from here): https://public.roboflow.com/object-detection/oxford-pets https://public.roboflow.com/object-detection/oxford-pets

criddell 6y ago

That's really neat. Once your model is complete, does it work offline?

yeldarb 6y ago
Yep, in this example the weights are compiled into the app and inference is done locally on the iPhone processor.
- criddell 6y ago
  Is the app available anywhere? I'd love to see if it works on my aquarium.
  - yeldarb 6y ago
    I didn't clean it up and submit for app review but if you have XCode you can compile and run it by tweaking the sample app (start at 22:25 in the YouTube video above). Here are the weights: https://www.dropbox.com/s/c49a5zqqt1ml89o/Aquarium%202.mlmodel?dl=0 https://www.dropbox.com/s/c49a5zqqt1ml89o/Aquarium%202.mlmod...

crb002 6y ago

What apps do you use for drawing the labeling/bounding boxes?

yeldarb 6y ago
There are a handful of free tools you can use. We have write-ups of most of them in the "Labeling Your Images Yourself" section here: https://blog.roboflow.com/object-detection/ https://blog.roboflow.com/object-detection/ Roboflow (our startup) can import the annotation files from all of those tools and convert them to Create ML's format for you.