5 ms·

Drone Control via Alexa

41 points by pansinghkoder 8y ago

jjwiseman 8y ago
I did something similar about six years ago: https://www.youtube.com/watch?v=uhBa11gdbeU https://www.youtube.com/watch?v=uhBa11gdbeU I used a (Python) natural language parser of my own creation (this was before intent classification was a big thing), Nuance speech recognition, and a javascript (node) interface to the AR.Drone.
- waterside81 8y ago
  Haha- the drone not landing when you told it to is basically the beginning of every sci-fi movie where the robots turn on the people. Great job.
  - pansinghkoder 8y ago
    TODO: add a kill switch :D
- spectramax 8y ago
  Seriously impressive! I particularly noted the speed of command to actuation.
kossae 8y ago
This seems oh-so-dangerous given the current state of NLP, but very cool project! :)
- pansinghkoder 8y ago
  Thanks! I saw the fear in my Director's eyes while showcasing when the drone was hovering ~3 feet away.
  - escherplex 8y ago
    Not bad! Be interesting to include this tech into a FPV drone headset which could yield serviceable complete heads-up control for area sightseeing. BTW hope you turned off the projected sniper's reticle during the demo as this does tend to elicit angst in the observers - sorry :-)
markwillis82 8y ago
I also did this a few years ago - voice controlled drone, had some keyboard based kill switches, unfortunately the drone is quite noisy so had to talk quite loudly to get a decent STT translation.
- pansinghkoder 8y ago
  This setup just requires raspberry-pi to be in the vicinity of drone. Voice command can be provided remotely.
kylek 8y ago
"Alexa, search and destroy"
b0bby_tabl3s 8y ago
"Alexa, wipe out a village @ xyz".
oulipo 8y ago
Very cool! If you want to do this in a 100% on-device and private-by-design way, you can take a look at what we are building at https://snips.ai https://snips.ai (disclaimer: I'm a co-founder) Someone actually already did a Voice controlled drone with the platform https://github.com/trancept/snips_bebop/ https://github.com/trancept/snips_bebop/ :) It runs on a Raspberry Pi 3, or any Linux, osX, iOS, Android device, and it works in English, French, German, Japanese, Spanish, Italian, and more coming soon! We'd love to show what you are building on our blog if you want to use it :)
- jmwilson 8y ago
  Second the recommendation for Snips. I recently built a Snips-based voice assistant for hands-free oscilloscope control (https://github.com/jmwilson/ollie https://github.com/jmwilson/ollie), and snips is a much better fit for this kind of domain-specific, field-deployable (offline) voice assistant. Consider the whole of infrastructure required for this application. The Pi sends a request to Alexa, which sends a request to a lambda server, which sends a request to SQS, which is polled by the Pi. Each of those AWS servers has possible subsystems and some load balancer in front of it. Single device, offline processing is so much cleaner when there's no need for general connectivity.
  - pansinghkoder 8y ago
    Thanks! My implementation is meant for remote voice control of drone.
mishkinf 8y ago
this is a crash waiting to happen
Fission 8y ago
Deja vu -- a group of friends and I tried out something similar at a hackathon a while back, and it ended up pretty decent https://devpost.com/software/recon-4dg8qz https://devpost.com/software/recon-4dg8qz
GuillaumeBrdet 8y ago
That's pretty cool, though, knowing me and Alexa I will send that drone to the first wall or tree around me lol.

41 points by pansinghkoder 8y ago

I did something similar about six years ago: https://www.youtube.com/watch?v=uhBa11gdbeU https://www.youtube.com/watch?v=uhBa11gdbeU I used a (Python) natural language parser of my own creation (this was before intent classification was a big thing), Nuance speech recognition, and a javascript (node) interface to the AR.Drone.

waterside81 8y ago
Haha- the drone not landing when you told it to is basically the beginning of every sci-fi movie where the robots turn on the people. Great job.
- pansinghkoder 8y ago
  TODO: add a kill switch :D
spectramax 8y ago
Seriously impressive! I particularly noted the speed of command to actuation.

kossae 8y ago

This seems oh-so-dangerous given the current state of NLP, but very cool project! :)

pansinghkoder 8y ago
Thanks! I saw the fear in my Director's eyes while showcasing when the drone was hovering ~3 feet away.
- escherplex 8y ago
  Not bad! Be interesting to include this tech into a FPV drone headset which could yield serviceable complete heads-up control for area sightseeing. BTW hope you turned off the projected sniper's reticle during the demo as this does tend to elicit angst in the observers - sorry :-)

markwillis82 8y ago

I also did this a few years ago - voice controlled drone, had some keyboard based kill switches, unfortunately the drone is quite noisy so had to talk quite loudly to get a decent STT translation.

pansinghkoder 8y ago
This setup just requires raspberry-pi to be in the vicinity of drone. Voice command can be provided remotely.

kylek 8y ago

"Alexa, search and destroy"

b0bby_tabl3s 8y ago

"Alexa, wipe out a village @ xyz".

oulipo 8y ago

Very cool! If you want to do this in a 100% on-device and private-by-design way, you can take a look at what we are building at https://snips.ai https://snips.ai (disclaimer: I'm a co-founder) Someone actually already did a Voice controlled drone with the platform https://github.com/trancept/snips_bebop/ https://github.com/trancept/snips_bebop/ :) It runs on a Raspberry Pi 3, or any Linux, osX, iOS, Android device, and it works in English, French, German, Japanese, Spanish, Italian, and more coming soon! We'd love to show what you are building on our blog if you want to use it :)

jmwilson 8y ago
Second the recommendation for Snips. I recently built a Snips-based voice assistant for hands-free oscilloscope control (https://github.com/jmwilson/ollie https://github.com/jmwilson/ollie), and snips is a much better fit for this kind of domain-specific, field-deployable (offline) voice assistant. Consider the whole of infrastructure required for this application. The Pi sends a request to Alexa, which sends a request to a lambda server, which sends a request to SQS, which is polled by the Pi. Each of those AWS servers has possible subsystems and some load balancer in front of it. Single device, offline processing is so much cleaner when there's no need for general connectivity.
- pansinghkoder 8y ago
  Thanks! My implementation is meant for remote voice control of drone.

mishkinf 8y ago

this is a crash waiting to happen

Fission 8y ago

Deja vu -- a group of friends and I tried out something similar at a hackathon a while back, and it ended up pretty decent https://devpost.com/software/recon-4dg8qz https://devpost.com/software/recon-4dg8qz

GuillaumeBrdet 8y ago

That's pretty cool, though, knowing me and Alexa I will send that drone to the first wall or tree around me lol.