6 ms·

Hi, I'm the co-founder of https://snips.ai https://snips.ai and we are building a 100% on-device Voice AI platform which runs on the Raspberry Pi 3 It is free t

by oulipo 9y ago

Hi, I'm the co-founder of https://snips.ai https://snips.ai and we are building a 100% on-device Voice AI platform which runs on the Raspberry Pi 3 It is free to use for makers, and we will start open-sourcing the components a few weeks from now. We are using Rust because it is safe and very fast! We would love to tell more about what we are building if you have questions. The whole platform runs on-device which makes it ideal for privacy, cost, and to allow it to run when there is no network We are available in English, French, German, and soon Japanese and Korean and we are working on other European languages! We would love to see what you build with our platform to feature it on our website Take a look at what some people have built with it: https://github.com/snipsco/awesome-snips https://github.com/snipsco/awesome-snips and a few tutorials to get you started: https://medium.com/snips-ai/building-a-voice-controlled-home-sound-system-using-snips-and-sonos-2aaf16523ce9 https://medium.com/snips-ai/building-a-voice-controlled-home...

t_fatus 9y ago
nice to have projects linked, any live demo ?
- mfester 9y ago
  Here are a few: - Music player with Spotify and Sonos: https://vimeo.com/237742054 https://vimeo.com/237742054 - News and weather forecasts: https://www.youtube.com/watch?v=IFQzDSWr2l0 https://www.youtube.com/watch?v=IFQzDSWr2l0 - Controlling blinds: https://www.youtube.com/watch?v=ukkOLqcm2CY&t=9s https://www.youtube.com/watch?v=ukkOLqcm2CY&t=9s - Zork game: https://www.youtube.com/watch?v=5RX4Dm9TmCY https://www.youtube.com/watch?v=5RX4Dm9TmCY - Prayer assistant: https://www.youtube.com/watch?v=x1AGaYBLzkA&feature=youtu.be https://www.youtube.com/watch?v=x1AGaYBLzkA&feature=youtu.be
JustFinishedBSG 9y ago
Hope you still exist in Jan 2021 when I'm getting (hopefully ah) my PhD ;) so I can apply
bitL 9y ago
Do you use Deep Learning, HMM or something else for your voice recognition? If so, how did you make it fast on RPi3? Can I use your tech on RPi2 as well (for controlling a humanoid robot)?
- oulipo 9y ago
  Yes, this is a DL model! For the ASR and the wakeword recognition. We are doing some low-level optimizations For the Raspberry Pi 2 the model is a bit too large, but we will be able to handle them as hubs: your Raspberry Pi 2 in multiple rooms will detect the wakeword and stream the voice to a "hub" Raspberry Pi 3 which will do the speech recognition
  - riku_iki 9y ago
    what tools you use for building/training DL models? How do you connect them to Rust?
    - woodson 9y ago
      Judging by their employees' posts to the kaldi-help group, they most likely use the Kaldi toolkit.
EugeneOZ 9y ago
Rust's algebraic data types and patterns matching allows to write mathematically-complete decisions flows - do you use it?
nerdponx 9y ago
+1 for fully on-device. Where, generally, does a company like this get training data? Do you just hire a team to tag TV clips and YouTube videos?
- oulipo 9y ago
  We do a mix of having people generate data, gathering data from public and commercial sources
  - nerdponx 9y ago
    And another +1 for transparency. This is a product I can get behind.
jffry 9y ago
I signed up for an account and plan on trying it out later, and I just want to say: thank you for explaining what your newsletter is, and for making it opt-in, instead of opt-out.
bluGill 9y ago
Are you aware of mycroft.ai? Your goals are similar, but the implementation is different. Any possibility of collaboration.
squarefoot 9y ago
This sounds very interesting. Being capable of working unconnected is the only way to get true privacy from these devices. Having them open sourced (hopefully 100% though I can understand the reasons for keeping some parts closed) would be even better. I have always been strongly opposed to networked voice assistants because the risk of them being used as spying tools by design is simply too high, And surely no Google, Amazon, Apple etc. assistant will never enter my home, but that one is a different beast. Keep up the good work! ps. Please add other European languages soon :)
- oulipo 9y ago
  We are working on this! What language would you want?
  - squarefoot 9y ago
    I'm Italian. There are applications in the automotive field for a mostly disconnected device such as this one. If it can deal with a noisy environment like a car that would make it even more interesting.
    - oulipo 9y ago
      We are also working on car environment, and we expect to start italian this year :) Subscribe to our newsletter!
just_testing 9y ago
amazing! Do you have any timelines for portuguese? (And, quite specifically, brazilian portuguese?) Thanks!
- jodureau 9y ago
  Hi! We have quite a few languages on our plate, but it's very likely we'll work on Brazilian Portuguese before the end of the year.

by oulipo 9y ago

t_fatus 9y ago

nice to have projects linked, any live demo ?

mfester 9y ago
Here are a few: - Music player with Spotify and Sonos: https://vimeo.com/237742054 https://vimeo.com/237742054 - News and weather forecasts: https://www.youtube.com/watch?v=IFQzDSWr2l0 https://www.youtube.com/watch?v=IFQzDSWr2l0 - Controlling blinds: https://www.youtube.com/watch?v=ukkOLqcm2CY&t=9s https://www.youtube.com/watch?v=ukkOLqcm2CY&t=9s - Zork game: https://www.youtube.com/watch?v=5RX4Dm9TmCY https://www.youtube.com/watch?v=5RX4Dm9TmCY - Prayer assistant: https://www.youtube.com/watch?v=x1AGaYBLzkA&feature=youtu.be https://www.youtube.com/watch?v=x1AGaYBLzkA&feature=youtu.be

JustFinishedBSG 9y ago

Hope you still exist in Jan 2021 when I'm getting (hopefully ah) my PhD ;) so I can apply

bitL 9y ago

Do you use Deep Learning, HMM or something else for your voice recognition? If so, how did you make it fast on RPi3? Can I use your tech on RPi2 as well (for controlling a humanoid robot)?

oulipo 9y ago
Yes, this is a DL model! For the ASR and the wakeword recognition. We are doing some low-level optimizations For the Raspberry Pi 2 the model is a bit too large, but we will be able to handle them as hubs: your Raspberry Pi 2 in multiple rooms will detect the wakeword and stream the voice to a "hub" Raspberry Pi 3 which will do the speech recognition
- riku_iki 9y ago
  what tools you use for building/training DL models? How do you connect them to Rust?
  - woodson 9y ago
    Judging by their employees' posts to the kaldi-help group, they most likely use the Kaldi toolkit.

EugeneOZ 9y ago

Rust's algebraic data types and patterns matching allows to write mathematically-complete decisions flows - do you use it?

nerdponx 9y ago

+1 for fully on-device. Where, generally, does a company like this get training data? Do you just hire a team to tag TV clips and YouTube videos?

oulipo 9y ago
We do a mix of having people generate data, gathering data from public and commercial sources
- nerdponx 9y ago
  And another +1 for transparency. This is a product I can get behind.

jffry 9y ago

I signed up for an account and plan on trying it out later, and I just want to say: thank you for explaining what your newsletter is, and for making it opt-in, instead of opt-out.

bluGill 9y ago

Are you aware of mycroft.ai? Your goals are similar, but the implementation is different. Any possibility of collaboration.

squarefoot 9y ago

This sounds very interesting. Being capable of working unconnected is the only way to get true privacy from these devices. Having them open sourced (hopefully 100% though I can understand the reasons for keeping some parts closed) would be even better. I have always been strongly opposed to networked voice assistants because the risk of them being used as spying tools by design is simply too high, And surely no Google, Amazon, Apple etc. assistant will never enter my home, but that one is a different beast. Keep up the good work! ps. Please add other European languages soon :)

oulipo 9y ago
We are working on this! What language would you want?
- squarefoot 9y ago
  I'm Italian. There are applications in the automotive field for a mostly disconnected device such as this one. If it can deal with a noisy environment like a car that would make it even more interesting.
  - oulipo 9y ago
    We are also working on car environment, and we expect to start italian this year :) Subscribe to our newsletter!

just_testing 9y ago

amazing! Do you have any timelines for portuguese? (And, quite specifically, brazilian portuguese?) Thanks!

jodureau 9y ago
Hi! We have quite a few languages on our plate, but it's very likely we'll work on Brazilian Portuguese before the end of the year.