3 ms·

The second half of your comment is a go-to-market concern but doesn't feel so relevant for a research prototype. It could be done with a private local model too

The second half of your comment is a go-to-market concern but doesn't feel so relevant for a research prototype. It could be done with a private local model too, maybe not by Google. But I don't think the voice problem is surmountable. I closed their image editing demo when I saw it required a mic. It would be appealing as a Spotlight-like text pop-up interface where you type instructions, which would work in social/office environments, but that might only appeal to power users.

aquariusDue 5mo ago
This will sound like another brick in the paved road to dystopia but I'm kinda bullish on equipment that can recognize subvocalization. Or at least let me have a small drawing tablet with a stylus (think etch-a-sketch or Wacom Intuos) because at this point I'd rather practice writing and do away with typing altogether (even though I enjoy typing for typing's sake via MonkeyType).
- NDlurker 5mo ago
  I've been dreaming about that for 20 years. And then use it for people to communicate while sleeping.
why_at 5mo ago
Yeah I think there could be something to the integration of AI in an operating system so that it can handle things going on in different applications the same way you can already copy and paste between things. But if it's going to require phoning home to some Google/OpenAI/whoever then forget it. I don't want a constant connection to my OS from one of these companies.
anon84873628 5mo ago
It seems that if we ultimately want to "move at the speed of thought," it will require speech.
- Swizec 5mo ago
  > It seems that if we ultimately want to "move at the speed of thought," it will require speech. Except for the large majority of people who read, type, and click way faster than they can talk. Especially for visual things it’s way faster to drag a rectangle than to describe what you want. A lot of us also aren’t linear verbal thinkers. It would take minutes to hours to verbalize concepts we can grasp visually/schematically in seconds. Great book on the topic: https://www.goodreads.com/book/show/60149558-visual-thinking https://www.goodreads.com/book/show/60149558-visual-thinking
  - svachalek 5mo ago
    Most people speak at about 150 wpm, but very few can type that fast. But reading and gesturing are fast, which is what TFA is about, combining reading and gesturing with speech.
    - Swizec 5mo ago
      You rarely need 150wpm when typing. If you try dictation, you’ll notice that half those words are error correction and checksum bits and just turn taking filler. I usually convey the same meaning with 80wpm typing. Makes it faster to read too Maybe I’m just slightly adhd – listening to people talk drives my crazy. Get to the point! Much easier if they type it out
      - dkersten 5mo ago
        > listening to people talk drives my crazy. People have so many verbal tics and filler words too. Anthropic’s Dario says “you know” after every third word, for example. Or they meander around unrelated/unimportant details.
  - anon84873628 5mo ago
    Isn't "drag the rectangle" and visual interaction exactly the point of the research in the article? Speech is the perfect side channel to this interaction, not a context switch to text. Also, I doubt DeepMind is designing for existing programmers and savvy computer users. They are thinking about the other billions of people in the world. Speech is the skill people will already have, not typing.

aquariusDue 5mo ago

This will sound like another brick in the paved road to dystopia but I'm kinda bullish on equipment that can recognize subvocalization. Or at least let me have a small drawing tablet with a stylus (think etch-a-sketch or Wacom Intuos) because at this point I'd rather practice writing and do away with typing altogether (even though I enjoy typing for typing's sake via MonkeyType).

NDlurker 5mo ago
I've been dreaming about that for 20 years. And then use it for people to communicate while sleeping.

why_at 5mo ago

Yeah I think there could be something to the integration of AI in an operating system so that it can handle things going on in different applications the same way you can already copy and paste between things. But if it's going to require phoning home to some Google/OpenAI/whoever then forget it. I don't want a constant connection to my OS from one of these companies.

anon84873628 5mo ago

It seems that if we ultimately want to "move at the speed of thought," it will require speech.

Swizec 5mo ago
> It seems that if we ultimately want to "move at the speed of thought," it will require speech. Except for the large majority of people who read, type, and click way faster than they can talk. Especially for visual things it’s way faster to drag a rectangle than to describe what you want. A lot of us also aren’t linear verbal thinkers. It would take minutes to hours to verbalize concepts we can grasp visually/schematically in seconds. Great book on the topic: https://www.goodreads.com/book/show/60149558-visual-thinking https://www.goodreads.com/book/show/60149558-visual-thinking
- svachalek 5mo ago
  Most people speak at about 150 wpm, but very few can type that fast. But reading and gesturing are fast, which is what TFA is about, combining reading and gesturing with speech.
  - Swizec 5mo ago
    You rarely need 150wpm when typing. If you try dictation, you’ll notice that half those words are error correction and checksum bits and just turn taking filler. I usually convey the same meaning with 80wpm typing. Makes it faster to read too Maybe I’m just slightly adhd – listening to people talk drives my crazy. Get to the point! Much easier if they type it out
    - dkersten 5mo ago
      > listening to people talk drives my crazy. People have so many verbal tics and filler words too. Anthropic’s Dario says “you know” after every third word, for example. Or they meander around unrelated/unimportant details.
- anon84873628 5mo ago
  Isn't "drag the rectangle" and visual interaction exactly the point of the research in the article? Speech is the perfect side channel to this interaction, not a context switch to text. Also, I doubt DeepMind is designing for existing programmers and savvy computer users. They are thinking about the other billions of people in the world. Speech is the skill people will already have, not typing.