4 ms·

Phoneme- and Word-Based Learning of English Words Presented to the Skin

36 points by godelmachine 8y ago

mankyd 8y ago
Is this study referring to something other than braille, or is braille inclusive under "English Words Presented to the Skin".
- sova 8y ago
  "Previous studies have explored the role of training in the use of haptic devices. For example, a study concerned with the acquisition of Braille by sighted learners has demonstrated that a corresponding visual display was beneficial for the acquisition of haptic Braille [13]. This result suggests the use of a visual display in the current study, corresponding to the activation of vibrators on the tactual display. In addition, the efficacy of correct-answer feedback for perceptual learning tasks is well-established [14], indicating that correct-answer feedback should be employed in the learning procedure. With the phonemic-based tactual display designed for conveying English words, we consider two training approaches to training: phoneme-based and word-based [15]. The phoneme-based approach, which operates on a “bottom-up” theory of learning, concentrates on maximizing the individual’s ability to discriminate between and identify the individual sound patterns of speech [15]. The word-based approach is based on a “topdown” theory of learning. It bypasses the training of basic phoneme patterns and starts with words directly [15]. Previous studies of speech training have employed single or combined approaches [16-18]; however, these studies have not led to definitive conclusions for choosing one approach over another."
- twic 8y ago
  AIUI, the ultimate goal of this work is to present spoken, rather than written, words to the skin. The idea is that you can process spoken language into phonemes, and then present those to the skin, although in this study, the phonemes were generated directly. I assume that the belief is that it's more easier to reliably encode speech to phonemes in real time than it is to encode it to text.
myth_drannon 8y ago
I was reading about a research lab somewhere in Madison that would attach electrodes to the tongue and send electric impulses based on real time cemara feed. The blind's person brain would then adapt and start seeing with the tongue. The general idea was that the eyes are just the gates that transform light into electric impulses so why not use tongue to send the electric impulses. They did achieve pretty amazing results.
- marcoperaza 8y ago
  As in they would actually have the subjective experience of sight? Or would they just become aware of the three dimensional layout of the objects?
  - Retric 8y ago
    Seems like you could answer that question by wearing a blindfold and using the device for a few months. But, I doubt you are going to find a volunteer. That said, if you use a tool for long enough it seems to gain a sense of touch. Your brain is just interpreting what you feel in your hands, but from the brain's perspective it's just signals either way and the shortcut is useful.
    - marcoperaza 8y ago
      Many blind people have previously had normal vision. So if such a study featured them, they would be able to answer that question.
      - Retric 8y ago
        That's only half the story, what happens when a sighted person takes off their blindfold after leaning how to use the device? I picture some come of synesthesia, but it's hard to say. The most interesting thing would be if their eyes stopped being integrated for a while. https://m.youtube.com/watch?v=MFzDaBzBlL0 https://m.youtube.com/watch?v=MFzDaBzBlL0
- 8y ago
_emacsomancer_ 8y ago
This looks very interesting. I was amused on my first skim-through to see: "One-hundred common English words were selectedfor the present study (see Table 1; the 8 groups are explained later in Sec. Error! Reference source not found.)"

36 points by godelmachine 8y ago

Is this study referring to something other than braille, or is braille inclusive under "English Words Presented to the Skin".

sova 8y ago
"Previous studies have explored the role of training in the use of haptic devices. For example, a study concerned with the acquisition of Braille by sighted learners has demonstrated that a corresponding visual display was beneficial for the acquisition of haptic Braille [13]. This result suggests the use of a visual display in the current study, corresponding to the activation of vibrators on the tactual display. In addition, the efficacy of correct-answer feedback for perceptual learning tasks is well-established [14], indicating that correct-answer feedback should be employed in the learning procedure. With the phonemic-based tactual display designed for conveying English words, we consider two training approaches to training: phoneme-based and word-based [15]. The phoneme-based approach, which operates on a “bottom-up” theory of learning, concentrates on maximizing the individual’s ability to discriminate between and identify the individual sound patterns of speech [15]. The word-based approach is based on a “topdown” theory of learning. It bypasses the training of basic phoneme patterns and starts with words directly [15]. Previous studies of speech training have employed single or combined approaches [16-18]; however, these studies have not led to definitive conclusions for choosing one approach over another."
twic 8y ago
AIUI, the ultimate goal of this work is to present spoken, rather than written, words to the skin. The idea is that you can process spoken language into phonemes, and then present those to the skin, although in this study, the phonemes were generated directly. I assume that the belief is that it's more easier to reliably encode speech to phonemes in real time than it is to encode it to text.

myth_drannon 8y ago

I was reading about a research lab somewhere in Madison that would attach electrodes to the tongue and send electric impulses based on real time cemara feed. The blind's person brain would then adapt and start seeing with the tongue. The general idea was that the eyes are just the gates that transform light into electric impulses so why not use tongue to send the electric impulses. They did achieve pretty amazing results.

marcoperaza 8y ago
As in they would actually have the subjective experience of sight? Or would they just become aware of the three dimensional layout of the objects?
- Retric 8y ago
  Seems like you could answer that question by wearing a blindfold and using the device for a few months. But, I doubt you are going to find a volunteer. That said, if you use a tool for long enough it seems to gain a sense of touch. Your brain is just interpreting what you feel in your hands, but from the brain's perspective it's just signals either way and the shortcut is useful.
  - marcoperaza 8y ago
    Many blind people have previously had normal vision. So if such a study featured them, they would be able to answer that question.
    - Retric 8y ago
      That's only half the story, what happens when a sighted person takes off their blindfold after leaning how to use the device? I picture some come of synesthesia, but it's hard to say. The most interesting thing would be if their eyes stopped being integrated for a while. https://m.youtube.com/watch?v=MFzDaBzBlL0 https://m.youtube.com/watch?v=MFzDaBzBlL0
8y ago

_emacsomancer_ 8y ago

This looks very interesting. I was amused on my first skim-through to see: "One-hundred common English words were selectedfor the present study (see Table 1; the 8 groups are explained later in Sec. Error! Reference source not found.)"