4 ms·
I took 2.5 years of ASL in University, and I've always been annoyed by this, but had a hard time describing what I mean to others. You have just summed up the p
by mabbo 8y ago
I took 2.5 years of ASL in University, and I've always been annoyed by this, but had a hard time describing what I mean to others. You have just summed up the problem perfectly in a few sentences, and I thank you for that.
That said, I think the OP is still on the right track here:
> I put it together so you can train it on your own set of word and sign/gesture combos.
A Deaf person should be able to train the system on each command they want so that it works for them automatically in the dialect they want.
> there are local bindings where you make up a sign name for someone on the fly and then use it during a conversation
My very favourite thing about ASL, having learned programming beforehand, was that I could assign people to variables/registers in space. "John point at spot to my left said to Susan spot on right bla bla bla" and then later be able to just point at my left and everyone knows I mean John. And then if John moves to the right, I've just moved him into that register and can reassign the left one to someone or something else. And with a group of experienced Signers, everyone just comprehends this perfectly.
- imglorp 8y agoAh, pointing at sign space for someone... I like to think of that like a pronoun (there's probably an official term). There's also this thing where you introduce a character, then make up a "temporary name sign" on the fly. Don't know what that's called either :)
- mercurywells 8y agoThe term is 'deixis'. Not sure about the latter.
- mncharity 8y ago> ASL [...] programming Hand pose tracking is becoming increasingly viable, both with rapidly advancing ML of camera video[1], and perhaps with VR gloves. So as someone interested in expert UIs for programming inside VR/AR, I ask... Any suggestions for ASL linguistics resources to mine for non-novice UI idioms/vocabularies/grammars/etc? Your "3-space as namespace" as one example. Gaze tracking will similarly be available. Facial expression, at least while wearing HMDs, regrettably not so much (despite prototypes). Is there signing experience with hand-held objects? - fast fine-control "fiddling with a pencil" is available with sub-millimeter few-degrees precision 6DOF, but it's unclear what vocabulary/grammar to use with it. Big picture: VR/AR seems an opportunity to leverage accumulated insights from signing. [1] eg, https://github.com/xinghaochen/awesome-hand-pose-estimation https://github.com/xinghaochen/awesome-hand-pose-estimation
- imglorp 8y agoStudent, not expert, but.. the definitive reference is [1]. The front matter establishes a system for taxonomy of signs: one hand or two, handshapes, location, motion, facial expression, modifiers, classifiers, etc. and then has a big dictionary. That front matter should be very helpful for translation authors. Note however, that's their dialect/accent, and other regions will have variations. Bill Vicars [2] is pretty good about cataloging many variations but it's all video material, not reference. 1. https://www.amazon.com/Gallaudet-Dictionary-American-Sign-Language/dp/1563682826 https://www.amazon.com/Gallaudet-Dictionary-American-Sign-La... 2. http://asluniversity.com http://asluniversity.com
- mncharity 8y agoThanks!