3 ms·
> ASL [...] programming Hand pose tracking is becoming increasingly viable, both with rapidly advancing ML of camera video[1], and perhaps with VR gloves. So
by mncharity 8y ago
> ASL [...] programming
Hand pose tracking is becoming increasingly viable, both with rapidly advancing ML of camera video[1], and perhaps with VR gloves. So as someone interested in expert UIs for programming inside VR/AR, I ask...
Any suggestions for ASL linguistics resources to mine for non-novice UI idioms/vocabularies/grammars/etc?
Your "3-space as namespace" as one example.
Gaze tracking will similarly be available. Facial expression, at least while wearing HMDs, regrettably not so much (despite prototypes). Is there signing experience with hand-held objects? - fast fine-control "fiddling with a pencil" is available with sub-millimeter few-degrees precision 6DOF, but it's unclear what vocabulary/grammar to use with it.
Big picture: VR/AR seems an opportunity to leverage accumulated insights from signing.
[1] eg, https://github.com/xinghaochen/awesome-hand-pose-estimation https://github.com/xinghaochen/awesome-hand-pose-estimation
- imglorp 8y agoStudent, not expert, but.. the definitive reference is [1]. The front matter establishes a system for taxonomy of signs: one hand or two, handshapes, location, motion, facial expression, modifiers, classifiers, etc. and then has a big dictionary. That front matter should be very helpful for translation authors. Note however, that's their dialect/accent, and other regions will have variations. Bill Vicars [2] is pretty good about cataloging many variations but it's all video material, not reference. 1. https://www.amazon.com/Gallaudet-Dictionary-American-Sign-Language/dp/1563682826 https://www.amazon.com/Gallaudet-Dictionary-American-Sign-La... 2. http://asluniversity.com http://asluniversity.com
- mncharity 8y agoThanks!