We present McSig, a multimodal system for teaching blind children cursive handwriting so that they can create a personal signature. For blind people handwriting is very difficult to learn as it is a near-zero feedback activity that is needed only occasionally, yet in important situations; for example, to make an attractive and repeatable signature for legal contracts. McSig aids the teaching of signatures by translating digital ink from the teacher's stylus gestures into three non-visual forms: (1) audio pan and pitch represents the x and y movement of the stylus; (2) kinaesthetic information is provided to the student through a force-feedback haptic pen that mimics the teacher's stylus movement; and (3) a physical tactile line on the writing sheet is created by the haptic pen.
- multimodal system
- visual impairement
Plimmer, B., Reid, P., Blagojevic, R., Crossan, A., & Brewster, S. A. (2011). Signing on the tactile line: a multimodal system for teaching handwriting to blind children. ACM Transactions on Computer-Human Interaction, 18(3), 1-29. . https://doi.org/10.1145/1993060.1993067