000000113 001__ 113
000000113 005__ 20260421150638.0
000000113 0247_ $$2DOI$$a10.6083/M4CR5R8D
000000113 037__ $$aETD
000000113 245__ $$aLeveraging multimodal redundancy for dynamic learning, with SHACER, a speech and handwriting recognizer
000000113 260__ $$bOregon Health and Science University
000000113 269__ $$a2007
000000113 336__ $$aDissertation
000000113 502__ $$bPh.D.
000000113 502__ $$gComputer Science &amp; Electrical Engineering (sunsetting)
000000113 520__ $$aNew vocabulary frequently emerges during collaborative human interactions, posing challenges for fixed-vocabulary speech and handwriting recognizers. This dissertation introduces SHACER, a system that dynamically learns out-of-vocabulary terms by integrating redundantly spoken and handwritten input. Analyses of multiple interaction contexts show that most handwritten terms are also spoken, are topic-specific, and are valuable for recall and retrieval. SHACER aligns speech and handwriting using phonetic and articulatory features to refine pronunciations and orthographic forms, enabling dynamic vocabulary acquisition. In a meeting-based application, SHACER significantly reduced recognition errors for handwritten abbreviations, demonstrating the value of multimodal redundancy for adaptive language understanding.
000000113 540__ $$fCC BY
000000113 542__ $$fIn copyright - single owner
000000113 650__ $$aSpeech$$026226
000000113 650__ $$aHandwriting$$019846
000000113 650__ $$aCommunication$$016935
000000113 650__ $$aSpeech Perception$$026233
000000113 6531_ $$amultimodal redundancy
000000113 6531_ $$aspeech recognition
000000113 6531_ $$aoral communication
000000113 6531_ $$awritten communication
000000113 691__ $$aOGI School of Science and Engineering$$041365
000000113 692__ $$aDepartment of Computer Science and Electrical Engineering$$041404
000000113 7001_ $$aKaiser, Edward$$uOregon Health and Science University$$041354
000000113 7201_ $$aCohen, Philip$$uOregon Health and Science University$$041354$$7Personal$$eAdvisor
000000113 8564_ $$9048212e9-c742-474b-b09b-92914fd909a6$$s8382506$$uhttps://digitalcollections.ohsu.edu/record/113/files/113_etd.pdf$$ePublic$$215e4f945f8fbe850259bee4f16c4201f$$31
000000113 901__ $$a&lt;p&gt;These documents are archival records. They are retained for historical reference only. &lt;/p&gt;&lt;p&gt;&lt;b&gt;Need an accessible version? Use the ‘Get Accessible Copy’ link above.&lt;/b&gt;&lt;/p&gt;
000000113 905__ $$a/rest/prod/cf/95/jb/44/cf95jb44s
000000113 909CO $$ooai:digitalcollections.ohsu.edu:113$$pstudent-work
000000113 956__ $$aGet Accessible Copy$$uhttps://ohsu.libwizard.com/f/requestaccessibledocument
000000113 980__ $$aTheses and Dissertations