60 likes | 184 Views
This proposal explores advanced methods for parsing spontaneous utterances in meetings, focusing on the transcription of incomplete, disfluent, and agrammatical speech. It highlights techniques for low-compression summarization to create effective meeting minutes while maintaining context. The research emphasizes the use of automatic question-answering systems and disambiguation processes in a multi-speaker dialogue environment. Lexical and syntactic transformations are also discussed, aiming to improve the accuracy and utility of human transcription efforts in academic and professional settings.
E N D
Electric Secretary • Proposal: Parsing spontaneous utterances for • Corrected/Completed Speech ("transcript") • Low-compression summarization ("minutes") • Question answering • Meeting context • Spontaneous speech: • Incomplete, Agrammatical, Disfluent, Poor function words • Dialog: • Multiple speakers, deictic reference
Meeting Minutes • Compressed • Reorderedf. MOO Help-Sheet • The MOO Help-Sheet is currently under revision, and will be mailed as soon as possible.http://www.techfak.uni-bielefeld.de/bcd/Faculty/Meetgs96/vsns-bcd-faculty-15Mar96-minutes.html
Human Transcription • Gesture • DisambiguationGeorgF says, "I'll email the MOO Help sheet to all Instructors"PaulSt says, "OK! Thanks."RebeccaP says, "Do we again have consulting students to help with working with the MOO if we want to do something fancy with it?"GeorgF nods.Robertgi says, "Georg has posted about 100 jobs for consultants."http://www.techfak.uni-bielefeld.de/bcd/Faculty/Meetgs96/vsns-bcd-faculty-15Mar96
Speech Recognition • ViaVoice advertises 95% • Meetings not dictated! • Tiny experiment:Georg has posted about 100 jobs for consultantsTortoise was said about hundred jobs for consultants I never did anything fancy, but it has occurred to me that I didn't I never did anything fancy but as occurred to me that Recorded by Andy Chang in conversational voice, with high quality microphone, using extensively trained ViaVoice recognizer in dictation mode. Thanks, Andy!
Prior Work • Berkeley/MIT: Meeting Recording, Correction Krste Asanovic, Adam Janin, ...http://www.icsi.berkeley.edu/~janin/mrpda/ • Edinburgh: Parsing and Tagging David McKelvie, Henry Swift Thompsonhttp://www.ltg.ed.ac.uk/~dmck/PPP/ • Brown: Edit Detection and Parsing Eugene Charniak, Mark Johnsonhttp://www.cs.brown.edu/people/ec/
Value Added! • Transcription • Removing edits: finding similar parses • Hallucinating function words: missing parse location • Combination with visual input (pointing)? • Summary • Focus tracking, reference resolution • Question Answering • Syntactic transformations • Domain-specific knowledge