An improved automatic lipreading system to enhance speech recognition

Eric Petajan, Bradford Bischoff, David Bodoff, N. Michael Brooke

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Current acoustic speech recognition technology performs well with very small vocabularies in noise or with large vocabularies in very low noise. Accurate acoustic speech recognition in noise with vocabularies over 100 words has yet to be achieved. Humans frequently lipread the visible facial speech articulations to enhance speech recognition, especially when the acoustic signal is degraded by noise or hearing impairment. Automatic lipreading has been found to improve significantly acoustic speech recognition and could be advantageous in noisy environments such as offices, aircraft and factories. An improved version of a previously described automatic lipreading system has been developed which uses vector quantization. dynamic time warping, and a new heuristic distance measure. This paper presents visual speech recognition results from multiple speakers under optimal conditions. Results from combined acoustic and visual speech recognition are also presented which show significantly improved performance compared to the acoustic recognition system alone.

Original languageEnglish
Title of host publicationProceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1988
EditorsJ.J. O'Hare
PublisherAssociation for Computing Machinery
Pages19-25
Number of pages7
ISBN (Electronic)0201142376
DOIs
StatePublished - 1 May 1988
Externally publishedYes
Event1988 SIGCHI Conference on Human Factors in Computing Systems, CHI 1988 - Washington, United States
Duration: 15 May 198819 May 1988

Publication series

NameConference on Human Factors in Computing Systems - Proceedings
VolumePart F130202

Conference

Conference1988 SIGCHI Conference on Human Factors in Computing Systems, CHI 1988
Country/TerritoryUnited States
CityWashington
Period15/05/8819/05/88

Keywords

  • Lipreading
  • Speech recognition
  • Vision

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'An improved automatic lipreading system to enhance speech recognition'. Together they form a unique fingerprint.

Cite this