Passer à la navigation principale Passer à la recherche Passer au contenu principal

Improving video captioning for deaf and hearing-impaired people based on eye movement and attention overload

  • Computer Research Institute of Montreal

Résultats de recherche: Chapitre dans un livre, rapport, actes de conférence › Participation à un ouvrage collectif lié à un colloque ou une conférence › Revue par des pairs

10 Citations (Scopus)

Résumé

Deaf and hearing-impaired people capture information in video through visual content and captions. Those activities require different visual attention strategies and up to now, little is known on how caption readers balance these two visual attention demands. Understanding these strategies could suggest more efficient ways of producing captions. Eye tracking and attention overload detections are used to study these strategies. Eye tracking is monitored using a pupilcenter-corneal-reflection apparatus. Afterward, gaze fixation is analyzed for each region of interest such as caption area, high motion areas and faces location. This data is also used to identify the scanpaths. The collected data is used to establish specifications for caption adaptation approach based on the location of visual action and presence of character faces This approach is implemented in a computer-assisted captioning software which uses a face detector and a motion detection algorithm based on the Lukas-Kanade optical flow algorithm. The different scanpaths obtained among the subjects provide us with alternatives for conflicting caption positioning. This implementation is now undergomg a user evaluation with hearing impaired participants to validate the efficiency of our approach.

Langue originaleAnglais
titreProceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XII
EditeurSPIE
ISBN (imprimé)0819466050, 9780819466051
Les DOIs
ÉtatPublié - 2007
Modification externeOui
Evénement12th Human Vision and Electronic Imaging, HEVI 2007 - San Jose, CA, Etats-Unis
Durée: 29 janv. 2007 → 1 févr. 2007

Série de publications

NomProceedings of SPIE - The International Society for Optical Engineering
Volume6492
ISSN (imprimé)0277-786X

Conférence

Conférence12th Human Vision and Electronic Imaging, HEVI 2007
Pays/TerritoireEtats-Unis
La villeSan Jose, CA
Période29/01/07 → 1/02/07

Classification disciplinaire ASJC Scopus

  • Matériaux électroniques, optiques et magnétiques
  • Instrumentation
  • Physique de la matière condensée
  • Applications de l'informatique
  • Mathématiques appliquées
  • Ingénierie électrique et électronique

Empreinte digitale

Voici les principaux termes ou expressions associés à « Improving video captioning for deaf and hearing-impaired people based on eye movement and attention overload ». Ces libellés thématiques sont générés à partir du titre et du résumé de la publication. Ensemble, ils forment une empreinte digitale unique.

Citer cette ressource