Capturing social cues with imaging glasses

Citation

Murray L, Hands P, Goutcher R & Ye J (2016) Capturing social cues with imaging glasses. In: UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. UbiComp2016: 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 12.09.2016-16.09.2016. New York: ACM, pp. 968-972. https://doi.org/10.1145/2968219.2968260

Abstract
Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

Keywords
Affective Computing; Imaging glasses; Emotion Recognition