Face-voice space: Integrating visual and auditory cues in judgments of person distinctiveness
- PDF / 735,198 Bytes
- 18 Pages / 595.276 x 790.866 pts Page_size
- 24 Downloads / 176 Views
Face-voice space: Integrating visual and auditory cues in judgments of person distinctiveness Joshua R. Tatz 1 & Zehra F. Peynircioğlu 1 & William Brent 2
# The Psychonomic Society, Inc. 2020
Abstract Faces and voices each convey multiple cues enabling us to tell people apart. Research on face and voice distinctiveness commonly utilizes multidimensional space to represent these complex, perceptual abilities. We extend this framework to examine how a combined face-voice space would relate to its constituent face and voice spaces. Participants rated videos of speakers for their dissimilarity in face only, voice only, and face-voice together conditions. Multiple dimensional scaling (MDS) and regression analyses showed that whereas face-voice space more closely resembled face space, indicating visual dominance, face-voice distinctiveness was best characterized by a multiplicative integration of face-only and voice-only distinctiveness, indicating that auditory and visual cues are used interactively in person-distinctiveness judgments. Further, the multiplicative integration could not be explained by the small correlation found between face-only and voice-only distinctiveness. As an exploratory analysis, we next identified auditory and visual features that correlated with the dimensions in the MDS solutions. Features pertaining to facial width, lip movement, spectral centroid, fundamental frequency, and loudness variation were identified as important features in face-voice space. We discuss the implications of our findings in terms of person perception, recognition, and face-voice matching abilities. Keywords Person distinctiveness . Faces . Voices . Multisensory integration . Multiple dimensional scaling
Introduction Most of us can distinguish, recognize, and identify other people from just their faces or voices. We rapidly and perhaps even automatically extract such characteristics as age, gender, and race from people’s faces and voices (e.g., Belin, Fecteau, Significance Statement Although face distinctiveness versus voice distinctiveness measures were only slightly correlated with one another, combined face-voice distinctiveness was best predicted by multiplying separate face and voice distinctiveness measures. This indicates that face and voice cues are combined in an interactive manner that makes people more distinct. Because we routinely encounter others through faces and voices, it is relevant to consider the implications of these findings for more general models of person recognition and perception. We suggest that person perception may in part be based on representing others based on whether our expectations for how faces and voices go together are confirmed or violated. * Joshua R. Tatz [email protected] 1
Department of Psychology, American University, Washington, DC 20016, USA
2
Department of Performing Arts, American University, Washington, DC 20016, USA
& Bédard, 2004; Wiese, Schweinberger, & Neumann, 2008). The information that faces and voices convey may be considered complementary because the
Data Loading...
