Audiovisual Representations of Valence: a Cross-study Perspective
- PDF / 754,109 Bytes
- 10 Pages / 595.276 x 790.866 pts Page_size
- 8 Downloads / 158 Views
RESEARCH ARTICLE
Audiovisual Representations of Valence: a Cross-study Perspective Svetlana V. Shinkareva 1
&
Chuanji Gao 1 & Douglas Wedell 1
Received: 15 June 2020 / Accepted: 22 October 2020 / Published online: 25 November 2020 # The Society for Affective Science 2020
Abstract Hedonic valence describes the pleasantness or unpleasantness of psychological states elicited by stimuli and is conceived as a fundamental building block of emotional experience. Multivariate pattern analysis approaches contribute to the study of valence representation by allowing identification of valence from distributed patterns of activity. However, the issue of construct validity arises in that there is always a possibility that classification results from a single study are driven by factors other than valence, such as the idiosyncrasies of the stimuli. In this work, we identify valence across participants from six different fMRI studies that used auditory, visual, or audiovisual stimuli, thus increasing the likelihood that classification is driven by valence and not by the specifics of the experimental paradigm of a particular study. The studies included a total of 93 participants and differed on stimuli, task, trial duration, number of participants, and scanner parameters. In a leave-one-study-out cross-validation procedure, we trained the classifiers on fMRI data from five studies and predicted valence, positive or negative, for each of the participants in the left-out study. Whole-brain classification demonstrated a reliable distinction between positive and negative valence states (72% accuracy). In a searchlight analysis, the representation of valence was localized to the right postcentral and supramarginal gyri, left superior frontal and middle frontal cortices, and right pregenual anterior cingulate and superior medial frontal cortices. The demonstrated cross-study classification of valence enhances the construct validity and generalizability of the findings from the combined studies. Keywords Valence . MVPA . fMRI
Introduction An intrinsic part of daily perception is the coding of hedonic valence or the pleasantness or unpleasantness of the events or stimuli being perceived. Together with arousal, valence forms the core affective experience that underlies psychological states and is conceived as a fundamental building block of emotional experience (Barrett & Bliss-Moreau, 2009; Russell, 2003). Positive valence may lead to approach states whereas negative valence may lead to avoidance states, with the arousal value signaling the level of activation of those states. Core affective information of the stimuli are processed quickly and automatically (Olofsson et al., 2008), and valenced reactions to stimuli and outcomes form the basis Handling Editor: Kristen Lindquist * Svetlana V. Shinkareva [email protected] 1
Department of Psychology, Institute for Mind and Brain, University of South Carolina, Columbia, SC 29201, USA
for learning in paradigms such as evaluative conditioning and reinforcement learning (Hayes & Wedell, 202
Data Loading...
