4.7 Article

Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing

Journal

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
Volume 3, Issue 1, Pages 69-87

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/T-AFFC.2011.27

Keywords

Social signal processing; nonverbal behavior analysis and synthesis; social interactions understanding

Funding

  1. European Community [231287]

Ask authors/readers for more resources

Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

What You Say or How You Say It? Depression Detection Through Joint Modeling of Linguistic and Acoustic Aspects of Speech

Nujud Aloshban, Anna Esposito, Alessandro Vinciarelli

Summary: The joint analysis of linguistic and acoustic aspects of speech can accurately discriminate between depressed and nondepressed speakers, with an accuracy above 80%. Multimodal approaches outperform unimodal ones due to people's tendency to manifest their condition through one modality only, leading to diversity across unimodal approaches.

COGNITIVE COMPUTATION (2022)

Article Computer Science, Artificial Intelligence

Synthetic vs Human Emotional Faces: What Changes in Humans' Decoding Accuracy

Terry Amorese, Marialucia Cuciniello, Alessandro Vinciarelli, Gennaro Cordasco, Anna Esposito

Summary: The study found that participants of different ages and genders have different performances in interpreting and recognizing emotional expressions conveyed by virtual agents. Young people and women perform better in recognizing certain emotions, while there are also differences between different age groups and genders.

IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS (2022)

Article Computer Science, Information Systems

Assessing student engagement from facial behavior in on-line learning

Paolo Buono, Berardina De Carolis, Francesca D'Errico, Nicola Macchiarulo, Giuseppe Palestra

Summary: This study aims to assess student engagement level through facial behavior and predict it using Long Short-Term Memory (LSTM) networks. The results show a weak correlation between engagement prediction from facial behavior and students' subjective answers, but a stronger correlation when considering the emotional dimension of engagement.

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Article Green & Sustainable Science & Technology

The 'Glocal' Community of Matera 2019: Participative Processes and Re-Signification of Cultural Heritage

Rosa Scardigno, Giuseppe Mininni, Paolo Giovanni Cicirelli, Francesca D'Errico

Summary: This study explores the re-signification of the Matera community in a rapidly changing environment, analyzing the psychosocial value of the Cultural Heritage of the Mega Event M19 through the variables of culture, participation, and sense of community and identity. Critical discourse analysis is used to analyze the positioning of both front and backstage, revealing the impact of Matera's uniqueness and unresolved fragilities on the opportunities and needs of M19.

SUSTAINABILITY (2022)

Editorial Material Engineering, Electrical & Electronic

The SONICOM Project: Artificial Intelligence-Driven Immersive Audio, From Personalization to Modeling

Lorenzo Picinali, Brian F. G. Katz, Michele Geronazzo, Piotr Majdak, Arcadio Reyes-Lecuona, Alessandro Vinciarelli

IEEE SIGNAL PROCESSING MAGAZINE (2022)

Article Computer Science, Information Systems

Detecting racial stereotypes: An Italian social media corpus where psychology meets NLP

Cristina Bosco, Viviana Patti, Simona Frenda, Alessandra Teresa Cignarella, Marinella Paciello, Francesca D'Errico

Summary: This paper studies the formation and application of stereotypes from the perspectives of psychology and computational linguistics. By building an Italian social media corpus and conducting lexical analysis and experiments, the aim is to provide theoretical basis for the development of tools that automatically detect and label Italian stereotypes.

INFORMATION PROCESSING & MANAGEMENT (2023)

Article Computer Science, Artificial Intelligence

Scare-Away Risks: The Effects of a Serious Game on Adolescents' Awareness of Health and Security Risks in an Italian Sample

Francesca D'Errico, Paolo Giovanni Cicirelli, Concetta Papapicco, Rosa Scardigno

Summary: This study aims to improve adolescents' perception of risks and promote protective behaviors through a digital game named 'Scare-away risks'. Results show that playing this game is related to higher levels of engagement, internal locus of control, risk perception, and protective behavioral intentions.

MULTIMODAL TECHNOLOGIES AND INTERACTION (2022)

Article Psychology, Educational

Addressing racial misinformation at school: a psycho-social intervention aimed at reducing ethnic moral disengagement in adolescents

Francesca D'Errico, Paolo Giovanni Cicirelli, Giuseppe Corbelli, Marinella Paciello

Summary: The present study investigates the effectiveness of promoting socio-analytic thinking to intervene in the reliance on ethnic moral disengagement caused by racial misleading news, which contributes to the spread of ethnic prejudice. The study focuses on racial hoaxes, which are misleading news stories involving health or safety threats and ethnic or national identities. The intervention procedure incorporates literature on media biases' reflection and recent studies on 'mediated intergroup contact'. The results show that social-analytic processing reduces ethnic biases of moral disengagement, suggesting that improving social-analytic processes can effectively counter distorted beliefs associated with discrimination and racial prejudice.

SOCIAL PSYCHOLOGY OF EDUCATION (2023)

Article Psychology, Multidisciplinary

Decolonising Reactions to Material Traces of the European Past: The Case of an Italian Colonial Food

Alessia Mastropietro, Stefano Migliorisi, Isora Sessa, Francesco Borgogno, Francesca D'Errico, Laurent Licata, Giovanna Leone

Summary: European capital cities are filled with material traces of colonialism, including both institutional reminders and ephemeral objects that glorify colonial domination. The reactions of descendants of former colonizers to these traces suggest that colonial tropes still shape their contemporary understanding of the past. A comprehensive decolonization effort should not only include previously marginalized minorities, but also raise awareness among the majorities about the harmful implications of unquestioned colonial legacies. Furthermore, awareness of the impact of material traces could contribute to redesigning European physical spaces to be more inclusive for descendants of formerly colonized groups.

PSYCHOLOGY AND DEVELOPING SOCIETIES (2023)

Article Social Sciences, Interdisciplinary

Preventing Prejudice Emerging from Misleading News among Adolescents: The Role of Implicit Activation and Regulatory Self-Efficacy in Dealing with Online Misinformation

Giuseppe Corbelli, Paolo Giovanni Cicirelli, Francesca D'Errico, Marinella Paciello

Summary: This study examines the possibility of preventing prejudice among adolescents by promoting the analytical processing of social media content. The results suggest a negative relationship between affective prejudice and socio-analytical processing, and find that this analytical performance is influenced by implicit activation and inhibitory factors.

SOCIAL SCIENCES-BASEL (2023)

Article Social Sciences, Interdisciplinary

Faking and Conspiring about COVID-19: A Discursive Approach

Rosa Scardigno, Alessia Paparella, Francesca D'Errico

Summary: In the era of post-truth, the COVID-19 pandemic has triggered an alarming infodemic characterized by the widespread use of misinformation and emotional rhetoric, resulting in a decline in trust in science, institutions, and traditional media. This study conducted a qualitative investigation of 112 fake and conspiracy news articles in Italy, analyzing their psycholinguistic and argumentative features and differentiating them based on Aristotle's rhetoric stances. The findings revealed that although fake and conspiracy news share common roots in the post-truth climate, they engage in different rhetoric patterns and construct specific epistemic pathways. The implications for health and digital literacy are discussed.

QUALITATIVE REPORT (2023)

Article Engineering, Multidisciplinary

'Emotion that Goes Around Comes Around'. Political Charisma and the Emotions Conveyed through Social Media

Francesca D'Errico, Isabella Poggi

Summary: The study showed that the charisma and emotional expression conveyed by political leaders on social media are influenced by their political and power positions. Expressing negative emotions leads to more negative emotions and evaluations, while emotionally regulated charismatic politicians can enhance users' perception of their competence and increase their voting intentions.

ACTA POLYTECHNICA HUNGARICA (2022)

Article Psychology, Multidisciplinary

President Obama's Humble Face: An Authentic or a Socially Desirable Posturing? A Study on Reactions to Obama's Autobiographical Self-Disclosures

Alessia Mastropietro, Peter Bull, Francesca D'Errico, Isora Sessa, Stefano Migliorisi, Giovanna Leone

Summary: This research examines the impact of coherence between facial expressions and words in Obama's autobiographical sharing on receivers' perception. The findings suggest that a facial expression of contempt, consistent with descriptions of his difficulties, is crucial for perceiving his humble political discourse as authentic rather than a simple socially desirable posturing.

FRONTIERS IN PSYCHOLOGY (2022)

Article Psychology, Multidisciplinary

How Personal Values Count in Misleading News Sharing with Moral Content

Francesca D'Errico, Giuseppe Corbelli, Concetta Papapicco, Marinella Paciello

Summary: This study examines the personal factors that influence the online sharing of moral misleading news, including personal values, communication bias, credibility evaluations, and moral emotions. The results show that self-transcendence values impede the sharing of misleading news, while conservation values promote it. Additionally, news written with a less blatantly biased linguistic frame is consistently rated as more credible, and more credible and emotionally activating news is more likely to be shared online.

BEHAVIORAL SCIENCES (2022)

Article Social Sciences, Interdisciplinary

HUMILITY EXPRESSION AND ITS EFFECTS ON MORAL SUASION: AN EMPIRICAL STUDY OF OCASIO-CORTEZ'S COMMUNICATION

Francesca D'Errico, Peter Bull, Ernestina Lamponi, Giovanna Leone

Summary: Humble leadership is a positive trait that allows leaders to admit limitations, be open to new ideas, and give a voice to others. This study examines the persuasive effects of a female politician displaying humility, with a focus on the role of emotional displays when discussing a moral issue. The results show that the politician elicits positive emotions and evaluations, especially when displaying sadness, contributing to the acceptance of her persuasive message.

HUMAN AFFAIRS-POSTDISCIPLINARY HUMANITIES & SOCIAL SCIENCES QUARTERLY (2022)

No Data Available