Proceedings of the 1st International Workshop on Socially Intelligent human-like Virtual Agents (SIVA 2023) - Perception,INteraction, Robotique sociales Accéder directement au contenu
Ouvrages Année : 2023

Proceedings of the 1st International Workshop on Socially Intelligent human-like Virtual Agents (SIVA 2023)

Résumé

SIVA’23 - Socially Interactive Human-like Virtual Agents From expressive and context-aware multimodal generation of digital humans to understanding the social cognition of real humans Due to the rapid growth of virtual, augmented, and hybrid reality together with spectacular advances in artificial intelligence, the ultra-realistic generation and animation of digital humans with human-like behaviors is becoming a massive topic of interest. This complex endeavor requires modeling several elements of human behavior including the natural coordination of multimodal behaviors including text, speech, face, and body, plus the contextualization of behavior in response to interlocutors of different cultures and motivations. Thus, challenges in this topic are two folds—the generation and animation of coherent multimodal behaviors, and modeling the expressivity and contextualization of the virtual agent with respect to human behavior, plus understanding and modeling virtual agent behavior adaptation to increase human’s engagement. The aim of this workshop is to connect traditionally distinct communities (e.g., speech, vision, cognitive neurosciences, social psychology) to elaborate and discuss the future of human interaction with human-like virtual agents. We expect contributions from the fields of signal processing, speech and vision, machine learning and artificial intelligence, perceptual studies, and cognitive and neuroscience. Topics will range from multimodal generative modeling of virtual agent behaviors, and speech-to-face and posture 2D and 3D animation, to original research topics including style, expressivity, and context-aware animation of virtual agents. Moreover, the availability of controllable real-time virtual agent models can be used as state-of-the-art experimental stimuli and confederates to design novel, groundbreaking experiments to advance understanding of social cognition in humans. Finally, these virtual humans can be used to create virtual environments for medical purposes including rehabilitation and training. SIVA'23 is organized as a satellite workshop of the IEEE International Conference on Automatic Face and Gesture Recognition 2023 and the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 Topics + Analysis Analyzing and understanding of human multimodal behavior (speech, gesture, face) Creating datasets for the study and modeling of human multimodal behavior Coordination and synchronization of human multimodal behavior Analysis of style and expressivity in human multimodal behavior Cultural variability of social multimodal behavior + Modeling and generation Multimodal generation of human-like behavior (speech, gesture, face) Face and gesture generation driven by text and speech Context-aware generation of multimodal human-like behavior Modeling of style and expressivity for the generation of multimodal behavior Modeling paralinguistic cues for multimodal behavior generation Few-shots or zero-shot transfer of style and expressivity Slightly-supervised adaptation of multimodal behavior to context + Psychology and Cognition Cognition of deep fakes and ultra-realistic digital manipulation of human-like behavior Social agents/robots as tools for capturing, measuring and understanding multimodal behavior (speech, gesture, face) Neuroscience and social cognition of real humans using virtual agents and physical robots
Fichier non déposé

Dates et versions

hal-04009032 , version 1 (28-02-2023)

Identifiants

  • HAL Id : hal-04009032 , version 1

Citer

Nicolas Obin, Catherine Pelachaud, Louis-Philippe Morency, Rachael Jack, Ryo Ishii. Proceedings of the 1st International Workshop on Socially Intelligent human-like Virtual Agents (SIVA 2023). 2023. ⟨hal-04009032⟩
106 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More