Multimodal Creativity in Speech-Gesture Production

This project is part C02 of the CRC 1646 “Linguistic Creativity in Communication”. It investigates how speakers make creative use of their verbal and gestural resources in communicatively challenging situations. We combine psycholinguistics experiments with A.I.-based, computational cognitive modeling to develop a model of speech-gesture creativity and create simulations of robust, effective multimodal speakers.

New papers out at CogSci, ACM IVA and SemDIAL

Paper season continues! short and long papers accepted at CogSci, ACM IVA, and SemDial conferences. Topics:

Inferring Partner Models for Adaptive Explanation Generation (SemDial “TrentoLog”)
Revealing the Cognitive Trajectories of Medical Diagnostic Reasoning (CogSci 2024)
Sense of Control in Dynamic Multitasking and its Impact on Voluntary Task-Switching (CogSci 2024)
Integrating Representational Gestures into Automatically Generated Embodied Explanations (IVA 2024)

Uncovering Domain Relations by Using Large Language Models as Domain Experts