Implications of conversing with intelligent assistants in everyday life (IMPACT)

Autonomous systems using artificial intelligence (AI) to communicate with humans will soon be a part of everyday life. The increasing availability and deployment of such systems can have implications for humans and society at different levels. This project studies those implications with regard to users’ (1) understanding of AI algorithms, (2) communication with machines, and (3) relationship building with machines.

Adaptive autonomy of worker assistance systems

This project is part of the Forschungskolleg “Design of flexible working environments – human-centered use of Cyber-Physical Systems in industry 4.0” run by the Universities of Paderborn and Bielefeld. We investigate how to develop learning, intelligent assistance systems for industrial workers that adapt their level of assistance and autonomy to the internal state of the worker, and need to make this understood, accepted, and utilized by the user.

Lively and trustworthy social robots (VIVA)

The VIVA project aims to build a mobile social robot that produces lively and socially-appropriate behavior in interaction. We are in charge of developing an embodied communication architecture that controls and mediates the robot’s responsive behavior. In addition, we endow the robot with abilities for cohesive spoken dialogue over long-term interactions.

Mental models in collaborative interactive reinforcement learning

This project is part of the Research Cluster CINEMENTAS (“Collaborative Intelligence Based on Mental Models of Assistive Systems”) funded by a major international technology company. We investigate the role of mental models for interactive reinforcement learning, according to which learning is seen as a  dynamic collaborative process in which the trainer and learner together trying to figure out best action policy. We study how learning of a cognitive system can be sped up when the human trainer gives evaluative, informative feedback based on mental models of the system and the learning process, and the learner uses this feedback to build a (potentially simplified) model of the task domain and to shape its policy.

Development of iconic co-speech gesturing in preschool children (EcoGest)

This projects aims to provide a detailed account of the development of iconic gesturing and its integration with speech in different communicative genres. We will study pre-school children at 4 to 5 years of age to investigate their speech-accompanying iconic gesture use and to develop a computational cognitive model of their development. We apply qualitative and quantitative methods to study children’s speech-gesture behavior and to evaluate our findings with computational cognitive modeling in terms of the following aspects: (1) forms of iconic gesturing, (2) positions of gestures, (3) semantic coordination of speech and gesture, (4) packaging of information.

 

 

Social Motorics

SP-05 – Social Motorics

This project explores the sensorimotor and cognitive mechanisms underlying the dynamic coordination of interaction partners. In previous work, we have separately developed models for Bayesian hierarchical gesture perception as well as cognitively based speech-gesture production. Here we aim at integrating these accounts in a model of the so-called Social Brain, of both mirroring and mentalizing processes. The goal is a probabilistic and hierarchical sensorimotor model that grounds perception, production and inter-agent coordination on principles of predictive processing, free-energy minimization and active inference, in a close coupling of perception and production processes.

Media

CITEC News, 2017

Publications

Underlying mechanisms of the sense of agency (SoA)

In this postdoc project by Dr. Zeynep Barlas, we conduct studies to investigate the underlying mechanisms of the sense of agency, i.e. the sense that one is in control of their actions and the consequences of these actions. In particular, these studies examine whether and how movement related and contextual factors contribute to the sense of agency through predictive and postdictive processes. We employ behavioral methodologies established in both physical and virtual reality environments, and also examine how sense of ownership and sense of agency alter in joint actions with robots and virtual agents.