Suche

Publikationen


2018

2017

2016

  • Tabletop Interaction Beyond Touch - Interaction On, Above, Around, and Across Tabletop Surfaces
    Chi Tai Dang
    Dissertation
  • Measuring the Impact of Multimodal Behavioural Feedback Loops on Social Interactions
    Ionut Damian, Tobias Baur, Elisabeth André
    Proceedings ICMI
    In this paper we explore the concept of automatic behavioural feedback loops during social interactions. Behavioural feedback loops (BFL) are rapid processes which analyse the behaviour of the user in realtime and provide the user with live feedback on how to improve the behaviour quality. In this context, we implemented an open source software framework for designing, creating and executing BFL on Android powered mobile devices. To get a better understanding of the effects of BFL on face-to-face social interactions, we conducted a user study and compared between four different BFL types spanning three modalities: tactile, auditory and visual. For the study, the BFL have been designed to improve the users' perception of their speaking time in an effort to create more balanced group discussions. The study yielded valuable insights into the impact of BFL on conversations and how humans react to such systems.
  • Social Signal Processing for Dummies
    Ionut Damian, Michael Dietz, Frank Gaibler, Elisabeth André
    Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI) 2016
  • MobileSSI: asynchronous fusion for social signal interpretation in the wild
    Simon Flutura, Johannes Wagner, Florian Lingenfelser, Andreas Seiderer, Elisabeth André
    Proceedings ICMI
    Over the last years, mobile devices have become an integral part of people's everyday life. At the same time, they provide more and more computational power and memory capacity to perform complex calculations that formerly could only be accomplished with bulky desktop machines. These capabilities combined with the willingness of people to permanently carry them around open up completely new perspectives to the area of Social Signal Processing. To allow for an immediate analysis and interaction, real-time assessment is necessary. To exploit the benefits of multiple sensors, fusion algorithms are required that are able to cope with data loss in asynchronous data streams. In this paper we present MobileSSI, a port of the Social Signal Interpretation (SSI) framework to Android and embedded Linux platforms. We will test to what extent it is possible to run sophisticated synchronization and fusion mechanisms in an everyday mobile setting and compare the results with similar tasks in a laboratory environment.
  • MobileSSI - A Multi-modal Framework for Social Signal Interpretation on Mobile Devices
    Simon Flutura, Johannes Wagner, Florian Lingenfelser, Andreas Seiderer, Elisabeth André
    Proceedings of the 12th International Conference on Intelligent Environments (IE) 2016
    Over the last years, new generations of mobile devices have found their way into our pockets. They provide more and more computational power and memory capacity to perform complex calculations that formerly could only be accomplished with bulky desktop machines. Moreover, mobile devices are equipped with a range of sensors to capture people's motion, environmental sound etc. These capabilities combined with the willingness of people to permanently carry them around open up completely new ways of observing human behaviour no longer in laboratories, but "in the wild". However, the detection and analysis of social cues is still a challenging task and requires adequate tools to synchronise, process and analyse relevant signals. This may be the reason why many studies and applications focus on offline analysis and typically collect data over long periods of time and analyse them afterwards. To allow for immediate feedback, real-time assessment is necessary. In this paper, we present MobileSSI, a port of the Social Signal Interpretation (SSI) framework to Android and embedded Linux platforms. The framework supports the joint development of processing pipelines for the analysis of social signals on a desktop computer and mobile devices. Throughout the paper we report on challenges we had to face when porting SSI to a mobile context. Furthermore, we summarise first experiences with a real-life setting in a pub where we focused on the analysis of multimodal social group dynamics investigating laughter as a sign of enjoyment.
  • Exploring Eye-Tracking-Based Detection of Visual Search for Elderly People
    Michael Dietz, Daniel Schork, Elisabeth André
    Proceedings of the 12th International Conference on Intelligent Environments (IE) 2016
  • Investigating Politeness Strategies and their Persuasiveness for a Robotic Elderly Assistant
    Stephan Hammer, Birgit Lugrin, Sergey Bogomolov, Kathrin Janowski, Elisabeth André
    Proceedings of the 11th International Conference on Persuasive Technologies (Persuasive 2016)
  • Exploring Eye-Tracking-Driven Sonification for the Visually Impaired
    Michael Dietz, Maha El Garf, Ionut Damian, Elisabeth André
    Proceedings of the 7th Augmented Human International Conference (AH) 2016
  • Exploring the Potential of Realtime Haptic Feedback during Social Interactions
    Ionut Damian, Elisabeth André
    Proceedings of 10th ACM International conference on Tangible, Embedded and Embodied Interaction (TEI)
    We explore the use of haptic feedback to deliver supportive information during social interactions in realtime. In an exploratory user study, we investigated perceptual limitations of vibration patterns during a conversation between peers. The results from this study have then been used to develop a system for providing users with realtime information regarding the quality of their nonverbal behaviour while engaged in a public speech.

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998