Available thesis topics

Below you will find focus areas in the research field "Human-Centered Security and Privacy" for which we offer Bachelor's and Master's theses. For a specific topic and any questions about these focus areas, please contact the relevant person.

Public Security User Interfaces

The rapid development of digital technologies and the increasing threat of cybersecurity have led to a growing need for innovative security solutions in public spaces. One example of user interfaces that can improve security behavior are so-called Public Security User Interfaces. These are interfaces positioned in shared, non-personal areas that offer information or interactions on security-related topics. These interfaces play an important role in providing security information, improving situational awareness, and promoting secure behavior. The main goal of this research is to investigate the design, implementation, and impact of user interfaces that enhance security behavior, in order to facilitate the transition from cybersecurity awareness to habitual secure behavior.

The theses in this area deal with topics such as:

• Behavior analysis of user interaction with Public Security User Interfaces
• Personalization strategies to support secure behavior
• Selection of content and dynamic adaptation to the target group and contextual factors

Recommended knowledge and interests

• Knowledge in human-centered design
• Experience in conducting user studies
• Interest in conducting a thorough literature review
• Independent thinking and creative problem solving
• Optional: Interest in public display research

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Doruntina Murtezaj

Social Engineering

Cybercrime currently causes a global economic loss amounting to several trillion euros. According to expert analyses, up to 90% of these damages are a direct or indirect result of attacks in which the human element is at the center. Attackers exploit authority, fear, curiosity, or helpfulness with the goal of manipulating their victims to obtain sensitive data. Examples include phone calls to obtain user login credentials, emails containing malware attachments to gain access to protected networks, or deep fakes used to impersonate someone's identity.

Theses in this area address a variety of questions:

• How do people behave during social engineering attacks?
• How can social engineering attacks be detected?
• Which contextual factors facilitate social engineering attacks?
• How can user interfaces be developed to protect against social engineering attacks?

Recommended knowledge and interests

• Interest in human-centered attacks
• Knowledge of qualitative and/or quantitative research methods
• Interest in conducting a thorough literature review
• Independent thinking and creative problem solving

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Felix Dietz

Security and Privacy in Mixed Reality

Mixed reality devices are quickly finding their way into users’ daily lives, particularly in the form of head-mounted displays. Users can immerse themselves in virtual worlds or enrich the virtual world with physical content, supporting a wide range of applications in the areas of entertainment, work, education, and well-being. While these technologies support an ever-increasing number of features in the aforementioned areas, they also present challenges and create opportunities for security and privacy.

Theses in this area essentially deal with topics in the context of two general questions: (1) How can mixed reality solve existing challenges in terms of privacy and security? (2) What challenges in terms of privacy and security arise in the context of mixed reality, and how can these be addressed?

Recommended knowledge and interests

• Interest in VR/AR technology
• Knowledge of qualitative and/or quantitative research methods
• Interest in conducting a thorough literature review
• Willingness to learn, e.g., Unity

Readings | Literature

• Ethics Emerging: the Story of Privacy and Security Perceptions in Virtual Reality
  https://www.usenix.org/system/files/conference/soups2018/soups2018-adams.pdf
• Exploring the Unprecedented Privacy Risks of the Metaverse
  https://arxiv.org/pdf/2207.13176.pdf

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Verena Winterhalter

Viktorija Paneva

On-Body Security and Privacy Interfaces

The rapid integration of wearable sensors and head-mounted displays (HMDs) makes on-body computing increasingly relevant for security and privacy research. In this area, we focus on biometric authentication, privacy-preserving wearables, physiological sensing, and secure interaction paradigms for augmented reality (AR) and virtual reality (VR). Possible topics include the development of novel authentication methods for wearable devices, privacy-preserving approaches to continuous physiological monitoring, secure interaction concepts in AR and VR environments, and adaptive security/privacy mechanisms that enhance user trust and system reliability. By addressing current challenges and future opportunities, we aim to develop resilient, privacy-conscious, and user-friendly on-body systems that prioritize both security and seamless interaction experiences.

Recommended knowledge and interests

• Interest in wearables / hardware prototyping
• Knowledge of qualitative and/or quantitative research methods
• Interest in conducting a thorough literature review
• Willingness to learn (e.g., Unity)

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Oliver Hein

Tangible Security and Privacy User Interfaces

In the age of ubiquitous computing, users' IT security and privacy are at risk almost anytime. IT security and privacy assistants help users become aware of these risks and take appropriate measures to protect their data. However, these systems are often too complex, unintuitive, and not visually appealing. In order to enable even less technologically savvy or inexperienced individuals to use IT security and privacy assistants, such mechanisms must become tangible, i.e., physically manipulable and touchable by humans.

Recommended knowledge and interests

• Interest in Usable Security
• Knowledge in the field of Human-Computer Interaction and qualitative and/or quantitative research methods
• Independent thinking and creative problem solving
• For some projects: Interest in Fabrication (e.g., 3D modeling/printing, electronics, soldering)

Readings | Literature

• Take Your Security and Privacy Into Your Own Hands! Why Security and Privacy Assistants Should be Tangible https://dl.gi.de/handle/20.500.12116/37360
• Making Privacy Graspable: Can we Nudge Users to use Privacy Enhancing Techniques? https://arxiv.org/abs/1911.07701
• Privacy Itch and Scratch: On Body Privacy Warnings and Controls https://dl.acm.org/doi/10.1145/2851581.2892475
• Privacy Care: A Tangible Interaction Framework for Privacy Management https://dl.acm.org/doi/10.1145/3430506

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Sarah Delgado Rodriguez

Behavioral Biometrics

The use of biometric mechanisms—i.e., authentication based on unique features of a user's physiology or behavior—is a convenient and fast alternative to classical token- or knowledge-based authentication. Popular examples include fingerprint, facial recognition, or typing behavior biometrics. However, these systems typically rely on machine learning algorithms, making their decisions both difficult for the user to comprehend and subject to manipulation.

In this research area, we investigate novel approaches that enable users to understand and influence the results of biometric (black-box) systems, and develop new approaches with a focus on the user.

The following questions are particularly interesting:

• How can users explore and understand influences on the decision-making process of biometric systems?
• How can user interfaces for biometric systems be designed to more clearly communicate the robustness and accuracy of predictions?
• How can users influence how they are recognized, i.e., by changing their behavior?
• How can users be encouraged to exhibit more distinctive behavior?
• How can biometric authentication be embedded in natural interaction?

Concrete research approaches include, among others, investigating (real) user behavior (e.g., through observations, interviews, surveys) and designing, implementing, and evaluating novel security and privacy concepts.

Recommended knowledge and interests

• General interest in biometrics, authentication, and machine learning
• Knowledge of qualitative and/or quantitative research methods
• Solid programming skills (e.g., Python or Android)

Readings | Literature

• Comparing passwords, tokens, and biometrics for user authentication http://www.nikacp.com/images/10.1.1.200.3888.pdf
• An introduction to biometric recognition https://www.cse.msu.edu/~rossarun/pubs/RossBioIntro_CSVT2004.pdf
• Touch me once and I know it’s you! Implicit Authentication based on Touch Screen Patterns https://www.medien.ifi.lmu.de/pubdb/publications/pub/deluca2012chi/deluca2012chi.pdf

Example Thesis

Reauthentication Concepts for Biometric Authentication Systems on Mobile Devices

Contact

Interested students are asked to submit their CV, academic transcript, and intended start date.

Lukas Mecke

Details

Problem Statement

The increased use of generative models has elevated human-AI collaboration to new heights. Although there has been extensive research on the evaluation metrics of generative models, these have not yet been leveraged for human exploration of the latent space of such models. Exploring latent spaces remains a significant challenge, particularly in terms of how users interact with these spaces through different user interfaces. This work investigates the influence of user interfaces on users’ exploration of generative model latent spaces, aiming to develop more intuitive and effective exploration tools. Specifically, in this thesis, we aim to build a visualization tool for understanding the metrics related to GANs' latent space—capturing how users explore, navigate, and engage with generative outputs. By focusing on UI design and interaction, this work sheds light on user-centric exploration patterns and provides practical insights for designing accessible and engaging interfaces. The findings contribute to a deeper understanding of user interaction with generative models and facilitate their broader adoption and application across various domains.

Tasks

• Perform a literature review. Identify key challenges and gaps in current approaches to GAN's latent space Exploration
• Build a visulaization tool from the python package provided for different metrics
• Conduct a user studys
• Do statistical evaluations
• Write a thesis and present your findings in the Disputationsseminar
• (Optional:) co-write a research paper

Details

Problem Statement

In this thesis, we explore how small, interactive elements - like inline widgets - can help shape the way a story unfolds. For example, a character widget might let an author edit a character's traits, and those changes could automatically adjust how that character acts across the story. Instead of building a complete storytelling system, our focus is on design concept that support writers as they work. This concept will allow edits to specific parts of the story—like a character or setting—to ripple out and influence the broader narrative when needed. By making it easier to see and control how local changes affect the big picture, this approach helps writers stay flexible, creative, and in control of their stories.

Tasks

• Perform a literature review. Identify key challenges and gaps in current approaches to using dynamic widgets in creative writing tools
• Implement an interactive website for the users
• Conduct a user study
• Do a statistical evaluation
• Write a thesis and present your findings in the Disputationsseminar
• (Optional:) co-write a research paper

Details

Description

Electrodermal activity (EDA) denotes the measurement of continuous changes in the electrical conductance properties of the skin in response to sweat secretion by the sweat glands. EDA is autonomously modulated by sympathetic nervous system (SNS) activity, a component of the autonomic nervous system (ANS), which is involved in the control of involuntary bodily functions as well as cognitive and emotional states. Specifically, phasic EDA activity correlated with stress, cognitive load, and attention orienting. Therefore, measuring phasic EDA responses can give us information about the user's state.In this thesis project, we want to develop an adaptive system that modifies the visual complexity of the VR environment based on changes in phasic EDA. Specifically, we want to use new signal processing methodologies termed adaptive thresholding and gaussian filtering.The research consists of three main stages: (1) validation of the psychophysiological inference underpinning the adaptive system (2) implementation of a working VR prototype, and (3) an evaluation of the adaptive environment.

You will

• Perform a literature review
• Modify an existing VR environment
• Implement an preprocessing pipeline for phasic EDA detection
• Collect and analyze electroencephalographic (EEG), electrodermal activity (EDA) and electrocardiography (ECG) data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, MNE).

References

• Fairclough, S. H. (2009). Fundamentals of physiological computing. Interacting with computers, 21(1-2), 133-145.
• Chiossi, F., Welsch, R., Villa, S., Chuang, L., & Mayer, S. (2022). Virtual Reality Adaptation Using Electrodermal Activity to Support the User Experience. Big Data and Cognitive Computing, 6(2), 55.
• Babaei, E., Tag, B., Dingler, T., & Velloso, E. (2021, May). A critique of electrodermal activity practices at chi. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-14).
• Kleckner, I., Wormwood, J. B., Jones, R. M., Siegel, E., Culakova, E., Heathers, J., ... & Goodwin, M. (2021). Adaptive thresholding increases ability to detect changes in rate of skin conductance responses to psychologically arousing stimuli.

Details

Description

Mixed reality (MR) systems refer to the entire broad spectrum that ranges from physical to virtual reality (VR). It includes instances that overlay virtual content on physical information, i.e., Augmented Reality (AR), and those that rely on physical content to increase the realism of virtual environments, i.e., Augmented Virtuality (AV). Such instances tend to be pre-defined for the blend of physical and virtual content. To what extent can MR systems rely on physiological inputs to infer user state and expectations and, in doing, adapt their visualization in response? Measurement sensors for eye and body motion, autonomic arousal (e.g., respiration, electrodermaland heart activity), and cortical activity (e.g., EEG, fNIRS) are widely used in psychological and neuroscience research to infer hidden user states, such as stress, overt/covert attention, working memory load, etc.However, it is unclear if such inferences can serve as useful real-time inputs in controlling the presentation parameters of MR environments.In this thesis project, we will investigate whether this blend can be adaptive to user states, which are inferred from physiological measurements derived from gaze behavior, peripheral physiology (e.g.., electrodermal activity (EDA); electrocardiography (ECG)), and cortical activity (i.e.., electroencephalography (EEG)). In other words, we will investigate the viability and usefulness of MR use scenarios that vary in their blend of virtual and physicalcontent according to user physiology. In particular, we will focus on understanding how physiological readings can passively determine the appropriate amount ofvisual information to present within an MR system.

You will

• Perform a literature review
• Modify an MR environment
• Adapt existing processing pipeline for EEG and EDA data
• Collect and analyze electroencephalographic (EEG), electrodermal activity (EDA), and electrocardiography (ECG) data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, Neurokit)

References

• Lotte, F., Faller, J., Guger, C., Renard, Y., Pfurtscheller, G., Lecuyer, A., & Leeb, R. (2012). Combining BCI with virtual reality: towards new applications and improved BCI. In Towards practical brain-computer interfaces (pp. 197-220). Springer, Berlin, Heidelberg.
• McGill, M., Boland, D., Murray-Smith, R., & Brewster, S. (2015, April). A dose of reality: Overcoming usability challenges in vr head-mounted displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 2143-2152).
• Fairclough, S. H. (2009). Fundamentals of physiological computing. Interacting with computers, 21(1-2), 133-145.

Details

Description

Biocybernetic adaptation is a form of physiological computing where real-time physiological data from the brain and the body can be used as an input to adapt the user interface. In this way, from the physiological data, we can infer the user’s state and design implicit interactions in VR to change the scene to support certain goals. This thesis aims the develop and evaluate an adaptive VR environment designed to maximize users' performance by exploiting changes in real-time electroencephalography (EEG) to adjust the level of visual complexity. The research consists of three main stages: (1) validation of the input EEG measures underpinning the loop; (2) implementation of a working VR prototype; and (3) an evaluation of the adaptive environment. Specifically, we aim to demonstrate the sensitivity of EEG power in the (frontal) theta and (parietal) alpha bands to adapt levels of visual complexity.

You will

• Perform a literature review
• Modify an existing VR environment
• Implement an online biocybernetic loop using EEG
• Collect and analyze EEG, EDA, and ECG data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity and/or C#
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, MNE).

References

• Biocybernetics Loops and Physiological Computing
• Development of an Adaptive Game using EEG frequencies

Details

Description

Research from cognitive science and computerized displays of simple stimuli has shown how perceptual load is a critical factor for modulating distraction. Perceptual load is the amount of information involved in processing task stimuli. According to Lavie (1995), our attentional resources are limited and mainly directed towards task-relevant goals, but we might be more prone to distractors if we have cognitive spare resources. Previous research showed that human faces have bigger distracting power than non-face objects. This project aims to assess the distracting potential distracting effect of human avatars in a social VR scenario. We aim to transfer of traditional paradigms that assess attention and distraction to immersive VR. Lastly, we adapt the target-distractor recognizability to evaluate if a physiologically-adaptive system that optimizes for perceptual load can support task performance. The research consists of three main stages: (1) validation of the psychophysiological inference underpinning the physiological loop (2) implementation of a working VR prototype, and (3) an evaluation of the adaptive environment.

You will

• Perform a literature review
• Modify an existing VR environment
• Implement an online biocybernetic loop using EEG and/or EDA
• Collect and analyze electroencephalography (EEG), electrodermal activity (EDA), and electrocardiography (ECG) data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity and/or C#
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, Neurokit, MNE).

References

• Perceptual Load of faces
• Perceptual load and task engagement
• Evaluating perceptual load in VR

Details

Description

Physiological computing is a multidisciplinary research field in HCI wherein the interaction depends on measuring and responding to the user's physiological activity in real-time (Fairclough, 2009). Physiological computing allows for implicit interaction; by monitoring the physiological signals of the user, the computer can infer, e.g., if the task demands are either too challenging or easy, and either adapt the difficulty level or when users are getting distracted from the task, the system could give them a notification. Measuring the psychological state of the user creates intriguing possibilities for Social VR scenarios as we can either adapt the number of displayed avatars, their form or even their proxemic distance. This thesis aims the develop an adaptive Social VR environment designed to support users' performance when engaged in a cognitive task using a measure of physiological state (electrodermal activity: EDA) as input for adaptation. The research consists of three main stages: (1) validation of the psychophysiological inference underpinning the physiological loop (2) implementation of a working VR prototype, and (3) an evaluation of the adaptive environment.

You will

• Perform a literature review
• Modify an existing VR environment
• Implement an online biocybernetic loop using EDA
• Collect and analyze EEG, electrodermal activity (EDA) and electrocardiography (ECG) data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, Neurokit).

References

• Biocybernetics Loops and Physiological Computing
• Adapting task complexity of a Social VR environment based on skin conductance

Details

Description

Prior work has explored transition visualizations between VR environments, or on specific interaction techniques for transferring objects from VR <-> AR views. However, there has been less attention on what are the more effective transitions across the reality-virtuality continuum. The focus of this work would be to (a) identify suitable MR transitions (b) create a mapping to common tasks where such transitions may be applicable (e.g., keyboard typing) (c) prototype different transitions, from R-->AR-->AV--VR, and vice versa: VR-->AV-->AR--R, and empirically investigating different parameters of each (d) run a user evaluation to assess perceived UX. comfort, sickness, etc. This project extends the work in Keep it simple? Evaluation of Transitions VR, by exploring MR transitions, instead of only across different VR environments. Evaluation metrics will involve both objective and subjective measures.

RQ1: What are the most effective methods for transitioning users across the reality-virtuality spectrum?

RQ2: How do these transition visualizations influence user experience, user physiological state, workload, and acceptance across tasks?

You will

• Perform a literature review
• Develop a environment
• Implement an preprocessing pipeline for phasic EDA detection
• Collect and analyze electroencephalographic (EEG), electrodermal activity (EDA) and electrocardiography (ECG) data
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity
• Good knowledge of Python libraries for scientific computing (e.g. Scipy, MNE).
• Knowledge of physiological sensing

References

• Nico Feld, Pauline Bimberg, Benjamin Weyers, and Daniel Zielasko. 2023. Keep it simple? Evaluation of Transitions in Virtual Reality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23). Association for Computing Machinery, New York, NY, USA, Article 196, 1-7. https://doi.org/10.1145/3544549.3585811
• Dimitar Valkov and Steffen Flagge. 2017. Smooth immersion: the benefits of making the transition to virtual environments a continuous process. In Proceedings of the 5th Symposium on Spatial User Interaction (SUI '17). Association for Computing Machinery, New York, NY, USA, 12-19. https://doi.org/10.1145/3131277.3132183
• Han, Jihae, Robbe Cools, and Adalberto L. Simeone. "The Body in Cross-Reality: A Framework for Selective Augmented Reality Visualisation of Virtual Objects." In XR@ ISS. 2020. https://ceur-ws.org/Vol-2779/paper6.pdf
• Cools, R., Esteves, A., & Simeone, A. L. (2022, October). Blending spaces: Cross-reality interaction techniques for object transitions between distinct virtual and augmented realities. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 528-537). IEEE.
• Pointecker, F., Friedl, J., Schwajda, D., Jetter, H.C. and Anthes, C., 2022, October. Bridging the gap across realities: Visual transitions between virtual and augmented reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 827-836). IEEE.
• Uwe Gruenefeld, Jonas Auda, Florian Mathis, Stefan Schneegass, Mohamed Khamis, Jan Gugenheimer, and Sven Mayer. 2022. VRception: Rapid Prototyping of Cross-Reality Systems in Virtual Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 611, 1-15. https://doi.org/10.1145/3491102.3501821

Details

Join a hands-on research project exploring how Tangible User Interfaces (TUIs) can help users better understand abstract cybersecurity topics like Quantum Key Distribution (QKD)! TUIs have shown promise in making complex topics more accessible — but can they help people grasp protocols like BB84? We've built a marble-track-based prototype to find out, and now it's time to evaluate it in a user study. This topic offers a unique opportunity to gain hands-on experiences with UX research, a highly demanded skill in- and outside of academia.

Your task: Design and conduct a laboratory study to empirically evaluate the TUI, and analyse the data collected during an intensive 6-week practical course (to start as soon as possible).

Details

Description

Project Overview
This thesis project presents a unique opportunity for students to contribute to innovative research on adaptive RSVP (Rapid Serial Visual Presentation) systems, following up from [1]. The focus is on developing an intelligent RSVP system that adapts to user attention and cognitive load by leveraging pupil dilation data. Pupil dilation has been shown to correlate with cognitive processing, providing valuable insight into the user's mental state while reading or processing visual stimuli. By incorporating this biometric feedback into the RSVP system, the project aims to create a more intuitive and personalized reading experience, especially for users with attention challenges or disabilities.

Project Motivation

Traditional RSVP systems often rely on fixed speeds or manual adjustments, which may not suit every user's cognitive capacity. This project seeks to enhance user engagement and efficiency by using real-time pupil dilation data to adjust the speed and presentation style dynamically. By doing so, the RSVP system can become more responsive to individual reading habits, reducing cognitive overload and improving comprehension and retention of information. This work has important implications for accessibility, enabling better interaction for users with reading difficulties or neurological impairments.

Project Goals

This thesis will explore the development and evaluation of an adaptive RSVP system, with a focus on the following key objectives:

• Experiment Design: Participants will engage with an RSVP system where reading speeds are adjusted in real-time based on pupil dilation data, providing insights into the correlation between cognitive load and visual presentation speed.
• Model Development: Develop a model that interprets pupil dilation changes and optimizes the RSVP presentation in response to varying cognitive loads, ensuring that reading pace and comprehension are maximized.

You will

• Conduct a literature review on pupil dilation and cognitive load in relation to visual stimuli
• Develop or modify an RSVP system to integrate real-time pupil tracking data
• Implement a preprocessing pipeline to analyze pupil dilation data during RSVP tasks
• Collect and analyze data, focusing on how pupil dilation correlates with reading performance and user engagement
• Summarize findings in a thesis and present them to an audience
• (Optional) Co-write a research paper based on the results

You need

• Strong communication skills in English
• Experience with eye-tracking technologies and software
• Basic knowledge of machine learning for modeling data (e.g., Python, TensorFlow)

References

• [1] Grootjen, J., Thalhammer, P., & Kosch, T. (2024). Your eyes on speed: Using pupil dilation to adaptively select speed-reading parameters in virtual reality. In Proceedings of the 26th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '24). ACM. https://doi.org/10.1145/3676531

Details

Description

Project OverviewThis thesis project offers an exciting opportunity for students to contribute to cutting-edge research on gaze estimation in interactive systems. The focus is on enhancing the accuracy of gaze interpretation within Collaborative Virtual Environments (CVEs), where effective communication is often dependent on understanding where participants are looking. Gaze serves as a vital non-verbal communication cue, yet people frequently struggle to accurately determine another persons gaze direction (i.e., where someone is looking), especially over distances.

Project Motivation

In CVEs, precise gaze estimation is crucial for natural and effective interaction. While previous research has explored distant pointing as an interaction mechanism, this project shifts focus to gaze estimation. By addressing common inaccuracies in gaze prediction, this research aims to significantly improve how users interpret each others gaze during virtual interactions, ultimately enhancing the overall immersive experience.

Project Goals

This thesis will investigate how accurately gaze estimation can be performed in CVEs, focusing on two main aspects:

• 1. Gaze Estimation Experiments: Participants will perform gaze tasks directed at targets on a screen from two different distances. The data collected will help evaluate the performance of current gaze estimation methods in these scenarios.
• 2. Model Development: Using the insights from distant pointing research, the project aims to develop a mathematical model to correct (potential) systematic displacements in gaze estimation.

You will

• Perform a literature review
• Modify an existing VR environment
• Implement an preprocessing pipeline for eye-tracking data
• Collect and analyze eye-tracking data, focussing on developing a model to correct potential systematic displacement in gaze estimation
• Summarize your findings in a thesis and present them to an audience
• (Optional) co-writing a research paper

You need

• Strong communication skills in English
• Good knowledge of Unity

References

• [1] Schweigert, R., Schwind, V., & Mayer, S. (2019). EyePointing: A gaze-based selection technique. In Proceedings of Mensch und Computer 2019. ACM. https://doi.org/10.1145/3340764.3344897
• [2] Mayer, S., Schwind, V., Schweigert, R., & Henze, N. (2018). The effect of offset correction and cursor on mid-air pointing in real and virtual environments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 653:1–653:13). ACM. https://doi.org/10.1145/3173574.3174227
• [3] Mayer, S., Wolf, K., Schneegass, S., & Henze, N. (2015). Modeling distant pointing for compensating systematic displacements. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 4165–4168). ACM. https://doi.org/10.1145/2702123.2702332

Details

Background

Probes are a powerful and widely used method in Human-Computer Interaction (HCI) and related disciplines such as social sciences. They enable researchers to gather rich, contextual insights into participants’ lived experiences, uncovering underlying needs, emotions, intentions, and desires. By prompting participants to repeatedly reflect on and document specific aspects of their daily lives — often in the form of diary entries — researchers can gain a nuanced, reliable understanding of what truly matters to participants. This depth of insight is essential for the design of applications that are not only user-centered but also contextually relevant and personally meaningful.

It is inherent that probes are easy and engaging for the participants, while at the same time they are supposed to include multiple data types, such as written text, photos, log data, drawings, audio or video recordings and individual designs. With the growing importance of context-adaptive applications, there is an increasing need to investigate well-defined situations based on human and environmental context factors (e.g., location, activity, intentions, cognitive states, and emotions). Existing tools often lack the ability to effectively prompt participants to respond within these specific contexts.

Thesis Goal

The objective of this thesis is to design and develop a mobile application that functions as an innovative and engaging probe tool. It should support the collection of diverse data formats, including photos, videos, audio, and creative user inputs such as sketches or prototypes. Additionally, the application should utilize contextual triggers (e.g., location data, physiological data from smartwatches) to send timely notifications prompting users to provide input.

You will

• Conduct a literature review on the implementation of mobile probe tools
• Design and develop an innovative Android/iOS application for collecting context-based probes
• Implement a secure backend for storing research data, including features for export and analysis
• Conduct a short pre-test study involving real participants
• Document your findings in a written thesis and present them in a final presentation
• (Optional) Co-author a research paper based on the application artifact and results

Recommended Background

• Strong interest in mobile app development, including the use of APIs to access contextual data
• Creativity in exploring new and untested methods for probe design
• Solid programming skills in iOS and/or Android development

Readings | Literature

• Eghtebas, C., Klinker, G., Boll, S., & Koelle, M. (2023, July). Co-speculating on dark scenarios and unintended consequences of a ubiquitous (ly) augmented reality. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (pp. 2392-2407).
• Gaver, B., Dunne, T., & Pacenti, E. (1999). Design: cultural probes. interactions, 6(1), 21-29.
• Graham, C., Rouncefield, M., Gibbs, M., Vetere, F., & Cheverst, K. (2007, November). How probes work. In Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces (pp. 29-37).
• Boehner, K., Vertesi, J., Sengers, P., & Dourish, P. (2007, April). How HCI interprets the probes. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 1077-1086).
• Ibrahim, S. B., Antle, A. N., Kientz, J. A., Pullin, G., & Slovák, P. (2024, June). A Systematic Review of the Probes Method in Research with Children and Families. In Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (pp. 157-172).

Note

Please note that the scope and complexity of this project are more appropriate for a Master’s thesis. However, exceptionally qualified Bachelor’s students—based on academic transcript, motivation, or relevant experience—are also welcome to apply.

Contact

Interested students are invited to submit their CV, academic transcript, and intended start date to dominik.hirschberg ät unibw.de.

Details

Aufgabenstellung / Topic

This thesis builds upon a previous master's thesis on online action learning and aims to improve the approach by integrating both online and offline action detection. The goal is to refine the system to better detect when a robot should exhibit curiosity based on human activity. Improvements will focus on optimizing classification accuracy, reducing latency, and enhancing adaptability. Additionally, a user study will be conducted to evaluate the system's effectiveness in real-world human-robot interaction scenarios.

You will:

• Review literature on action recognition and curiosity-driven learning
• Analyze and improve the existing online action learning approach
• Develop and integrate a combined online-offline detection model
• Implement improvements and optimize system performance
• Conduct a user study to evaluate the system
• Summarize findings in a thesis
• (Optional) Co-author a research paper

You need:

• Experience with Machine Learning and Computer Vision
• Strong programming skills in Python
• Familiarity with ROS (Robot Operating System)
• Knowledge of study design and data analysis
• Strong statistical evaluation skills
• Strong English communication skills

References

• Automatic Class Discovery and One-Shot Interactions for Acoustic Activity Recognition

Details

Aufgabenstellung / Topic

This thesis explores how aggressive behavior toward robots, such as kicking or yelling, affects subsequent human-human interaction. While prior research has investigated verbal aggression directed at voice assistants ([1]), this project shifts the focus to physical robots in shared environments. The central question is: Does being mean to a robot influence how people behave with each other afterward?

Using a robot platform, the thesis will design controlled interaction scenarios where participants engage in socially inappropriate behavior toward a robot. We will then measure how this behavior impacts their social dynamics with human partners, aiming to uncover emotional, behavioral, or communicative changes.

You will:

• Conduct a literature review on aggression in Human-Agent Interaction
• Design and implement experimental conditions involving robot-directed aggression
• Develop and run a user study in which participants are triggered to be mean to a robot and then evaluate subsequent human-human interaction
• Analyze and summarize findings in a thesis
• (Optional) Contribute to a research publication

You need:

• A strong interest in Human-Robot Interaction and social psychology
• Experience with experimental design and behavioral data analysis
• Skills in Python and ROS for robot programming

Reference Work

• Riquel et al. (2021) – "F*** You!"-An Investigation of Humanness, Frustration, and Aggression in Conversational Agent Communication

Details

Aufgabenstellung / Topic

Non-Verbal communication is a non-intrusive way for robots to communicate with users. However, how robot gestures are understood by users is not directly clear. In this thesis, you will apply the Expression Elicitation approach to develop non-verbal, understandable expressions for a vacuum robot operating in a domestic environment. The goal is to enable the robot to clearly communicate its current goals and needs without relying on sound. Scenarios may include the robot signaling which room it plans to clean next, indicating that an object is blocking its path, or expressing that it needs to recharge.

You will:

• Review literature on robot expressiveness and non-verbal communication and come up with referents the robot should be able to communicate
• Follow the Expression Elicitation methodology to design expressions
• Implement software to create dynamic robot expressions for a vacuum robot
• Conduct a user study
• Analyze and summarize findings in a thesis
• (Optional) Contribute to a research publication

You need:

• Interest in Human-Robot Interaction
• Skills in Python programming
• (Optional) Experience with robotics platforms and ROS (Robot Operating System)
• Knowledge of study design and user evaluation

Reference Work

• An Approach to Elicit Human-Understandable Robot Expressions to Support Human-Robot Interaction

Details

Aufgabenstellung / Topic

In this thesis, we aim to elicit non-verbal expressions for a semi-humanoid robot to enhance its on-task communication. Applying the expression elicitation approach ([1]), the goal is to develop a set of understandable expressions for task-related interactions. These expressions may include showing curiosity, interrupting to correct mistakes, or signaling attentiveness.

You will:

• Perform a literature review
• Identify relevant design dimensions
• Implement expressions on a semi-humanoid robot
• Conduct a user study to evaluate expression clarity
• Analyze and summarize findings in a thesis
• (Optional) Co-author a research paper

You need:

• High research interest in Human-Robot Interaction
• Experience with ROS and Python
• Knowledge of study design and data analysis
• Strong English communication skills

References

• Expression Elicitation Approach

Details

Description

Project Overview

For human-in-the-loop (HITL) systems, it is important to understand and quantify users’ perceptions to make the next predictions inline with the user’s intention. HITL systems that employ visual recognition often require inferring similarity between a percieved object and a mental targed. This is often difficult to determine when it comes to complex stimuli like faces. While HITL systems traditionally rely on explicit user input, implicit EEG responses can support the decision-making process effortlessly.

Project Goals

In this project, we will be exploring brain signals (more accurately, ERP components) in similariy prediction for visual stimuli.

• Experiment Design: Participants will be shown a target image followed by a number of non-target images. For every image pair (target & target), they will need to determine similarity on a scale. During the experiment, they will provide keyboard input, eye tracking data and EEG data.
• Data Analysis: Preprocess the received data and analyze ERP components.
• Model Training: Train a model on the collected data that predicts different levels of similarity between images.

You will

• Generate visual stimuli for the experiment (via Midjourney or similar) OR explore previously used datasets of images from similar studies
• Integrate the stimuli in a given system
• Conduct a user study with EEG and Eye Tracking
• Collect and analyze the collected data, focusing on finding correlations between assessed similarity and ERP components
• Summarize findings in a thesis and present them to an audience
• (Optional) Co-write a research paper based on the results

You need

• Strong communication skills in English
• Knowledge of machine learning and data analysis (e.g., Python)

References

• De la Torre Ortiz, The P3 indexes the distance between perceived and target image https://helda.helsinki.fi/bitstream/10138/572292/1/main_1.pdf
• De la Torre Ortiz, Cross-Subject EEG Feedback for Implicit Image Generation https://helda.helsinki.fi/server/api/core/bitstreams/d2a54f39-7d87-4311-9b08-0d71578a36ca/content

Details

Description

Project Overview

There has been rapid development in technologies that aim to support the needs of neurodivergent individuals in navigating everyday life and improving their wellbeing. Addressing the differences in perception and cognition, multiple mechanisms are available to ease self regulation, focus improvement and stress management. One very promising approach is neurofeedback - a method of brain tracking in connection to a specific activity. In the past, this non invasive method used to be practiced in a lab, with the assistance of a professional. However, nowadays there are tracking opportunities via consumer devices that can be done in the comfort of one's home. We would like to investigate the need for these devices and in which context could they provide maximum support to suit the needs of neurodivergent individuals.

Project Goals

In this project, you will find a scenario to inspect the usefulness and improvement of brain tracking for neurodivergent individuals

You will

• Design a scenario where the participants can be familiarized with the device and try it out
• Develop the set up of the experiment and a questionnaire/li>
• Conduct a user study with ND participants
• Collect and analyze the collected data
• Summarize findings in a thesis and present them to an audience
• (Optional) Co-write a research paper based on the results

You need

• Strong communication skills in English
• Strong MOTIVATION and interest in qualitative research

References

• Burtcher et al, Neurodivergence and Work in Human-Computer Interaction: Mapping the Research Landscape https://dl.acm.org/doi/fullHtml/10.1145/3663384.3663386
• Hall et al, Designing for Strengths: Opportunities to Support Neurodiversity in the Workplace https://dl.acm.org/doi/10.1145/3613904.3642424

Details

Description

As VR technologies become increasingly embedded in everyday life, concerns around privacy and data collection grow more pressing. This project draws on the design concepts and guidelines presented in recent research on usable privacy in immersive environments to develop and evaluate novel VR user interfaces for privacy awareness and control for different use cases and contexts.

Project Goal

The goal of this practical / thesis is to implement specific privacy interfaces across multiple application contexts (e.g. gaming, learning, social VR).

You will

• Perform a literature review
• Modify an existing privacy interface in VR
• Adapt the UIs for multiple VR use cases / virtual environments
• (thesis) Design and conduct a user study to evaluate the prototypes; data analysis
• Summarize your findings in written form and present them to an audience
• (Optional) co-writing a research paper

You need

• Interest in VR, HCI, and privacy/usability topics
• Good knowledge of Unity/C#
• Basic knowledge of qualitative/quantitative research methods is a plus

References

• [1] V. Paneva, M. Strauss, V. Winterhalter, S. Schneegass and F. Alt, "Privacy in the Metaverse:," in IEEE Pervasive Computing, vol. 23, no. 3, pp. 73-78, July-Sept. 2024, https://doi.org/10.1109/MPRV.2024.3432953.

Details

Individual Practical (6 ECTS)

Start Date: Flexible

Supervisor: Julian Rasch (julian.rasch ät um.ifi.lmu.de)

This project is a collaboration with a Munich-based artist Philip Gröning and part of a larger initiative.

Project Overview

The objective of this project is to create a camera-based system to predict wave movements and identify the calmest surface point on a defined, square water body. This system will employ computer vision techniques, specifically optical flow, to track wave motion across video frames. Machine learning models will be utilized to predict future wave behavior, consistently detecting regions with minimal motion, representing calm areas. The calmest point will serve as the primary output and will be forwarded to a 7-axis robotic arm. The project includes real-time video processing, optical flow analysis, and machine learning for wave pattern forecasting.

Project Objectives

• Capture video of water surfaces and process it using optical flow to detect wave motion.
• Analyze optical flow data to locate regions with the least movement (calm surface points).
• Utilize machine learning models to predict wave dynamics from historical wave movement patterns, identifying calm surface areas.
• Communicate the identified area to a 7-axis robotic arm for position alignment.
• Optional: Develop a real-time visualization tool to highlight calm areas on the water surface.

Expected Deliverables

• A fully functional system for detecting waves and calm surface regions using live camera footage.
• A machine learning model for wave dynamics prediction.
• ROS (Robot Operating System) communication functionality.
• Optional: A visualization tool for real-time water surface monitoring.

Required Skills & Knowledge

• Python Programming
• Computer Vision (e.g., OpenCV)
• Familiarity with ML frameworks (e.g., TensorFlow, PyTorch, Keras)
• Basic understanding of ROS

This project offers practical experience in computer vision and machine learning applied to a real-world problem, making it ideal for students interested in AI, robotics, environmental monitoring, and computational fluid dynamics. As part of a larger art project, an interest in the creative domain is beneficial but not mandatory.

Please send a brief motivation letter, CV, and transcript of records if you are interested in this project.

Details

We, the Centre for Accident Research & Road Safety - Queensland (CARRS-Q) at the Queensland University of Technology (QUT) in Australia, offer you a unique position for your Master/Bachelor thesis in the areas of human-computer interaction and infotainment systems for motorbikes.

Join us on the journey of shaping the digital future and break the cycle with newest innovation technology approaches. We are a dedicated research team based in Brisbane in the Sunshine State of Australia and look for creative and out of the box thinking minds to join our team onshore.

We work on the most difficult challenges in the automotive industry where the only limits are our own imagination. Digitalization will be key to ensure a safe riding experience in the future. Come join our creative team to shape the future of motorbikes. All in?

What awaits you?

We will work with you to shape and scope your thesis project to align with any of the following activities:

• You will prepare real-world rider studies in various traffic scenarios and different interaction concepts.
• Evaluate various output media for a safe riding experience.
• Build a pretotype with an innovative mixed approach of augmented reality and voice speech. In addition, this unique placement provides
• the ability to present and discuss your solutions with industry experts at BMW Motorrad Munich on a higher level.
• the chance to discuss the newest trends in smart voice agents with other creative minds within industry and relevant stakeholders such as the state police in Queensland with an idea to learn from them and support shaping infotainment solutions for the future.

What should you bring along?

• Currently enrolled full time in an undergraduate or graduate program at an accredited college or university studying Human-Computer Interaction (HCI), or related fields like Computer Science Engineering, Software Engineering, Informatics, Data Science. Master’s degree preferred.
• Proven experience in software development, software engineering, prototyping or similar role.
• Experience in software development life cycles (SDLC).
• Experience with software design and development in a test-driven environment.
• Knowledge of coding languages (e.g.,C++, Java, JavaScript, Python) and platforms like Unity.
• An elevated mindset that is willing to think outside of the box and sees opportunity in every difficulty.
• Being able to work in a team is key for this position.

Challenge accepted? Apply now!

Earliest starting date: 01.05.2023
Duration: 6 - 12 months
Working hours: Full-time

Details

Details

Master Thesis

Start Date: Flexible

Supervisor: Clara Sayffaerth (clara.sayffaerth@um.ifi.lmu.de)

Overview

This project aims to explore how different Extended Reality (XR) visualizations of an expert's perspective impact learning and memory retention. With more people retiring from the workforce than entering it, combined with the rapid evolution of technology, transferring practical and procedural knowledge has become increasingly challenging. Currently, this transfer often relies on in-person demonstrations, which can be limiting. XR technology offers solutions by enabling learning that is not restricted by time or place while also presenting information in an immersive, three-dimensional way. Additionally, XR allows us to visually adapt reality. By experimenting with how a virtual expert is visualized, we can go beyond replicating realistic instructions. These adaptations have the potential to enhance the learning experience and improve knowledge transfer for future learners.

Objectives

• Conduct a literature review on perspectives and their visualizations in XR (AR/VR/MR)
• Design muliple perspective visualizations
• Build a HMD-AR application (with Unity)
• Conduct a user study
• Analyze the data statistically
• Summarize your findings in a thesis and present them
• (Optional) Co-author a research paper based on your findings

Required Skills & Knowledge

• Strong communication skills in English.
• Experience with XR development preferably AR/HMDs in Unity
• Motivation to learn new skills
• (Optional) Interest in building hardware

Please send a brief motivation letter, CV, and transcript of records if you are interested in this Master thesis.

Details

As data becomes increasingly complex and multidimensional, conveying uncertainty effectively has become a critical challenge in the field of data visualization, especially in immersive and 3D environments. Immersive Analytics, which leverages spatial interfaces and virtual environments, presents new opportunities and challenges for representing uncertainty in ways that are both intuitive and informative.This thesis will explore the adaptation and evaluation of various visualization techniques for conveying uncertainty within immersive 3D environments.The goal of this thesis is to investigate and evaluate visualization techniques that utilize surface and rendering properties to represent uncertainty in 3D space. This includes:

• Conducting a literature review to identify existing techniques and theoretical foundations.
• Selecting and implementing a range of visualization styles in a virtual environment.
• Designing and running a user study to assess these techniques.
• Analyzing and interpreting the results to provide recommendations and insights.

Deliverables

• A written thesis
• A working prototype demonstrating the implemented visualization techniques
• Study materials and anonymized data used for the user study

Details

Description

Understanding how users interpret and process data visualizations is crucial for improving visualization literacy assessment. Existing assessment approaches have extensively examined factors such as visualization type [6–8], task complexity [7,8], and data volume [9] in relation to user performance. However, these studies primarily rely on response accuracy, a measure that can be influenced by guessing and thus fails to reliably capture the underlying cognitive processes involved in comprehension.

To address this gap, our research systematically evaluates user behavior during a standardized visualization literacy assessment—the Visualization Literacy Assessment Test (VLAT) [1]. By integrating the collection of event-related potentials (ERP) and eye-tracking data, we aim to identify physiological markers that correlate with performance and detect signs of guessing behavior in multiple-choice assessments. These insights could lead to a deeper understanding of how individuals engage with existing visualization literacy tests, moving beyond binary correctness.

Ultimately, this work aims to improve traditional questionnaire-based assessments with physiological sensing, providing a richer and more reliable evaluation of visualization literacy. By enhancing existing measures with physiological responses, we contribute to the development of more precise and insightful methods for assessing visualization comprehension.

Research Phases

The research consists of the following phases:

1. Literature review: Review current work on visualization literacy assessment and physiological data collection in HCI.
2. Implementation: Integrate the standardized VLAT test into an experimental framework (e.g., PsychoPy), including response logging, confidence ratings, and synchronized eye-tracking and EEG data capture.
3. Experimentation: Conduct a user study collecting EEG, eye-tracking, and behavioral data across multiple VLAT items.
4. Data analysis: Compile the dataset and perform exploratory analysis focusing on uncertainty and gaze behavior.

You Will

• Conduct a literature review on visualization literacy and physiological computing.
• Set up and implement the VLAT test within an experimental environment (PsychoPy).
• Extend the experiment to collect responses, confidence ratings, EEG, and gaze data.
• Design and run a user study with EEG and eye-tracking.
• Compile and structure the resulting dataset for analysis.
• Perform data analysis to uncover patterns in cognitive engagement and comprehension.
• Document your work in a thesis and present your findings.
• (Optional) Contribute to co-authoring a research publication.

You Need

• Good written and verbal communication skills in English.
• Solid Python skills for experiment implementation and data analysis.

References

• [1] S. Lee, S.-H. Kim, and B. C. Kwon, “VLAT: Development of a Visualization Literacy Assessment Test,” IEEE Trans. Vis. Comput. Graph., vol. 23, no. 1, pp. 551–560, Jan. 2017, doi: 10.1109/TVCG.2016.2598920.
• [2] S. Pandey and A. Ottley, “Mini-VLAT: A Short and Effective Measure of Visualization Literacy,” Comput. Graph. Forum, vol. 42, no. 3, pp. 1–11, 2023, doi: 10.1111/cgf.14809.
• [3] L. W. Ge, Y. Cui, and M. Kay, “CALVI: Critical Thinking Assessment for Literacy in Visualizations,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, in CHI ’23. New York, NY, USA: Association for Computing Machinery, Apr. 2023, pp. 1–18. doi: 10.1145/3544548.3581406.
• [4] Y. Cui, L. W. Ge, Y. Ding, F. Yang, L. Harrison, and M. Kay, “Adaptive Assessment of Visualization Literacy,” Aug. 27, 2023, arXiv: arXiv:2308.14147. Accessed: Aug. 27, 2024. [Online]. Available: http://arxiv.org/abs/2308.14147
• [5] J. Boy, R. A. Rensink, E. Bertini, and J.-D. Fekete, “A Principled Way of Assessing Visualization Literacy,” IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 1963–1972, Dec. 2014, doi: 10.1109/TVCG.2014.2346984.
• [6] G. J. Quadri, A. Z. Wang, Z. Wang, J. Adorno, P. Rosen, and D. A. Szafir, “Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, in CHI ’24. New York, NY, USA: Association for Computing Machinery, May 2024, pp. 1–26. doi: 10.1145/3613904.3642813.
• [7] S. Lee, B. C. Kwon, J. Yang, B. C. Lee, and S.-H. Kim, “The Correlation between Users’ Cognitive Characteristics and Visualization Literacy,” Appl. Sci., vol. 9, no. 3, Art. no. 3, Jan. 2019, doi: 10.3390/app9030488.
• [8] C. Nobre, K. Zhu, E. Mörth, H. Pfister, and J. Beyer, “Reading Between the Pixels: Investigating the Barriers to Visualization Literacy,” in Proceedings of the CHI Conference on Human Factors in Computing Systems, in CHI ’24. New York, NY, USA: Association for Computing Machinery, May 2024, pp. 1–17. doi: 10.1145/3613904.3642760.
• [9] J. Talbot, V. Setlur, and A. Anand, “Four Experiments on the Perception of Bar Charts,” IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 2152–2160, Dec. 2014, doi: 10.1109/TVCG.2014.2346320.

Details

Preliminary Abstract

Today's world is shaped by generative artificial intelligence (genAI) more than by any other technology. In a rush to be early adopters, companies try to include genAI in their products, neglecting their users' need for agency, control, and trust. We propose a layered approach to give users control over whether they want to use genAI and to what degree: (1) genAI is completely disabled, (2) a locally hosted AI model is employed, and (3) the model has access to the internet. As tangible interfaces have proven to increase trust when it comes to privacy & security, we developed several tangible control mechanisms for users to switch between the different stages and evaluated them in an explorative study.

Goal

In this bachelors thesis, you will explore the design space of tangible interfaces for controlling generative AI access. Specifically, you will conceptualize and prototype a couple of distinct physical "AI switches", each offering different interaction modalities. The process will begin with low-fidelity ideation (e.g., pen-and-paper sketches), followed by the development of functional prototypes using microcontrollers (e.g., ESP32), electronic components (buttons, switches, displays), and digital fabrication techniques (e.g., 3D printing, laser cutting). The prototypes will be evaluated in a comparative, exploratory user study using a Wizard-of-Oz setup, simulating the different AI access levels without needing a fully functional backend.

What we expect

• You have experience with hardware (working with microcontrollers, 3D printing etc.)
• You can work and solve problems independently
• You are creative

What you get

• Two committed supervisors, weekly meetings, and hands-on advice
• Being part of state-of-the-art research on AI-user-interaction
• A bachelors thesis

Details

Overview

This thesis explores the design and development of a physical AI buddy—a tangible, interactive companion that supports children’s learning in museum environments without relying on traditional screen-based interfaces. As digital media increasingly mediates knowledge transfer, especially for young audiences, this project investigates alternative, embodied interaction formats that blend AI-based content delivery with physical presence and intuitive, age-appropriate communication. The broader research scope of this project investigates alternative interaction forms with Large Language Models (LLMs) and simplified input and output forms to provide a more barrier-free interface solution for special contexts.

Objective

The aim of the thesis is to conceptualize and prototype an AI-powered physical object that acts as a mediator between children and curated museum content. This “AI buddy” will be capable of responding to questions, offering simple explanations, and encouraging exploration through playful dialogue or gesture, without the cognitive overload or distraction often associated with screens.

The project will address questions such as:

• How can artificial intelligence be embedded in a child-friendly physical form to foster curiosity and engagement?
• What are the interaction modalities (voice, light, movement, touch) that allow for natural, screenless dialogue?
• How can such a system support the educational goals of museums while respecting children’s cognitive and emotional development?

Context & Collaboration

The thesis is intended to be developed in collaboration with a German partner museum, which specializes in science and technology education. These institutions offer rich opportunities to explore how physical AI companions can adapt to different exhibition content and learning environments.

Methodology

• Research on existing AI interaction models in educational and museum contexts, here mandatory to consider a special emphasis on the challenging design constraints that a museum's context provides (robustness, ease of use, discreetness, etc.)
• User-centered design processes, including co-design sessions with children and museum educators
• Iterative prototyping of the physical AI buddy (using sensors, microcontrollers, natural language processing)
• Evaluation through informal observations or guided interactions in a museum setting (if feasible)

Outcome

The thesis will result in a functional prototype, a design framework, and recommendations for implementing screenless AI companions in educational institutions such as museums. The work will contribute to the fields of interaction design, child-computer interaction (CCI), and digital museology.

Details

Description

When learning complex motor skills-like playing piano or dancing -we refine our movements over time through repetition and conscious correction. Neuroscience suggests that this process relies on internal execution and reflection. However, recent findings challenge this view: a study using Electrical Muscle Stimulation (EMS) showed that externally actuating corrective movements can enhance both performance and learning.This project investigates a key question:Is it the muscular stimulation or the external actuation that drives learning?You'll explore this by comparing EMS-based feedback with robotic physical guidance using our custom setup that includes a Novint Falcon haptic device, dual EMS systems, and Unity3D. The work will involve building interactive scenarios, conducting controlled user studies, and analyzing behavioral outcomes.

You will Gain

• Practical experience with EMS and robotic feedback systems
• Skills in motor learning research, experimental design, and human-subject studies
• The chance to contribute to understanding how humans learn with external support

Requirements / Willingness to Learn:

• Experience or strong interest in Unity3D and haptic interfaces
• Interest in neuroscience, motor control, or human augmentation
• Comfort working with participants and running empirical studies

References

• Steeven Villa, Finn Jacob Eliyah, Yannick Weiss, Robin Welsch, Thomas Kosch. 2025. Understanding the Influence of Electrical Muscle Stimulation on Motor Learning: Enhancing Motor Learning or Disrupting Natural Progression?

Details

Description

As technologies like AI, EMS, and XR enter our daily lives, new social dilemmas arise. Imagine taking a test while another student uses AI support you don't have access to. How do people perceive fairness, advantage, or identity in these contexts?In prior research, we developed a psychometric scale (SHAPE) to measure public attitudes toward technologically augmented humans. However, the tool is currently only available in English.This project asks:How can we make this tool accessible across cultures while preserving its meaning and scientific validity?You'll work on a standardized translation of the SHAPE scale into either German or Japanese-depending on your native language. The process includes linguistic validation, focus groups, expert panels, and online surveys to ensure cultural nuance and psychometric rigor.

You will Gain:

• Insight into cross-cultural HCI and public perception of emerging technologies
• Experience with psychometric translation and qualitative research
• A chance to shape international research on human augmentation

Requirements / Willingness to Learn:

• Native fluency in German or Japanese, and excellent command of English
• Interest in psychology, human augmentation, or cultural studies
• Willingness to conduct focus groups and engage with diverse participants

References

• Steeven Villa, Jasmin Niess, Takuro Nakao, Jonathan Lazar, Albrecht Schmidt, and Tonja-Katrin Machulla. 2023. Understanding Perception of Human Augmentation: A Mixed-Method Study.
• Steeven Villa, Jasmin Niess, Albrecht Schmidt, Robin Welsch. Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) Scale

Details

Description

Haptic illusions occur when people experience the sensation of touch through non-tactile senses like vision or hearing. For example, visual manipulation of hand movements can evoke perceptions of weight, stiffness, or friction-even in the absence of actual physical feedback. This project investigates a compelling question: Can haptic illusions still occur when individuals view themselves from a third-person perspective or interact through a virtual avatar? You'll explore how immersive VR environments and avatar-based interactions influence the perception of haptic feedback. The work will involve experimental design, development in virtual reality, and user studies.

You will Gain

• Hands-on experience in cutting-edge VR research
• Skills in multimodal perception and human-computer interaction
• An opportunity to contribute to the scientific understanding of virtual embodiment and haptics

Requirements / Willingness to Learn:

• VR development experience using Unity3D
• Familiarity with Meta Quest devices
• Interest in learning how to control haptic interfaces, such as the Novint Falcon

References

• Yannick Weiss, Steeven Villa, Albrecht Schmidt, Sven Mayer, Florian Muller. 2023. Using Pseudo-Stiffness to Enrich the Haptic Experience in Virtual Reality.
• Albrecht Schmidt Augmenting Human Intellect and Amplifying Perception and Cognition

Details

This thesis is available from October 2025 at the earliest. If you require a thesis before this date, please consider another topic.

Parametric CAD software like Fusion360 or FreeCAD use sketches to define 3D geometry and ultimately design complex parts. Creating these sketches can be a time-intensive, complex process. Modern AI systems promise to increase the productivity of complex tasks like this by automating tedious and repetitive aspects.

In this thesis, your goal will be to explore how the presentation and interaction design of AI-assistance in these situations affects the engineers productivity. To this end, you will extend existing CAD tools to facilitate AI support in two ways: fine-granular AI completions at the level of individual sketch parameters (e.g. dimensions) and high-level generation from descriptions, e.g. through a conversational interface (roughly similar to inline auto-completion and conversational interfaces in coding). You will then conduct a user study to evaluate the differences between these interaction paradigms with respect to productivity.

Details

This thesis is available from October 2025 at the earliest. If you require a thesis before this date, please consider another topic.

Generative AI has proven highly successful in generating code, excelling in many benchmarks. While code typically is used to define system behavior, it can also be a way to, for example, generate 3d geometries. OpenSCAD is one example for such a scripting language to define complex 3d objects.

In this thesis, your goal will be to evaluate the performance of different Large Language Model regarding their performance for generating 3d geometries through OpenSCAD or other means.

Details

Master Thesis

Start Date: Flexible

Supervisor: Christoph Weber (c.weber ät hff-muc.de) HFF Munich

Overview

This thesis project offers an exciting opportunity for students interested in artificial intelligence, film production, and audio design to contribute to cutting-edge research. Sound design plays a crucial role in shaping emotional engagement and narrative coherence in film, yet the process remains highly manual, experience-dependent, and time-consuming. The primary goal of this research is to explore how AI-driven systems can automatically classify selected film scenes and subsequently generate and/or suggest appropriate sound design elements from a database. By systematically examining scene classification and AI-based audio generation, this research aims to develop a practical solution that integrates seamlessly into professional audio workflows—reducing manual workload and enhancing creative possibilities for sound designers—while also investigating its impact on user experience, as well as key factors such as control and sense of ownership.

Objectives

• Perform a literature review
• Design, conduct, and analyze expert interviews
• Develop an AI-based prototype for automatic scene classification and sound design recommendation and/or generation
• Demonstrate the integration of your prototype within an established audio production workflow (e.g., Avid Pro Tools)
• Evaluate the effectiveness of your prototype and document your findings in a thesis
• Summarize your findings in a thesis and present them
• (Optional) Co-author a research paper based on your findings

Required Skills & Knowledge

• Good programming skills in Python
• Interest in film production and sound design
• Basic knowledge of audio and video editing (ideally Avid Pro Tools or similar)
• Knowledge of artificial intelligence, machine learning, and ideally deep learning
• Motivation to learn new skills
• You have reviewed and familiarized yourself with the provided references
• Optional, but beneficial) Experience with the JUCE Framework

References (selection)

• Kamath, Purnima, et al. "Sound designer-generative ai interactions: Towards designing creative support tools for professional sound designers." Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 2024.
• Cheng, Ho Kei, et al. "Taming multimodal joint training for high-quality video-to-audio synthesis." arXiv preprint arXiv:2412.15322 (2024).
• Zhang, Yiming, et al. "Foleycrafter: Bring silent videos to life with lifelike and synchronized sounds." arXiv preprint arXiv:2407.01494 (2024).

Please send a brief motivation letter, CV, and transcript of records if you are interested in this Master thesis to c.weber ät hff-muc.de.

Details

Squishy is a tangible/deformable Interface in the form of a plushy that can be used to interact with generative AI beyond traditional chat-based input methods.After entering a prompt into an AI chat window, users often correct the AI's output by entering another prompt. Squishy enables users to react by interacting with a tangible interface, making the process more engaging and playful:

• Hitting > The user is not pleased with the output
• Shaking > The user is confused by the output
• Petting > The user is happy with the output
• ...

This concept has already been verified in a previous study. However, we want to improve the previous version by adding the following features:

• Voice recognition to enable the user to use voice input instead of prompting by text
• Text to speech to add feedback from Squishy to the user that goes beyond simple sounds
• A desktop application that serves as the frontend (displays the generated output, chat history, etc.)

What we expect:

• You have experience with hardware (working with microcontrollers, etc.)
• You have experience with (web) programming (frontend/backend)
• You can work independently

What you get:

• Two committed supervisors, weekly meetings, and hands-on advice
• (Co-)writing a scientific paper
• A masters thesis

Details