Perception and Action

Perception and Action

Duration 01/2020 - open

Narratives communicate information in many ways, for example in books, audio dramas, films, or visual narrations like comics. While there is extensive research on text or film comprehension, relatively little is known about comic comprehension. Visual narratives, however, offer many possibilities in formal and informal education settings. This project therefore addresses the question how we comprehend and process visual narratives like comics.

Perception and Action

Duration 03/2023 - open

While historically, the aim of propaganda was to convince citizens of a certain agenda, novel forms of disinformation come with a different goal in mind: To confuse, rather than convince. Or, as former president Trump’s advisor Steve Bannon put it: “The Democrats don’t matter. The real opposition is the media. And the way to deal with them is to flood the zone with shit”. Although this zone-flooding strategy poses a serious threat to democratic functioning, it currently lacks empirical investigation that maps out its effects on citizens. We conduct a rigorous, pre-registered investigation into the effects of zone-flooding that harnesses state of the art-methods from Signal Detection Theory and metacognition to illuminate pressing questions: Does zone-flooding affect citizens’ ability to distinguish truth from falsehood? Does it affect their insight into the accuracy of this distinction? Does it render citizens more skeptical or more gullible? And are these effects politically symmetrical?

Perception and Action

Duration 02/2022 - open

The comprehension of different types of narratives, such as text, pictures, or comics, is important for societal participation. This dissertation project investigates how narrative comprehension changes with age and which factors contribute positively or negatively to narrative comprehension. These findings are essential for the development of interventions for different age groups and thus for greater societal participation.

Perception and Action

Duration 02/2021 - 01/2025

As the world becomes increasingly technologically forward, the presence of artificial agents in day-to-day life also becomes more apparent. Studying the interaction between humans and artificial agents, such as robots, has long been in the research spotlight. While research in this field is traditionally focused on how robots can improve our lives, this PhD project aims at flipping the focus on humans helping robots.

Perception and Action

Duration 07/2023 - 10/2023

Belief in climate change misinformation such as denying its anthropogenicity has been shown to confuse the electorate, and stall political action. While the extent of the public’s incorrect beliefs is comparatively well-understood, its causes are subject to an ongoing debate. One of the most prominent questions centers around the role of social media: Does social media use drive widespread belief in science-related misinformation?

Perception and Action

Duration 04/2022 - open

How do citizens form beliefs about politicized topics science such as climate change, COVID-19 or vaccinations? In this project, we illuminate the role of metacognition, the insight that citizens have into the reliability and fallibility of their own knowledge and reasoning.

Perception and Action

Duration 07/2020 - 06/2024

The human environment is populated by other agents. Other humans make up an important part of this, but animals and increasingly autonomously acting machines, i.e., artificial agents, also act without explicit prompting. As a result, their actions are sometimes incomprehensible. This hinders joint work, which is meant to be facilitated by automation. An important aspect of any interaction with other agents is understanding the other. This includes assessing the capabilities of the other person. In a cooperative situation, it is important to be able to assess how much you can rely on your partner. In a competitive situation, you need to assess in which aspects you are superior.

Perception and Action

Duration 01/2012 - open

It is generally believed that humans prefer information that confirms their attitudes and avoid information that represents opposing views. Striving for confirmation and congeniality are also held responsible for a number of toxic phenomena on the Internet, such as the emergence of echo chambers and filter bubbles, the polarization of society, or the dissemination of misinformation. The present project investigates how people deal with opposing opinions – are they really ignored?

Perception and Action

Duration 12/2021 - 11/2024

In various research areas and topics such as climate change or testimonies it has already been demonstrated that mental representations are influenced by true and false information. Problematically, it becomes increasingly difficult to identify false information in our daily lives. Furthermore, new technologies simplify the creation of realistic-looking false messages in media. This dissertation project, therefore, addresses the question of how discriminability of information influences mental representations.

Perception and Action

Duration 09/2022 - open

How do people perceive dynamic media such as educational videos, movies, or soccer broadcasts? Human information processing is specialized in processing dynamic information. It distinguishes relevant, and thus informative, information from irrelevant information. This project follows two research lines, bridging the gap between cognitive psychological theories of event cognition and typical situations of media reception. On the one hand, we investigate the perceptual and psychological foundations of dynamic event perception by specifying, for example, the processes of encoding and the properties of mental representations of natural action sequences. On the other hand, we use cinematic stylistic devices (e.g., different camera perspectives, film editing) and new cinematographic film techniques (e.g., 3D films) to explain basic psychological processes, such as the experience of spatial presence or the experience of suspense.

Perception and Action

Duration 10/2020 - open

Do people know about their own knowledge? And how does this relate to their experience and behavior? In this project, we investigate how insight into ones’ own cognition relates to information selection and processing, as well as opinion and judgment formation.

Perception and Action

Duration 07/2023 - open

Generative Artificial Intelligence is capable of generating texts or images based on verbal prompts. With its universal range of application fields and the human-like output quality the interaction with generative AI becomes increasingly similar to the interaction with other humans. How does interaction with generative AI impact human behavior, understanding, and trust, and how can these insights be used to optimize human-machine collaboration?

Perception and Action

Duration 01/2020 - open

In nearly all educational settings (schools, universities, further education), videos play an increasingly large role. On video portals learners can deepen and broaden their acquired knowledge and while watching they leave traces like pauses or skips. This cooperation project investigates how such usage data in conjunction with videos automatically prepared under pedagogical and psychological considerations can be harnessed to make video learning adaptive and effective.

Perception and Action

Duration 10/2020 - open

In societal discourse, Artificial Intelligence (AI) is strongly tied with both opportunities and risks. In this project, it is investigated how humans perceive the risks of AI and how their risk assessments are associated with psychological factors like prior knowledge and judgmental confidence. The behavioral consequences of risk perception are investigated, as well as intervention methods aimed at raising an awareness of AI risks.

Perception and Action

Duration 05/2023 - open

How should we communicate politiczed science such as climate change or COVID-19? We explore how metacognition, the insight that citizens have into the reliability and fallibility of their own knowledge, interacts with science communication to shape behavior and beliefs, and how metacognition is shaped back by science communication.

Perception and Action

Duration 10/2023 - 09/2026

Event perception and cognition theories assume dynamic events are segmented into meaningful chunks of sub-actions with partonomic relationships. This allows viewers to process streaming information in units and predict future states of action based on their expectations and event knowledge. Event models store relevant information for events and guide perception using schemas (or scripts). While event models hold immediately accessible representations stored in long-term memory, working event models process perceptual representations of unfolding activity throughout the event. The studies of this project will shed light on whether event processing in working event models and long-term event schemas are modality-dependent. Considering that the grain of action leads to different levels of processing – with fine-grained events being aggregated into coarse-grained events – understanding modal and amodal representations of fine and coarse context will be important to the perceptual and conceptual organization of event comprehension. Furthermore, this project will explore the role of confidence and metacognitive sensitivity in event cognition. Since sensory information is continuously processed at working event models to predict what will happen next, it is important to know if one’s cognition relies on the perception of event boundaries. Results obtained from metacognitive sensitivity measures will provide further evidence for the event models and their interactions with event schemata. Lastly, this project will address whether event schemata influence the processing of events in general and whether repeated exposure to new events changes their cognition. However, the testing of these questions will be applied using visual and verbal events to observe modality-specific effects of different context grains (fine and coarse).<br>

Perception and Action

Duration 04/2024 - 03/2027

The Leibniz Lab is dedicated to enhancing pandemic preparedness by harnessing the interdisciplinary expertise of 41 Leibniz institutions. Its work spans four central domains: exploring how interactions among the environment, animals, and humans contribute to the emergence and spread of pathogens; mitigating the physical and psychological health impacts of pandemics; optimizing pandemic response strategies; and strengthening the resilience of educational systems in crisis contexts. By integrating diverse perspectives, the Lab functions as a dynamic think tank that complements clinical and infection-control efforts, and provides policymakers and civil society with evidence-based guidance. Recognizing the threat posed by emerging respiratory pathogens, the Lab investigates factors such as alternative livestock farming practices to curb zoonotic transmission, population-level immunity, and the biological mechanisms behind severe disease outcomes. These insights inform strategies to reinforce urban infrastructure and healthcare systems, as well as to enhance educational support for students and teachers during pandemic conditions. In addition, the Lab advances frameworks for robust international collaboration on pandemic preparedness and response. At the IWM, researchers contribute to this effort by examining science communication in pandemic contexts—particularly how individuals navigate and make sense of scientific information in environments saturated with conflicting, ambiguous, or misleading messages.

Perception and Action

Duration 09/2024 - open

Multimodal large language models (LLMs) generate texts based on image inputs. This makes them attractive for a wide range of applications where a large amount of image data needs to be processed. One of these applications is the cataloguing of archival images. ArchiveGPT thus focuses on applying a multimodal LLM to archaeological photo material provided by the Leibniz-Zentrum für Archäologie (LEIZA) in Mainz. We investigate the following questions: How does a multimodal LLM perform when confronted with – for the model, often unfamiliar – archaeological objects and terms? How do archive experts (compared to non-experts) perceive the quality of the model’s image descriptions? Can they at all tell the difference between these AI-generated descriptions and descriptions generated by archive experts? How good are they at estimating their ability to distinguish them beforehand? How important is trust in AI in regard to its use? For the first study on these questions, we generated the experimental material in close collaboration with the LEIZA. Provided with photocards from the image archive, a meta-data template usable in an archival cataloging process was generated for each photocard by the multimodal LLM and LEIZA archivists.

Perception and Action

Duration 04/2024 - 03/2027

How can we protect biodiversity and the climate while ensuring a stable and resilient food supply? This central question lies at the heart of a research project that seeks innovative answers to this complex challenge. It aims to develop solutions that respect and sustainably use the planet’s limited resources. By bringing together experts from diverse disciplines, the project strives to identify and address knowledge gaps at the intersections of biodiversity, climate, agriculture, and nutrition. Its interdisciplinary approach fosters a holistic understanding of the complex interconnections among these areas. A key focus of the project is linking scientific research with public discourse. It prioritizes the integration of knowledge and the development of transformative solutions that can be applied at local, regional, and international levels. The overarching goal is to support societal shifts toward comprehensive sustainability through the promotion of innovation and evidence-based decision-making. Another essential component is the development of effective strategies for communicating scientific information to the public. This includes actively addressing misinformation related to sustainability. The project reviews and synthesizes various science communication methods, creates educational materials tailored to different audiences, and designs training programs that treat biodiversity, climate, agriculture, and nutrition as interconnected fields. It also explores new ways of transferring knowledge and technology, aiming to make complex information more accessible and engaging. These tools are intended to support both classroom teaching and self-directed learning. To test and refine its approaches, the project will implement activities at five pilot sites located in both developed and developing countries. These sites will help ensure the applicability and effectiveness of its solutions in real-world contexts.

Perception and Action

Duration 08/2024 - 04/2026

Our interdisciplinary longitudinal study investigates the evolving dynamics of human-AI interaction over six waves spanning one year. By examining individual, behavioral, and task-related variables, the project aims to uncover how users' trust in, perceptions of, self-efficacy, and willingness to engage with AI systems develop and interrelate over time. The insights gained from this research are essential for better understanding human-machine interaction, a critical foundation for fostering effective collaboration between users and AI systems. This knowledge will inform user-centered AI design and guide the ethical integration of these technologies into various aspects of everyday life.

Perception and Action

Duration 01/2024 - 12/2026

Warning: project with empty content field