Project

Multimodal interaction in virtual reality

The technical development in the field of Virtual Reality currently shows a strong dynamic development. The high degree of immersion of this technology makes it possible to create for the user an intense feeling of presence in the virtual world. It is assumed that cognitive processes create a mental model of the self in the virtual world, which generates a feeling of "being in the virtual world". However, it is unclear from a cognitive science and learning psychology perspective in what ways this form of immersion can benefit the user in knowledge contexts. 

Interaction in highly immersive virtual reality also poses requirements and offers opportunities that may necessitate innovative interface designs. For example, the body can move freely in space and be used accordingly for interaction. This freedom considerably expands the interaction spectrum, e.g., compared to touch interfaces. In application development, there are various approaches to realization, which have, however, rarely been investigated in terms of learning psychology and cognitive science. The use of virtual reality technology thus offers interesting and novel possibilities with respect to the design of learning environments and to the supporting information processing by reducing the barriers between the agent and the information object.

  • Lachmair, M., Ruiz Fernández, S., & Gerjets, P. (2018). Does Grammatical Number influence the semantic priming between number cues and words related to vertical space? An investigation using Virtual Reality. Frontiers in Psychology, 9:573. https://dx.doi.org/10.3389/fpsyg.2018.00573 
  • Lachmair, M., Ruiz Fernandez, S., Cervera Torres, S., & Gerjets, P. (2017, November). Zooming Emotions: The Role of Action and Presence. Invited talk at the Interdisciplinary Workshop Virtual Reality Research: Active Self and Presence. Universität Potsdam.

Part of the lab

Duration

01/2018 - 12/2023

Funding

IWM budget resources

Your contact person

Participants

Publications (1)

  • Brucker, B., Pardi, G., Uehlin, F., Moosmann, L., Lachmair, M., Halfmann, M., & Gerjets, P. (2024). How learners’ visuospatial ability and different ways of changing the perspective influence learning about movements in desktop and immersive virtual reality environments. Educational Psychology Review, 36, Article 65. https://doi.org/10.1007/s10648-024-09895-w

    Open Access