ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User Studies

Sebastian Hubenschmid·Jonathan Wieland·Daniel Immanuel Fink·Andrea Batch·Johannes Zagermann·Niklas Elmqvist·Harald Reiterer
ACM CHI · 2022
Read the paper ↗Research portal ↗DOI ↗

Abstract

The nascent field of mixed reality is seeing an ever-increasing need for user studies and field evaluation, which are particularly challenging given device heterogeneity, diversity of use, and mobile deployment. Immersive analytics tools have recently emerged to support such analysis in situ, yet the complexity of the data also warrants an ex-situ analysis using more traditional non-immersive visual analytics setups. To bridge the gap between both approaches, we introduce ReLive: a mixed-immersion visual analytics framework for exploring and analyzing mixed reality user studies. ReLive combines an in-situ virtual reality view with a complementary ex-situ desktop view. While the virtual reality view allows users to relive interactive spatial recordings replicating the original study, the synchronized desktop view provides a familiar interface for analyzing aggregated data. We validated our concepts in a two-step evaluation consisting of a design walkthrough and an empirical expert user study.

Teaser figure from the paper.

Related

Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality
Sebastian Hubenschmid·Marc Satkowski·Johannes Zagermann·Julián Méndez·Niklas Elmqvist·Steven Feiner·Tiare Feuchtner·Jens Emil Grønbæk·Benjamin Lee·Dieter Schmalstieg·Raimund Dachselt·Harald Reiterer
IEEE TVCG · 2026
Participatory AI: A Scandinavian Approach to Human-Centered AI
Niklas Elmqvist·Eve Hoggan·Hans-Jörg Schulz·Marianne Graves Petersen·Peter Dalsgaard·Ira Assent·Olav W. Bertelsen·Akhil Arora·Kaj Grønbæk·Susanne Bødker·Clemens Nylandsted Klokmose·Rachel Charlotte Smith·Sebastian Hubenschmid·Christoph A. Johns·Gabriela Molina León·Anton Wolter·Johannes Ellemose·Vaishali Dhanoa·Simon Aagaard Enni·Mille Skovhus Lunding
arXiv · 2025