TransMIXR – Immersive AR and VR Platform

While the future of media experiences still has to be written, the eXtended Reality (XR) and Artificial Intelligence (AI) technologies of the TransMIXR project provide a unique window of opportunity for the European Creative and Cultural Sector (CCS) to reimagine digital co-creation, interaction and engagement possibilities in immersive Augmented Reality (AR) and Virtual Reality (VR) environments.

Project results have been showcased at the annual flagship event of the International Broadcasting Convention (IBC) in 2024 and 2025 – participating in the Media Innovation Program, presenting the TransMIXR-powered Newsroom of the Future and winning the prestigious IBC Accelerator Project of the Year Award.

Newsroom AI Toolbox – IBC 2025 Special Offer

Platform Overview

The TransMIXR platform provides (i) a distributed XR Creation Environment that supports remote collaboration and concurrent application scenarios of the Storypact editor, and (ii) an XR Media Experience Environment for the delivery and consumption of immersive media experiences. AI techniques for understanding and processing of complex media content enable the reuse of heterogeneous assets across immersive content delivery platforms.

Immersive TransMIXR Plattform for AR/VR Content Creation and Delivery

TransMIXR developed and evaluated four pilots that bring the vision of future media experiences to life across multiple CCS domains: (i) news media and broadcasting, (ii) performing arts, and (iii) cultural heritage. Additionally, the project forged interdisciplinary collaborations to demonstrate how immersive social experiences could be transferred to new application areas beyond the CCS. The project contributes to the Media and Audiovisual Action Plan from the European Commission, in particular boosting the adoption of XR technologies, opening new business models opportunities in new application areas and markets, and gaining worldwide leadership in XR technologies while being deeply grounded in European values such as veracity, diversity, connectedness and universality.

Interactive Visualization for AR and VR Environments

webLyzard conceptualized and implemented algorithms for computing content metrics and developed an interactive visual analytics dashboard to monitor these metrics. Advanced content exploration and visualization capabilities seamlessly integrate the content assets previously ingested, the metadata and the visualization methods. Interactive tooltips help inspect metadata and trigger drill-down operations, enabling a thorough evaluation of the ingested content in terms of completeness and quality of (meta)data assets for the pilots.

Communication and Impact Metrics

The webLyzard Stakeholder Dialogue and Opinion Model, or WYSDOM, is a real-time impact and communication success metric based on AI-enabled opinion mining methods initially developed for the U.S. Department of Commerce. The Horizon 2020 Project ReTV significantly extended the underlying model to provide seamless integration of content and audience metrics. TransMIXR expanded the interactive visualizations of these metrics to illustrate how perceptions evolve over time and how biases (gender, politics, etc.) impact these perceptions.

TransMIXR Project Consortium

Coordinated by the Technological University of the Shannon – Midlands Midwest, the TransMIXR consortium with 19 organizations from 12 European countries includes (i) leading expertise in European research, media and innovation programs, (ii) in-depth knowledge of AI & XR and their application to the media sector, and (iii) representatives of key European application domains including News Media, Cultural/Education and Creative.

This project has received funding from the European Union’s Horizon Europe research and innovation program under grant agreement No 101070109. Call: HORIZON-CL4-2021-HUMAN-01-06, Innovation for Media, including eXtended Reality (IA).