Virtual LiVe

The project Virtual LiVe aims at digitizing classic event formats that require physical presence via the use of new immersive media formats (e.g. 3D-Audio, 360°-Video, Light-fields, Volumetric Video). Virtual LiVe is funded within the framework of the KMU-akut program “Research for SMEs” of the Fraunhofer-Gesellschaft.

The three partner institutes of this project Fraunhofer FOKUS, Fraunhofer HHI and Fraunhofer IIS strive to find applicable high-end solutions for the event-streaming needs of various stakeholders from different industries.


Goals and Motivation

A large number of requests show the massive increase in demand for immersive exchange formats due to COVID-19 and require a quick response.

Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion strives to develop a pool of technological solutions where players from the industry can find a remedy for this problem.

The aim is to develop and evolve:

Platforms & Distribution
Identification, evaluation and implementation of technical and non-technical requirements and corresponding design of a platform for near-real-time and protected transmission of media content and interactions. Furthermore of marketing options (pay-per-use (tickets), subscription or advertising-supported models), and of necessary changes and adaptation along the distribution chain.

Interactive 3D Content
Identification, evaluation and implementation of workflows and tools for audiovisual interaction with realistic spatial perception through the combination of representation formats (i.e. 360°-Video, Light-fields, 3D-Audio), data reduction for immersive interactive content, efficient use of interaction possibilities and integration into communication platforms.

360°-Video & 3D-Audio
Identification, evaluation and implementation of requirements for high quality 360°-Video and 3D-Audio live-streaming for concerts that is compatible with various devices. Consideration of the requirements of cultural events, data protection and data security according to German/EU law, viewing direction and excerpt selection with object-based 3D audio and integration into communication platforms.

Current Problem

Due to the Corona crisis, face-to-face events such as concerts, trade fairs or workshops are no longer possible in the classical format with physical presence. This leads to cultural impoverishment and endangers business and cultural exchange in society. The cultural and creative industries are particularly dominated by SMEs and are the driving force behind such face-to-face events. They generate a turnover of more than EUR 170 billion in sales with 1.8 million employees and have been hit particularly hard as one of the most important sectors of the German economy.

At the same time, however, new immersive media formats (including 3D-Audio, 360°-Video, Light-fields, Volumetric Video) are opening up the possibility of digitizing classic event formats. This promises additional revenue streams and target audiences. Virtual LiVe therefore investigates how present-day solutions can be extended via high-quality virtual presence with immersive content to create new formats for virtual and hybrid cultural events as well as platforms for congresses and trade fairs.



Virtual LiVe will develop a tool box with individual elements from the technological expertise of the project partners. SMEs can put together a customized program from this tool box depending on the needs and requirements for their respective event needs and thus obtain a technology-based solution for the realization of their formats.

By combining competencies of the project partners, the entire production field of virtual events can be covered by a broad portfolio of immersive media formats (e.g. 3D-Audio, 360°-Video, Light-fields, Volumetric Video, interactive low-latency streaming and advanced stream analytics). The experience of the participating partner institutes in the respective core topics allows for a highly efficient and synergetic approach, enabling innovative and practical commercial applications and value creation opportunities for SMEs within a short processing time. Virtual LiVe offers the following benefits especially for SMEs:

  • Modular and scalable, thus both customer and application-specific optimized cost / benefit ratio
  • Complete solution including licensing and payment system from a single source, thus particularly attractive for SMEs
  • Higher degree of immersion compared to competitive solutions thanks to broad technology portfolio


Monthly Colloquium

The events will be held in German language.

Register for our upcoming colloquium and join our monthly session, keep up to date with the latest developments and also get in touch with the consortium of the project! Did you miss a past colloquium? Click on the titles below to see a recording of the sessions.

If you want to get a notification about further sessions, sign up for our newsletter here!


Upcoming: 9th Colloquium

Title: Real World Sustainable Remote Presences
Fax Quintus (CEO / Founder i-mmersive)

Abstract: Teleportation, a dream of humankind, may finally be within reach. Studying can be democratized via 360° live broadcasting; politicians can be omnipresent and resourceful without travelling. Let’s talk about the status quo!

Date: 27 April 2022
Time: 10 am – 11 am
Location: Virtual



8th Colloquium

24 March 2022

Title: Special Edition – Meet the Experts of the Hybrid Live Concert Kesselhaus Berlin / Planetarium Bochum
Speaker: Billy Andrews (The Dark Tenor), Sören Birke (Kesselhaus Berlin), Sven Giersch (Planetarium Bochum), Andreas Schaffner (K-tel), Manuel Schiewe (Fraunhofer FOKUS), Ulli Scuda (Fraunhofer IIS), Robert Seeliger (Fraunhofer FOKUS), Christian Weissig (Fraunhofer HHI)



7th Colloquium

23 February 2022

Title: Immersive storytelling in the context of art and culture with new technologies in public spaces.
Silke Ababneh (CEO, Founder & Creative Director vr4content)


6th Colloquium

22 December 2021

Title: Spin-offs & Fraunhofer start-up collaborations – CoLab, AHEAD & FTTF support technology transfer from initial utilization ideas to financing.
Speaker: CoLab, AHEAD & FTTF


5th Colloquium:

24 November 2021

Title: Insight into the digital stage: The project ‘The Digital Stage –’ introduces itself
Speaker: Digital Stage


4th Colloquium:

22 September 2021

Title: Social Media Platforms and Selected Use Cases from the Festival Landscape
Speaker: Sönke Kirchhof (Executive Producer / CEO, INVR.SPACE GmbH)


3rd Colloquium:

18 August 2021

Title: Open Round Table on the Subject “Virtual and Hybrid Trade Fairs”


2nd Colloquium:

21 July 2021

Title: Connected Adventures – Six Projects of the Dresden Symphony Orchestra 2006-2024
Speaker: Markus Rindt (Intendant, Dresdner Sinfoniker)


1st Colloquium:

23 June 2021

Title: Future of Live Entertainment
Speaker: Sven Bliedung von der Heide (Volucap)

Kick-Off Event: Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion

26 May 2021
@3IT Berlin/ Hybrid Event

Shaping the future of virtual events together! Read the article about the event here.

Kick-Off Event Virtual LiVe 26 May 2021: General Project Overview

Presented by: Angela Raguse, Fraunhofer IIS // The event was held in German language.

Kick-Off Event Virtual LiVe 26 May 2021: Fraunhofer Technology Presentation

Presented by: AC Coppens, the Catalysts // Christian Weißig, Fraunhofer HHI // Stephan Steglich, Fraunhofer FOKUS // Siegfried Fößel, Fraunhofer IIS // The event was held in German language.

Virtual LiVe – Hybrid Live-Concert in New Format @Kesselhaus Berlin & @Planetarium Bochum with Fraunhofer Technology, December 2021

With the help of interactive streaming technologies, visitors were able to experience a hybrid concert by the artist not only on site in Berlin, but also via the Internet, applaud the artist and exchange ideas with each other. Some of the musicians joined the performance via the Internet, even though they were playing in different locations. In addition, the concert was transmitted to the Planetarium Bochum as a 360° projection and with 3D-Audio sound.

Read the in-depth article about the event here.

Making-Of Hybrid Live Concert


Hybrid Live Concert in Berlin, Bochum and at Home

Virtual LiVe Media Coverage

Find all newsarticles here (click on the titles below to be redirected):

XR HUB BAVARIA, 19 May 2021
Neues Fraunhofer Projekt: Virtual LiVe – Virtualisierung von Live-Veranstaltungen durch audiovisuelle Immersion

Fraunhofer Heinrich-Hertz-Institut, HHI, 25 May 2021
Neues Fraunhofer Projekt: Virtual LiVe – Virtualisierung von Live-Veranstaltungen durch audiovisuelle Immersion

BLACH REPORT, 11 June 2021
Virtual LiVe: Neues Fraunhofer Projekt zur Virtualisierung von Live-Veranstaltungen

PRO MEDIA, 14 June 2021
Neues Fraunhofer Projekt zur Virtualisierung von Live-Events durch audiovisuelle Immersion

INFODIGITAL, 6 December 2021
Laborkonzert zeigt Möglichkeiten hybrider Live-Events mit Fraunhofer-Technologien

FKTG, 11 December 2021
Hybrides Live-Konzert mit 360°-Projektion und 3D-Audio

FKT, 14 December 2021
“Virtual LiVe”: Neue Konzepte für hybride Live-Veranstaltungen

BLACH REPORT, 20 December 2021
Virtual LiVe: Fraunhofer-Team validiert hybrides Konzert

StageReport, 21 December 2021
Virtual LiVe: Fraunhofer-Team validiert hybrides Konzert

EVENT PARTNER, 9 February 2022
Virtual LiVe: Forschung an immersiven Events

AV Magazine, 10 February 2022
Ultra-low latency stream brings remote musicians together

Avant Première, 15 February 2022
Panel on Audiovisual Immersion: ‘Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion’

EVENT PARTNER, 24 February 2022
Virtual LiVe: Hybrides Laborkonzert als immersives, digitales & interaktives Erlebnis

FKT, 4 March 2022
“Virtual LiVe”: Hybrides Live-Konzert mit Fraunhofer-Technologie

The communication of the newsletter is in German.

If you’re already subscribed to the 3IT newsletter and also want to receive the Virtual LiVe newsletter, please contact us.

General Contact

Maria Ott Coordination & Communication Fraunhofer HHI
Project Manager 3IT
Jennifer Chyla Coordination &
Fraunhofer HHI
Deputy Manager 3IT

Technical Contact: Immersive A/V Streaming & Platform Capabilities

Real-Time Immersive AV Streaming // DRM, ad-based Models, Interaction and Social Media Integration // Scalable Playback (Smartphone, Web, VR / AR, Dome)

Dr. Stephan Steglich Transmission and playback of immersive media, interaction Fraunhofer FOKUS
Head of Department Future Applications and Media
Dr. Louay Bassbouss Web Technologies, Standardization (W3C, HbbTV, CTA), Media Streaming Fraunhofer FOKUS
Senior Project Manager, Business Area FAME

Technical Contact: Immersive Video Recording and Encoding

360°-Video // Volumetric Video // Video Coding (H.26x)

Christian Weissig 360 degree video,
volumetric video
Fraunhofer HHI
Head of Capture & Display Systems Group
Thomas Koch 360 degree video,
volumetric video
Fraunhofer HHI
Project Manager at the Capture & Display Systems Group

Technical Contact: Immersive Audio Technologies and 6DoF Light-Field Rendering

3D-Audio (MPEG-H) // High-Quality Audio Communication (EVS) // Immersive Image-Based Rendering (Light-field)


Dr. Michel Bätz Light-field, MPEG-I Fraunhofer IIS
Sub-project leader Virtual LiVe IIS
Dr. Ulli Scuda Immersive and object based audio, binaural audio, MPEG-H, interactive audio Fraunhofer IIS
Head of Group, SoundLab