Virtual LiVe
The project Virtual LiVe aims at digitizing classic event formats that require physical presence via the use of new immersive media formats (e.g. 3D-Audio, 360°-Video, Light-fields, Volumetric Video). Virtual LiVe is funded within the framework of the KMU-akut program “Research for SMEs” of the Fraunhofer-Gesellschaft.
The three partner institutes of this project Fraunhofer FOKUS, Fraunhofer HHI and Fraunhofer IIS strive to find applicable high-end solutions for the event-streaming needs of various stakeholders from different industries.
PROJECT DETAILS
Goals and Motivation
A large number of requests show the massive increase in demand for immersive exchange formats due to COVID-19 and require a quick response.
Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion strives to develop a pool of technological solutions where players from the industry can find a remedy for this problem.
The aim is to develop and evolve:
Platforms & Distribution
Identification, evaluation and implementation of technical and non-technical requirements and corresponding design of a platform for near-real-time and protected transmission of media content and interactions. Furthermore of marketing options (pay-per-use (tickets), subscription or advertising-supported models), and of necessary changes and adaptation along the distribution chain.
Interactive 3D Content
Identification, evaluation and implementation of workflows and tools for audiovisual interaction with realistic spatial perception through the combination of representation formats (i.e. 360°-Video, Light-fields, 3D-Audio), data reduction for immersive interactive content, efficient use of interaction possibilities and integration into communication platforms.
360°-Video & 3D-Audio
Identification, evaluation and implementation of requirements for high quality 360°-Video and 3D-Audio live-streaming for concerts that is compatible with various devices. Consideration of the requirements of cultural events, data protection and data security according to German/EU law, viewing direction and excerpt selection with object-based 3D audio and integration into communication platforms.
Current Problem
Due to the Corona crisis, face-to-face events such as concerts, trade fairs or workshops are no longer possible in the classical format with physical presence. This leads to cultural impoverishment and endangers business and cultural exchange in society. The cultural and creative industries are particularly dominated by SMEs and are the driving force behind such face-to-face events. They generate a turnover of more than EUR 170 billion in sales with 1.8 million employees and have been hit particularly hard as one of the most important sectors of the German economy.
At the same time, however, new immersive media formats (including 3D-Audio, 360°-Video, Light-fields, Volumetric Video) are opening up the possibility of digitizing classic event formats. This promises additional revenue streams and target audiences. Virtual LiVe therefore investigates how present-day solutions can be extended via high-quality virtual presence with immersive content to create new formats for virtual and hybrid cultural events as well as platforms for congresses and trade fairs.
Solution
Virtual LiVe will develop a tool box with individual elements from the technological expertise of the project partners. SMEs can put together a customized program from this tool box depending on the needs and requirements for their respective event needs and thus obtain a technology-based solution for the realization of their formats.
By combining competencies of the project partners, the entire production field of virtual events can be covered by a broad portfolio of immersive media formats (e.g. 3D-Audio, 360°-Video, Light-fields, Volumetric Video, interactive low-latency streaming and advanced stream analytics). The experience of the participating partner institutes in the respective core topics allows for a highly efficient and synergetic approach, enabling innovative and practical commercial applications and value creation opportunities for SMEs within a short processing time. Virtual LiVe offers the following benefits especially for SMEs:
- Modular and scalable, thus both customer and application-specific optimized cost / benefit ratio
- Complete solution including licensing and payment system from a single source, thus particularly attractive for SMEs
- Higher degree of immersion compared to competitive solutions thanks to broad technology portfolio
Monthly Colloquium
The events will be held in German language.
Register for our upcoming colloquium and join our monthly session, keep up to date with the latest developments and also get in touch with the consortium of the project! Did you miss a past colloquium? Click on the titles below to see a recording of the sessions.
If you want to get a notification about further sessions, sign up for our newsletter here!
Upcoming: 9th Colloquium
Title: Real World Sustainable Remote Presences
Speaker: Fax Quintus (CEO / Founder i-mmersive)
Abstract: Teleportation, a dream of humankind, may finally be within reach. Studying can be democratized via 360° live broadcasting; politicians can be omnipresent and resourceful without travelling. Let’s talk about the status quo!
Date: 27 April 2022
Time: 10 am – 11 am
Location: Virtual
_____________________________________________________________________
8th Colloquium
24 March 2022
Title: Special Edition – Meet the Experts of the Hybrid Live Concert Kesselhaus Berlin / Planetarium Bochum
Speaker: Billy Andrews (The Dark Tenor), Sören Birke (Kesselhaus Berlin), Sven Giersch (Planetarium Bochum), Andreas Schaffner (K-tel), Manuel Schiewe (Fraunhofer FOKUS), Ulli Scuda (Fraunhofer IIS), Robert Seeliger (Fraunhofer FOKUS), Christian Weissig (Fraunhofer HHI)
_____________________________________________________________________
7th Colloquium
23 February 2022
Title: Immersive storytelling in the context of art and culture with new technologies in public spaces.
Speaker: Silke Ababneh (CEO, Founder & Creative Director vr4content)
Abstract
_____________________________________________________________________
6th Colloquium
22 December 2021
Title: Spin-offs & Fraunhofer start-up collaborations – CoLab, AHEAD & FTTF support technology transfer from initial utilization ideas to financing.
Speaker: CoLab, AHEAD & FTTF
Abstract
_____________________________________________________________________
5th Colloquium:
24 November 2021
Title: Insight into the digital stage: The project ‘The Digital Stage – digital-stage.org’ introduces itself
Speaker: Digital Stage
Abstract
_____________________________________________________________________
4th Colloquium:
22 September 2021
Title: Social Media Platforms and Selected Use Cases from the Festival Landscape
Speaker: Sönke Kirchhof (Executive Producer / CEO, INVR.SPACE GmbH)
Abstract
_____________________________________________________________________
3rd Colloquium:
18 August 2021
Title: Open Round Table on the Subject “Virtual and Hybrid Trade Fairs”
Abstract
______________________________________________________________________
2nd Colloquium:
21 July 2021
Title: Connected Adventures – Six Projects of the Dresden Symphony Orchestra 2006-2024
Speaker: Markus Rindt (Intendant, Dresdner Sinfoniker)
Abstract
______________________________________________________________________
1st Colloquium:
23 June 2021
Title: Future of Live Entertainment
Speaker: Sven Bliedung von der Heide (Volucap)
Abstract
Kick-Off Event: Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion
26 May 2021
@3IT Berlin/ Hybrid Event
Shaping the future of virtual events together! Read the article about the event here.
Kick-Off Event Virtual LiVe 26 May 2021: General Project Overview
Presented by: Angela Raguse, Fraunhofer IIS // The event was held in German language.
Kick-Off Event Virtual LiVe 26 May 2021: Fraunhofer Technology Presentation
Presented by: AC Coppens, the Catalysts // Christian Weißig, Fraunhofer HHI // Stephan Steglich, Fraunhofer FOKUS // Siegfried Fößel, Fraunhofer IIS // The event was held in German language.
Virtual LiVe – Hybrid Live-Concert in New Format @Kesselhaus Berlin & @Planetarium Bochum with Fraunhofer Technology, December 2021
With the help of interactive streaming technologies, visitors were able to experience a hybrid concert by the artist not only on site in Berlin, but also via the Internet, applaud the artist and exchange ideas with each other. Some of the musicians joined the performance via the Internet, even though they were playing in different locations. In addition, the concert was transmitted to the Planetarium Bochum as a 360° projection and with 3D-Audio sound.
Read the in-depth article about the event here.
Making-Of Hybrid Live Concert
______________________________________________________
Hybrid Live Concert in Berlin, Bochum and at Home
Virtual LiVe Media Coverage
Find all newsarticles here (click on the titles below to be redirected):
XR HUB BAVARIA, 19 May 2021
Neues Fraunhofer Projekt: Virtual LiVe – Virtualisierung von Live-Veranstaltungen durch audiovisuelle Immersion
Fraunhofer Heinrich-Hertz-Institut, HHI, 25 May 2021
Neues Fraunhofer Projekt: Virtual LiVe – Virtualisierung von Live-Veranstaltungen durch audiovisuelle Immersion
BLACH REPORT, 11 June 2021
Virtual LiVe: Neues Fraunhofer Projekt zur Virtualisierung von Live-Veranstaltungen
PRO MEDIA NEWS.de, 14 June 2021
Neues Fraunhofer Projekt zur Virtualisierung von Live-Events durch audiovisuelle Immersion
INFODIGITAL, 6 December 2021
Laborkonzert zeigt Möglichkeiten hybrider Live-Events mit Fraunhofer-Technologien
FKTG, 11 December 2021
Hybrides Live-Konzert mit 360°-Projektion und 3D-Audio
FKT, 14 December 2021
“Virtual LiVe”: Neue Konzepte für hybride Live-Veranstaltungen
BLACH REPORT, 20 December 2021
Virtual LiVe: Fraunhofer-Team validiert hybrides Konzert
StageReport, 21 December 2021
Virtual LiVe: Fraunhofer-Team validiert hybrides Konzert
EVENT PARTNER, 9 February 2022
Virtual LiVe: Forschung an immersiven Events
AV Magazine, 10 February 2022
Ultra-low latency stream brings remote musicians together
Avant Première, 15 February 2022
Panel on Audiovisual Immersion: ‘Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion’
EVENT PARTNER, 24 February 2022
Virtual LiVe: Hybrides Laborkonzert als immersives, digitales & interaktives Erlebnis
FKT, 4 March 2022
“Virtual LiVe”: Hybrides Live-Konzert mit Fraunhofer-Technologie
The communication of the newsletter is in German.
If you’re already subscribed to the 3IT newsletter and also want to receive the Virtual LiVe newsletter, please contact us.
Technical Contact: Immersive A/V Streaming & Platform Capabilities
Real-Time Immersive AV Streaming // DRM, ad-based Models, Interaction and Social Media Integration // Scalable Playback (Smartphone, Web, VR / AR, Dome)
Name |
Expertise |
Position |
Contact |
|
 |
Dr. Stephan Steglich | Transmission and playback of immersive media, interaction | Fraunhofer FOKUS Head of Department Future Applications and Media |
|
 |
Dr. Louay Bassbouss | Web Technologies, Standardization (W3C, HbbTV, CTA), Media Streaming | Fraunhofer FOKUS Senior Project Manager, Business Area FAME |
Technical Contact: Immersive Video Recording and Encoding
360°-Video // Volumetric Video // Video Coding (H.26x)
Name |
Expertise |
Position |
Contact |
|
 |
Christian Weissig | 360 degree video, volumetric video |
Fraunhofer HHI Head of Capture & Display Systems Group |
|
 |
Thomas Koch | 360 degree video, volumetric video |
Fraunhofer HHI Project Manager at the Capture & Display Systems Group |
Technical Contact: Immersive Audio Technologies and 6DoF Light-Field Rendering
3D-Audio (MPEG-H) // High-Quality Audio Communication (EVS) // Immersive Image-Based Rendering (Light-field)
Name |
Expertise |
Position |
Contact |
|
 |
Dr. Michel Bätz | Light-field, MPEG-I | Fraunhofer IIS Sub-project leader Virtual LiVe IIS |
|
 |
Dr. Ulli Scuda | Immersive and object based audio, binaural audio, MPEG-H, interactive audio | Fraunhofer IIS Head of Group, SoundLab |
PROJECT PARTNERS
