At NAB Show 2018 in Las Vegas Fraunhofer HHI will present a future video coding proposal beyond HEVC, 3D Human Body Reconstruction for VR and AR, and continuous live video streaming of high-resolution 360-degree video for virtual reality (VR360) at Fraunhofer Booth SU4916. These innovations are presented shortly in the following as well as a list of 3IT partners who also exhibit at this year’s NAB Show.
1. Future Video Coding beyond HEVC
One of the future needs is efficient video compression that goes beyond the current state of the art High Efficiency Video Coding standard (HEVC). In order to master this demanding challenge, the Joint Video Experts Team (JVET) issued a call for proposals for video coding technology with compression capability beyond HEVC. Fraunhofer HHI has responded to the call by submitting cutting edge coding technology. The new standard is planned to be finalized by 2020. At NAB 2018, Fraunhofer HHI will display its codec to the public for the first time. Significant coding efficiency improvements over HEVC are shown for content ranging from standard High Definition (HD) to High Dynamic Range Ultra-HD content.
2. 3D Human Body Reconstructions for Virtual and Augmented Reality
Fraunhofer HHI is presenting a novel and uniquely integrated 360-degree multi-camera capture and lighting system for the creation of highly realistic Volumetric Video content of moving persons. A set of 16 stereo cameras create 3D information from all different viewpoints around the person. This 3D information is then fused and transformed into a consistent, natural and dynamic 3D representation of the person.The automatically computed sequence of meshes can be integrated in VR and AR applications. The capture system supports diffuse lighting from any direction, which offers best possible conditions for re-lighting of the dynamic 3D models, afterwards, at the design stage of the virtual reality experience.
3. Live End to End Streaming of VR360 10K Video with MPEG-OMAF and HEVC Tiles
At NAB, Fraunhofer HHI presents the world’s first demonstrator for continuous live video streaming of VR360 videos with a resolution beyond 4K. This includes high-resolution VR360 10K video capturing and live rendering from the Fraunhofer HHI Omnicam-360, tile-based live encoding with the Fraunhofer HHI HEVC encoder, packaging according to the MPEG-OMAF Viewport-Dependent Media Profile and high-quality playback on VR glasses and TV screens.
For further information see also the Fraunhofer HHI website.
List of Partners Exhibiting at the NAB Show with Booth Number
ARRI Central Hall – C7925
Fraunhofer IIS South Hall (Upper) – SU4916 (joint Booth with Fraunhofer HHI)
Dolby South Hall (Upper) – SU1702
Lawo North Hall & Central Lobby – N2813
Rohde & Schwarz South Hall (Lower) – SL6610
Sony Central Hall – C11001