VVoW – Volumetric Video Workflow

VVoW is a new project run by the 3IT partners Trotzkind GmbH, reallifefilm international GmbH and the Fraunhofer HHI’s Vision and Imaging Technologies Department.

Using the new volumetric video studio (VoluCap), which is part of the 3IT facilities, the aim of VVoW is a new 3D reconstruction and modelling method for real people based on a multi-camera recording system. The new system will be used for future film productions, walk-in entertainment and infotainment experiences.

Until today, the integration of real content into virtual and augmented reality application is only possible to a limited extent. Virtual characters are only realistic to a certain degree when one, for instance, regards the diversity of facial expressions and details in the movement of cloths.

In order to develop a marketable recording and production system for the integration of real recorded content into virtual reality (VR) applications and to evaluate and develop the production process further, the realization of the project needs to accommodate certain requirements.

First, methods for the temporal stabilization of dynamic 3D models need to be provided. Second, mesh reduction and smoothing techniques need to be developed. Third, for a successful realization of the project plug-ins for commercial 3D post-production tools for efficient post-processing of 3D meshes are required. Thereby, the volumetric video studio (VoluCap) – that is a multi-camera recording system consisting of 32 cameras and 120 light panels positioned around the filmed object or person developed by Fraunhofer HHI – creates the conditions for the successful realization of VVOW.

VVOW is co-financed by the European Regional Development Fund (ERDF).

For further information, take a look at the website of VVOW.

“Virtual Play, after Samuel Beckett”

V-SENSE conducts creative experiments to explore the new potential opened by its cutting edge technologies when combined with creative arts in real productions. In collaboration with the School of Drama and the School of Engineering of Trinity College Dublin, V-SENSE produced a reinterpretation of Samuel Beckett’s ground-breaking 1963 text “Play” with a view to engaging a 21st century viewership that is increasingly accessing content via virtual reality technologies. The viewer is immersed into the play and can interact in six degrees of freedom (6DoF). The technology used for this production called “Virtual Play, after Samuel Beckett” was meanwhile spun out into a startup company, Volograms Limited. The production itself received the NEM Art Award in November 2017 and was submitted to other festivals too.

For more details and a video, check out the website of V-SENSE.


V-SENSE is a team of 20+ researchers (half postdocs half PhDs) in visual computing at the intersection of Computer Vision, Computer Graphics and Media Signal Processing. We are building a dynamic environment where enthusiastic young scientists with different backgrounds get together to shape the future in fundamental as well as applied research projects. Directions include but are not limited to:

  • Augmented, Virtual and Mixed Reality (AR/ VR/ MR)
  • Free View-point Video (FVV)
  • 360-Video
  • Light-Field Technologies
  • Visual Effects and Animation

The research project “V-SENSE – Extending Visual Sensation through Image-Based Visual Computing” is funded by SFI over five years with a substantial budget to cover over 20 researchers. This is part of a strategic investment in creative technologies by SFI and Trinity College, which is defined as one of the strategic research themes of the college. V-Sense intends to become an incubator in this context, to stimulate further integration and growth and to impact creative industries in Ireland as a whole.

V-SENSE aims to establish Trinity College Dublin as a world leading center of excellence in creative technologies, as part of an even bigger endeavor to establish Dublin and Ireland as a center of creative industries in general, including technology and creative production.

For more information and details click here.

AIS Awards Kathleen Schröter with the AIS Distinguished Leadership Award 2018

In January 2018 the Advanced Imaging Society (AIS) honored 13 women in entertainment, arts and technology with the Distinguished Leadership Award. Kathleen Schröter, Head of Marketing and Corporate Communications at Fraunhofer Heinrich Hertz Institute, HHI, received the award for her efforts to bring the scientific approaches of imaging technologies into the media industry. She accepted the award at the official luncheon in Beverly Hills.
Kathleen is the Executive Manager of the 3IT Innovation Center for Immersive Imaging Technologies since its founding in 2011 (as 3D Innovation Center at that time) and leads the Marketing and Corporate Communications department of Fraunhofer HHI since October 2014.
Managing the 3IT lead to understanding the industry and so she started to host, curate, and moderate events with a focus on digital media and immersive technologies. In her numerous speeches at different conferences, she translates academic scientific approaches into real use cases and daily life scenarios.
Jim Chabin, President of the AIS, explains: “The jury concluded that Kathleen is known for her outstanding ability to connect the scientific and academic research communities with senior entertainment industry stakeholders. A leader with her level of accomplishments in both of these industries is rarely found”.
Please find more information in the press release on the Fraunhofer HHI Homepage.

Fraunhofer HHI’s 3D Human Body Reconstruction Honoured with AIS Technology Innovation Award 2018

Each year the Advanced Imaging Society (AIS) honors outstanding technical achievements in the entertainment, arts and technology sector. Developers of technologies and processes, which have demonstrated both innovation and impact in advancing the creation or delivery of quality content, are awarded.
In particular, Fraunhofer HHI won the AIS Technology Innovation Award 2018 for the development of the 3D Human Body Reconstruction.
The 3D Human Body Reconstruction technology captures real persons with multiple cameras simultaneously and uses the video information to create a natural moving dynamic 3D model, which can be viewed from 360 degrees and can be placed into any virtual environment.
Please find more information in the press release on the Fraunhofer HHI Homepage.

Homestory – design akademie berlin

The design akademie berlin, SRH Hochschule für Kommunikation und Design has been a partner of the 3IT, former 3DIC, from the very beginning. Professor Sebastian Denz is a representative of the university and focuses on 3D photography and spatial media. He started to participate in networking events of the 3IT in 2012, where he met other professionals from the economic as well as the science sector. He was able to introduce the 3D research group (3DFG) to them, consisting of teachers and students who are interested in the field of 3D and want to take part in the development and design of 3D content. “The strength of three-dimensional processes is, at the same time, their great weakness. In many of the works I’m familiar with, the medium does actually force its way into the foreground, so that the form displaces the content, reducing the work to a mere ‘3D effect’. We have to think design in spatial dimensions, find a new vocabulary and storytelling.” (Sebastian Denz)

Apart from the university’s collaborations with other partners of the 3IT, Sebastian Denz also integrated the innovation center’s facilities into his 3D photography class – the studio and cinema for example have been used by students numerous times. Resources were joint, new technologies tested and innovations were presented to diversified audiences. In 2015 a new photography bachelor degree studypath (B. A. Fotografie) was established at the design akademie berlin. Its focus lies on visual media including 3D, CGI, 360°, VR and AR. There are a couple of intersections with the 3IT that were incorporated into the concept from the start. In June 2016 the 3IT team came to the design akademie berlin for a visit to introduce themselves to the students of the new studypath and to take a look at the recently refurnished building of the university.

ZWISCHEN RAUM, which translates to “space” or “room in-between” is an experimental installation of the increase of immersion in virtual reality. The project is at the same time a very successful bachelor thesis, realized by Adrian Staude and supervised by professor Sebastian Denz and Jörg Frohnmayer. The goal was to develop a prototype that gives a new perspective on immersion through virtual reality. One person/viewer is participating in a VR computer game via head mounted display and joystick while at the same time another person is using several props so that other senses of the viewer besides sight and touch are involved as well.

ZWISCHEN RAUM was exhibited at the 3IT VR Workshop that took place at Fraunhofer Heinrich Hertz Institute in 2016 as well as at Performersion – Days of Performing & Immersive Arts at Kühlhaus, a cooperation of the re:publica 2016, one of the largest and diverse conferences about digital culture in the world. Read more…


PAREIDOLIA is the title of the bachelor thesis carried out by Mila Albrecht. It is named after the phenomenon that the human brain can recognize faces and objects in patterns, structures and forms. The project was supervised by professor Sebastian Denz and Kirstin Weppner. The former student developed a device she called “Pareidoskop”, which gives the viewer the possibility to see the world upside down, isolated from the environment. This manipulation allows the person using the gadget to discover pareidolia, because the common masks of the human brain are disrupted. Mila Albrecht produced a book with a collection of pictures documenting the discoveries with the “Pareidoskop”. The device has to be used with an iPhone, in some sense a controversial medium that is said to be very engaging, to a point that its users have a restricted perception of their surroundings. In this case, the phone is used to counteract, because the viewer has the chance to perceive his or her environment in a new way with a different perspective.

New Partner Schneider Digital

We are happy to announce that Schneider Digital is now part of our 3IT partner network. As a manufacturer of professional 3D/VR/AR hardware Schneider Digital completes our partner portfolio with innovative solutions for all target groups with high-end needs for performance, system stability and high quality in daily professional use.
The Schneider Digital product portfolio contains high res displays from 23‘‘ to 98‘‘, passive stereo monitors, VR-powerwalls, performance workstations, professional graphics cards and innovative 3D/VR/AR input devices, and peripherie like CAD mouse devices, tracking and much more to achieve a complete solution.
One of Schneider’s brand-new 4K passive 3D-stereo displays – 3D PluraView can be viewed in our showroom. It includes all 3D capable software applications for different industrial and research fields of use. The flicker free and highbright 4K monitor shows GIS and mapping application examples with Terrasolid, Trimble and Hexagon as well as 3D-CAD, design and rendering software like Siemens NX and Autodesk VRED. Check out this website for more details.

Real-time Depth and Distance Measurement by Means of Stereo Endoscopy

New algorithms and demonstrators are being developed to enable a promising use of stereophotogrammetry for new application fields in the near future within the framework of the BMWi funded project 3DInMed.

The article “3D-Endoskopie: Kinotechnik für die berührungslose Vermessung”, by Jean-Claude Rosenthal from Fraunhofer Heinrich Hertz Institute and Johannes Ruhhammer from SCHÖLLY FIBEROPTIC GmbH is the cover story in the current issue of the German trade journal photonik.

To sum it up, the article presents a new image-based stereometric system based on new algorithms. These algorithms allow real-time depth and distance measurement by means of stereoscopic endoscopy. The images that are being recorded with stereo borescopes can be displayed in 3D on any conventional 3D display via known stereo representation. The resulting improvement of the depth perception ensures an intuitive and quick navigation of the inspection site.

The algorithms used for the depth and distance measurement are based on the principle of stereo triangulation which is an established procedure in optical measurement. The big advantages of stereoscopic measuring systems are an improved measuring methodology and an easy user guidance through the in real-time generated disparity information.

Please find the detailed article in German (!) available for download here.

IFA+ Summit: Welcome to the Next Level of Thinking!

IFA+ Summit offers an exclusive platform for leading thinkers, global trendsetters, and creative visionaries. It is the place where innovation, ideas and future projects come together! Spend two inspiring days during IFA – the leading trade show for consumer electronics and home appliances – at IFA+ Summit. You’ll meet with scientists, artists, developers and researchers.

One of them is Paul Chojecki from Fraunhofer HHI, who will be part of a panel on Day 2, 12am – 1pm, “VR – Real Life vs. Fantasy” on the mainstage. At the same time Stephan Heimbecher from 3IT partner Sky Germany can be found in the workshop area in a session which is called “UHD – Beyond Resolution” .

For more information on the IFA+ Summit please click here or download the program.

Date: 4 & 5 September
Location: Berlin ExpoCenter City, Hall 26B

IFA NEXT – The Edge of Innovation

IFA opens a new chapter with its new concept in hall 26 called IFA NEXT – The Edge of Innovation.

Our partner German TV Platform welcomes all IFA visitors in the new hall 26. Researchers, industry professionals, start-ups and retailers meet here to present innovation and technologies, share visions and ideas and drive new developments. Fraunhofer HHI will be part of a joint booth together with the German TV Platform. Additionally, Kathleen Schröter will take part in a press event on 1 September and will moderate the UHD panel on 2 September, featuring two of our partners: SKY Germany and DOLBY Germany.

Press event Date: 1 September
Time: 10 am – 12 pm
Location: Berlin ExpoCenter City, Hall 26B

UHD panel Date: 2 September
Time: 11 am – 12 pm
Location: Berlin ExpoCenter City, Hall 26B

TOA – Tech Open Air 2017 Berlin

In 2012 a couple of people from Berlin’s start-up scene came together to create a new kind of festival with the intention to build a bridge between technology, music, art and science worlds. This year TOA is taking place at Funkhaus Berlin, 11 – 14 July 2017. Don’t miss the diverse conference that includes various formats like presentations, Think Tanks and even morning meditations.

It is the world’s first crowdfunded festival and is therefore part of the leading interdisciplinary technology festivals in Europe. People from different disciplines invest their time in this festival to pass on their knowledge and passion to others.

TOA will also host over 200 unique satellite events all across the city. They allow participants to take over the festival and transform Berlin’s creative community into an interactive hub for tech. Attendees get the chance to talk to leading experts, as well as creating their own products in 3D printing workshops and more. On Friday, 14 July 2017, a satellite event will also take place at Fraunhofer Heinrich Hertz Institute.

Fraunhofer HHI showcases its collaboration platforms and showrooms, where you can experience the latest innovations in Smart and Big Data and Immersive Imaging Technologies like VR, AR and 360° panoramas. The tours include the Smart Data Forum, TiME Lab, the 3IT and the VR experience Human Body Reconstruction including a little Q&A with drinks and light snacks.

Find more information about the satellite events here.

Register here.