VVoW – Volumetric Video Workflow

VVoW is a new project run by the 3IT partners Trotzkind GmbH, reallifefilm international GmbH and the Fraunhofer HHI’s Vision and Imaging Technologies Department.

Using the new volumetric video studio, which is part of the 3IT facilities, the aim of VVoW is a new 3D reconstruction and modelling method for real people based on a multi-camera recording system. The new system will be used for future film productions, walk-in entertainment and infotainment experiences.

Until today, the integration of real content into virtual and augmented reality application is only possible to a limited extent. Virtual characters are only realistic to a certain degree when one, for instance, regards the diversity of facial expressions and details in the movement of cloths.

In order to develop a marketable recording and production system for the integration of real recorded content into virtual reality (VR) applications and to evaluate and develop the production process further, the realization of the project needs to accommodate certain requirements.

First, methods for the temporal stabilization of dynamic 3D models need to be provided. Second, mesh reduction and smoothing techniques need to be developed. Third, for a successful realization of the project plug-ins for commercial 3D post-production tools for efficient post-processing of 3D meshes are required. Thereby, the volumetric video studio – that is a multi-camera recording system consisting of 32 cameras and 120 light panels positioned around the filmed object or person developed by Fraunhofer HHI – creates the conditions for the successful realization of a volumetric video workflow.

VVoW is co-financed by the European Regional Development Fund (ERDF).

For further information, take a look at the website of VVOW.

“Virtual Play, after Samuel Beckett”

V-SENSE conducts creative experiments to explore the new potential opened by its cutting edge technologies when combined with creative arts in real productions. In collaboration with the School of Drama and the School of Engineering of Trinity College Dublin, V-SENSE produced a reinterpretation of Samuel Beckett’s ground-breaking 1963 text “Play” with a view to engaging a 21st century viewership that is increasingly accessing content via virtual reality technologies. The viewer is immersed into the play and can interact in six degrees of freedom (6DoF). The technology used for this production called “Virtual Play, after Samuel Beckett” was meanwhile spun out into a startup company, Volograms Limited. The production itself received the NEM Art Award in November 2017 and was submitted to other festivals too.

For more details and a video, check out the website of V-SENSE.


V-SENSE is a team of 20+ researchers (half postdocs half PhDs) in visual computing at the intersection of Computer Vision, Computer Graphics and Media Signal Processing. We are building a dynamic environment where enthusiastic young scientists with different backgrounds get together to shape the future in fundamental as well as applied research projects. Directions include but are not limited to:

  • Augmented, Virtual and Mixed Reality (AR/ VR/ MR)
  • Free View-point Video (FVV)
  • 360-Video
  • Light-Field Technologies
  • Visual Effects and Animation

The research project “V-SENSE – Extending Visual Sensation through Image-Based Visual Computing” is funded by SFI over five years with a substantial budget to cover over 20 researchers. This is part of a strategic investment in creative technologies by SFI and Trinity College, which is defined as one of the strategic research themes of the college. V-Sense intends to become an incubator in this context, to stimulate further integration and growth and to impact creative industries in Ireland as a whole.

V-SENSE aims to establish Trinity College Dublin as a world leading center of excellence in creative technologies, as part of an even bigger endeavor to establish Dublin and Ireland as a center of creative industries in general, including technology and creative production.

For more information and details click here.

AIS Awards Kathleen Schröter with the AIS Distinguished Leadership Award 2018

In January 2018 the Advanced Imaging Society (AIS) honored 13 women in entertainment, arts and technology with the Distinguished Leadership Award. Kathleen Schröter, Head of Marketing and Corporate Communications at Fraunhofer Heinrich Hertz Institute, HHI, received the award for her efforts to bring the scientific approaches of imaging technologies into the media industry. She accepted the award at the official luncheon in Beverly Hills.
Kathleen is the Executive Manager of the 3IT Innovation Center for Immersive Imaging Technologies since its founding in 2011 (as 3D Innovation Center at that time) and leads the Marketing and Corporate Communications department of Fraunhofer HHI since October 2014.
Managing the 3IT lead to understanding the industry and so she started to host, curate, and moderate events with a focus on digital media and immersive technologies. In her numerous speeches at different conferences, she translates academic scientific approaches into real use cases and daily life scenarios.
Jim Chabin, President of the AIS, explains: “The jury concluded that Kathleen is known for her outstanding ability to connect the scientific and academic research communities with senior entertainment industry stakeholders. A leader with her level of accomplishments in both of these industries is rarely found”.
Please find more information in the press release on the Fraunhofer HHI Homepage.

Fraunhofer HHI’s 3D Human Body Reconstruction Honoured with AIS Technology Innovation Award 2018

Each year the Advanced Imaging Society (AIS) honors outstanding technical achievements in the entertainment, arts and technology sector. Developers of technologies and processes, which have demonstrated both innovation and impact in advancing the creation or delivery of quality content, are awarded.
In particular, Fraunhofer HHI won the AIS Technology Innovation Award 2018 for the development of the 3D Human Body Reconstruction.
The 3D Human Body Reconstruction technology captures real persons with multiple cameras simultaneously and uses the video information to create a natural moving dynamic 3D model, which can be viewed from 360 degrees and can be placed into any virtual environment.
Please find more information in the press release on the Fraunhofer HHI Homepage.

Homestory – design akademie berlin

The design akademie berlin, SRH Hochschule für Kommunikation und Design has been a partner of the 3IT, former 3DIC, from the very beginning. Professor Sebastian Denz is a representative of the university and focuses on 3D photography and spatial media. He started to participate in networking events of the 3IT in 2012, where he met other professionals from the economic as well as the science sector. He was able to introduce the 3D research group (3DFG) to them, consisting of teachers and students who are interested in the field of 3D and want to take part in the development and design of 3D content. “The strength of three-dimensional processes is, at the same time, their great weakness. In many of the works I’m familiar with, the medium does actually force its way into the foreground, so that the form displaces the content, reducing the work to a mere ‘3D effect’. We have to think design in spatial dimensions, find a new vocabulary and storytelling.” (Sebastian Denz)

Apart from the university’s collaborations with other partners of the 3IT, Sebastian Denz also integrated the innovation center’s facilities into his 3D photography class – the studio and cinema for example have been used by students numerous times. Resources were joint, new technologies tested and innovations were presented to diversified audiences. In 2015 a new photography bachelor degree studypath (B. A. Fotografie) was established at the design akademie berlin. Its focus lies on visual media including 3D, CGI, 360°, VR and AR. There are a couple of intersections with the 3IT that were incorporated into the concept from the start. In June 2016 the 3IT team came to the design akademie berlin for a visit to introduce themselves to the students of the new studypath and to take a look at the recently refurnished building of the university.

ZWISCHEN RAUM, which translates to “space” or “room in-between” is an experimental installation of the increase of immersion in virtual reality. The project is at the same time a very successful bachelor thesis, realized by Adrian Staude and supervised by professor Sebastian Denz and Jörg Frohnmayer. The goal was to develop a prototype that gives a new perspective on immersion through virtual reality. One person/viewer is participating in a VR computer game via head mounted display and joystick while at the same time another person is using several props so that other senses of the viewer besides sight and touch are involved as well.

ZWISCHEN RAUM was exhibited at the 3IT VR Workshop that took place at Fraunhofer Heinrich Hertz Institute in 2016 as well as at Performersion – Days of Performing & Immersive Arts at Kühlhaus, a cooperation of the re:publica 2016, one of the largest and diverse conferences about digital culture in the world. Read more…


PAREIDOLIA is the title of the bachelor thesis carried out by Mila Albrecht. It is named after the phenomenon that the human brain can recognize faces and objects in patterns, structures and forms. The project was supervised by professor Sebastian Denz and Kirstin Weppner. The former student developed a device she called “Pareidoskop”, which gives the viewer the possibility to see the world upside down, isolated from the environment. This manipulation allows the person using the gadget to discover pareidolia, because the common masks of the human brain are disrupted. Mila Albrecht produced a book with a collection of pictures documenting the discoveries with the “Pareidoskop”. The device has to be used with an iPhone, in some sense a controversial medium that is said to be very engaging, to a point that its users have a restricted perception of their surroundings. In this case, the phone is used to counteract, because the viewer has the chance to perceive his or her environment in a new way with a different perspective.

Real-time Depth and Distance Measurement by Means of Stereo Endoscopy

New algorithms and demonstrators are being developed to enable a promising use of stereophotogrammetry for new application fields in the near future within the framework of the BMWi funded project 3DInMed.

The article “3D-Endoskopie: Kinotechnik für die berührungslose Vermessung”, by Jean-Claude Rosenthal from Fraunhofer Heinrich Hertz Institute and Johannes Ruhhammer from SCHÖLLY FIBEROPTIC GmbH is the cover story in the current issue of the German trade journal photonik.

To sum it up, the article presents a new image-based stereometric system based on new algorithms. These algorithms allow real-time depth and distance measurement by means of stereoscopic endoscopy. The images that are being recorded with stereo borescopes can be displayed in 3D on any conventional 3D display via known stereo representation. The resulting improvement of the depth perception ensures an intuitive and quick navigation of the inspection site.

The algorithms used for the depth and distance measurement are based on the principle of stereo triangulation which is an established procedure in optical measurement. The big advantages of stereoscopic measuring systems are an improved measuring methodology and an easy user guidance through the in real-time generated disparity information.

Please find the detailed article in German (!) available for download here.

MAGENTA VIRTUAL REALITY – Easy Access to the Virtual Worlds for Everyone.

Deutsche Telekom invites you to experience new virtual worlds easily and for free (individual data rates may apply). With its Magenta Virtual Reality app, Telekom provides some of the best VR and 360° contents in the areas of sports, music, e-learning and entertainment. In addition to VR content produced exclusively for Telekom, you have access to partner content, for example of Red Bull, National Geographic and Twentieth Century Fox. Witness new, exclusive and regularly added VR content, such as:

• Red Bull: Rally 360° and Surfing 360°
• National Geographic: Glowworm Caves of New Zealand and 360° Victoria Falls – The Devil’s Pool
• Telekom exclusive: Freistoß – FC Bayern training in 360° with Franck Ribéry, Joshua Kimmich and Kingsley Coman

Furthermore, exclusive VR App Deals are waiting for Telekom customers using Android smartphones. Once registered in their account, they are enabled to try out selected games or e-learning courses free of charge for a limited time.

With or without VR glasses, the Magenta VR portal enables you to join virtual reality through different devices, such as Google Daydream, Samsung Gear VR and even simple cardboards. Even without any additional technical equipment, you can experience amazing videos and games on your browser with its “magic window” mode.

Download the app Magenta Virtual Reality to your smartphone for free now!

Click here to enter Magenta Virtual Reality.

New Partner Schneider Digital

We are happy to announce that Schneider Digital is now part of our 3IT partner network. As a manufacturer of professional 3D/VR/AR hardware Schneider Digital completes our partner portfolio with innovative solutions for all target groups with high-end needs for performance, system stability and high quality in daily professional use.
The Schneider Digital product portfolio contains high res displays from 23‘‘ to 98‘‘, passive stereo monitors, VR-powerwalls, performance workstations, professional graphics cards and innovative 3D/VR/AR input devices, and peripherie like CAD mouse devices, tracking and much more to achieve a complete solution.
One of Schneider’s brand-new 4K passive 3D-stereo displays – 3D PluraView can be viewed in our showroom. It includes all 3D capable software applications for different industrial and research fields of use. The flicker free and highbright 4K monitor shows GIS and mapping application examples with Terrasolid, Trimble and Hexagon as well as 3D-CAD, design and rendering software like Siemens NX and Autodesk VRED. Check out this website for more details.

TOA – Tech Open Air 2017 Berlin

In 2012 a couple of people from Berlin’s start-up scene came together to create a new kind of festival with the intention to build a bridge between technology, music, art and science worlds. This year TOA is taking place at Funkhaus Berlin, 11 – 14 July 2017. Don’t miss the diverse conference that includes various formats like presentations, Think Tanks and even morning meditations.

It is the world’s first crowdfunded festival and is therefore part of the leading interdisciplinary technology festivals in Europe. People from different disciplines invest their time in this festival to pass on their knowledge and passion to others.

TOA will also host over 200 unique satellite events all across the city. They allow participants to take over the festival and transform Berlin’s creative community into an interactive hub for tech. Attendees get the chance to talk to leading experts, as well as creating their own products in 3D printing workshops and more. On Friday, 14 July 2017, a satellite event will also take place at Fraunhofer Heinrich Hertz Institute.

Fraunhofer HHI showcases its collaboration platforms and showrooms, where you can experience the latest innovations in Smart and Big Data and Immersive Imaging Technologies like VR, AR and 360° panoramas. The tours include the Smart Data Forum, TiME Lab, the 3IT and the VR experience Human Body Reconstruction including a little Q&A with drinks and light snacks.

Find more information about the satellite events here.

Register here.

Stereopsia is Proud to Announce the Launch of its Calls 2017

Researchers with novel scientific and/or technical results on the general topic of “3D immersion” are invited to submit their 4 to 8 page papers to the 7th edition of the peer-reviewed International Conference on 3D Immersion (IC3D) by 17 July 2017. 

Producers are invited to submit their best 3D contents for cinema, TV, and VR (preferably cinematic VR) produced in Europe, the Middle East or Africa (EMEA) to the Awards Competition by 1 September 2017. 

Independent producers with projects in development for a 3D film (theatrical release) or a 3D VR film (for VR devices/platforms) are invited to submit their projects to the 2nd edition of the 3D Film Booster (3DFB) by 15 September 2017.

The winners of the best scientific paper and of the best 3D contents for cinema, TV, and VR will receive Lumiere Awards from the Advanced Imaging Society and VR Society. All Stereopsia awards will be given out at the Awards Dinner in the beautiful “Salle Horta” of the Center for Fine Arts (BOZAR) in Brussels, Belgium on 13 December 2017. More info about Stereopsia (ex 3D Stereo MEDIA) here.