The advances in imaging technologies in the last decade brought several alternatives to the way we acquire and display visual information. These new imaging technologies are immersive as they provide the viewer with more information which either surrounds the viewer or helps the viewer to be immersed in this augmented representation. These immersive imaging technologies include omnidirectional video, light fields, and volumetric (also known as free viewpoint) video. These three different modalities cover the full spectrum of immersive imaging, from 3 degrees of freedom (DoF) to 6DoF and can be used for virtual reality (VR) as well as augmented reality (AR). Applications of immersive imaging notably include education, cultural heritage, tele-immersion, remote collaboration, and communication.
In this tutorial, we cover all stages of the immersive imaging technologies from content capture to display and quality assessment. In particular, we discuss the learning-based approaches on the relevant stages of immersive imaging pipeline. We first introduce the main concepts of immersive imaging and their creative experiments. Next, we present content acquisition systems, followed by content creation and the corresponding data formats. Content delivery is then discussed, notably ongoing coding standardisation efforts, followed by adaptive streaming strategies. Immersive imaging displays are then presented, as they play a crucial role in the user’s sense of immersion. Image rendering algorithms related to such displays are also explained. Finally, perception and quality evaluation of immersive imaging is presented.