Tech-invite 3GPPspecs RFCs

Gen 21 22 23 24 25 26 27 28 29 31 32 33 34 35 36 37 38 4‑5x
Fs NEs RPs SBIs IDs T_i+

TS 26.118 (SA4) ★
3GPP Virtual Reality Profiles
for Streaming Applications

3GPP‑Page ETSI‑search

use "3GPP‑Page" to get the Word version
use "ETSI‑search" to get the PDF version
for a better overview, the Table of Contents (ToC) is reproduced

V15.2.0 (PDF) 2019/09 71 p.

Rapporteur: Dr. Stockhammer, Thomas

This specification provides technologies for interoperable Virtual Reality services with focus on streaming and consumption. Virtual Reality (VR) is the ability to be virtually present in a space created by the rendering of natural and/or synthetic image and sound correlated by the movements of the immersed user allowing interacting with that world. Suitable media formats for providing immersive experiences are specified to enable Virtual Reality Services in the context of 3GPP bearer and user services.

The present document defines interoperability points for Virtual Reality for streaming services. Specifically, this document defines rendering scheme requirements, media profiles and presentation profiles for Virtual Reality. The specification builds on the findings and conclusions in TR 26.918.

full Table of Contents for TS 26.118 Word version: 15.2.0

1 Scope Word-p. 8

3 Definitions, symbols and abbreviations Word-p. 9

3.1 Definitions

3.3 Abbreviations

4 Architectures and Interfaces for Virtual Reality Word-p. 10

4.1 Definitions and Reference Systems

4.1.2 3GPP 3DOF Coordinate System Word-p. 11

4.1.3 Video Signal Representation Word-p. 13

4.1.4 Audio Signal Representation Word-p. 14

4.2 End-to-end Architecture Word-p. 15

4.3 Client Reference Architecture Word-p. 17

4.4 Rendering Schemes, Operation Points and Media Profiles Word-p. 18

4.5 Audio Rendering Word-p. 20

4.5.1 Audio Renderer Definitions

4.5.1.1 Reference Renderer

4.5.1.2 Common Informative Binaural Renderer (CIBR)

4.5.1.3 External Renderer Word-p. 21

4.5.1.4 Common Renderer API Word-p. 22

4.5.1.5 External Renderer API

4.5.1.6 Rendering Test

5.1 Video Operation Points

5.1.1 Definition of Operation Point

5.1.2 Parameters of Visual Operation Point Word-p. 23

5.1.3 Operation Point Summary

5.1.4 Basic H.264/AVC Word-p. 24

5.1.4.1 General

5.1.4.2 Profile and level

5.1.4.3 Aspect Ratios and Spatial resolutions Word-p. 25

5.1.4.4 Colour information

5.1.4.5 Frame rates

5.1.4.6 Random access point Word-p. 26

5.1.4.7 Sequence parameter set

5.1.4.8 Video usability information

5.1.4.9 Omni-directional Projection Format

5.1.4.10 Restricted Coverage

5.1.4.11 Other VR Metadata

5.1.4.12 Receiver Compatibility Word-p. 27

5.1.5 Main H.265/HEVC

5.1.5.1 General

5.1.5.2 Profile and level

5.1.5.3 Bit depth

5.1.5.4 Spatial Resolutions Word-p. 28

5.1.5.5 Colour information and Transfer Characteristics

5.1.5.6 Frame rates

5.1.5.7 Random access point Word-p. 29

5.1.5.8 Video and Sequence Parameter Sets

5.1.5.9 Video usability information

5.1.5.10 Omni-directional Projection Formats Word-p. 30

5.1.5.11 Restricted Coverage

5.1.5.12 Viewport-Optimized Content

5.1.5.13 Frame packing arrangement

5.1.5.14 Other VR Metadata

5.1.5.15 Receiver Compatibility Word-p. 31

5.1.6 Flexible H.265/HEVC

5.1.6.1 General

5.1.6.2 Profile and level

5.1.6.3 Bit depth Word-p. 32

5.1.6.4 Spatial Resolutions

5.1.6.5 Colour information and Transfer Characteristics

5.1.6.6 Frame rates Word-p. 33

5.1.6.7 Random access point

5.1.6.8 Video and Sequence Parameter Sets

5.1.6.9 Video usability information Word-p. 34

5.1.6.10 Omni-directional Projection Formats

5.1.6.11 Restricted Coverage

5.1.6.12 Viewport-Optimized Content

5.1.6.13 Frame packing arrangement Word-p. 35

5.1.6.14 Other VR Metadata

5.1.6.15 Receiver Compatibility

5.2 Video Media Profiles

5.2.1 Introduction and Overview

5.2.2 Basic Video Media Profile Word-p. 36

5.2.2.1 Overview

5.2.2.2 File Format Signaling and Encapsulation

5.2.2.3 DASH Integration Word-p. 37

5.2.2.3.1 Definition

5.2.2.3.2 Additional Restrictions for DASH Representations

5.2.2.3.3 DASH Adaptation Set Constraints Word-p. 38

5.2.3 Main Video Media Profile Word-p. 39

5.2.3.1 Overview

5.2.3.2 File Format Signaling and Encapsulation

5.2.3.3 DASH Integration Word-p. 41

5.2.3.3.1 Definition

5.2.3.3.2 Additional Restrictions for DASH Representations

5.2.3.3.3 DASH Adaptation Set Constraints

5.2.3.3.4 Adaptation Set Ensembles for Viewport-Optimized offering Word-p. 43

5.2.4 Advanced Video Media Profile Word-p. 44

5.2.4.1 Overview

5.2.4.2 File Format Signaling and Encapsulation

5.2.4.3 DASH Integration Word-p. 46

5.2.4.3.1 Definition

5.2.4.3.2 Additional Restrictions for DASH Representations

5.2.4.3.3 DASH Adaptation Set Constraints Word-p. 47

5.2.4.3.4 Adaptation Set Constraints for Viewport Selection Word-p. 49

6 Audio Word-p. 50

6.1 Audio Operation Points

6.1.1 Definition of Operation Point

6.1.2 Parameters of Audio Operation Point

6.1.3 Summary of Audio Operation Points

6.1.4 3GPP MPEG-H Audio Operation Point Word-p. 51

6.1.4.1 Overview

6.1.4.2 Bitstream requirements

6.1.4.3 Receiver requirements

6.1.4.3.1 General

6.1.4.3.2 Decoding process

6.1.4.3.3 Random Access Word-p. 52

6.1.4.3.4 Configuration change

6.1.4.3.5 MPEG-H Multi-stream Audio Word-p. 53

6.1.4.3.6 Rendering requirements

6.2 Audio Media Profiles Word-p. 55

6.2.1 Introduction and Overview

6.2.2 OMAF 3D Audio Baseline Media Profile

6.2.2.1 Overview

6.2.2.2 File Format Signaling and Encapsulation

6.2.2.2.1 General

6.2.2.2.2 Configuration change constraints

6.2.2.3 Multi-stream constraints Word-p. 56

6.2.2.3a Additional Restrictions for DASH Representations

6.2.2.4 DASH Adaptation Set Constraints

6.2.2.4.1 General

6.2.2.4.2 DASH Adaptive Bitrate Switching

7.1 Presentation without Pose Information to 2D Screens

8 VR Presentation Word-p. 57

8.2 3GPP VR File

8.3 3GPP VR DASH Media Presentation

A Content Generation Guidelines Word-p. 58

A.1 Introduction

A.2.2 Decoded Texture Signal Constraints

A.2.2.1 General

A.2.2.2 Constraints for Main and Flexible H.265/HEVC Operation Point

A.2.3 Conversion of ERP Signals to CMP Word-p. 59

A.2.3.1 General

A.2.3.2 Equirectangular Projection (ERP) Word-p. 60

A.2.3.3 Cubemap Projection (CMP) Word-p. 61

A.2.3.4 Conversion between two projection formats Word-p. 62

B Example External Binaural Renderer Word-p. 63

C Registration Information Word-p. 68

C.1 3GPP Registered URIs

D Change history Word-p. 69