1、 ETSI TR 126 918 V15.2.0 (2018-07) Universal Mobile Telecommunications System (UMTS); LTE; Virtual Reality (VR) media services over 3GPP (3GPP TR 26.918 version 15.2.0 Release 15) TECHNICAL REPORT ETSI ETSI TR 126 918 V15.2.0 (2018-07)13GPP TR 26.918 version 15.2.0 Release 15Reference RTR/TSGS-04269
2、18vf20 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document c
3、an be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of
4、any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document ma
5、y be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/portal.e
6、tsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified w
7、ithout the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. ETSI 2018. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are trademarks of ETSI registered for the benefit of its Members. 3GPPTM and LTETMare trademarks of
8、ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. oneM2M logo is protected for the benefit of its Members. GSMand the GSM logo are trademarks registered and owned by the GSM Association. ETSI ETSI TR 126 918 V15.2.0 (2018-07)23GPP TR 26.918 version 15.2.0 Releas
9、e 15Intellectual Property Rights Essential patents IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314
10、: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigatio
11、n, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Trademarks The present document may i
12、nclude trademarks and/or tradenames which are asserted and/or registered by their owners. ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the pr
13、esent document does not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks. Foreword This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or re
14、ports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs termin
15、ology In the present document “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables exce
16、pt when used in direct citation. ETSI ETSI TR 126 918 V15.2.0 (2018-07)33GPP TR 26.918 version 15.2.0 Release 15Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 8g3Introduction 8g31 Scope 9g32 References 9g33 Definitions and abbreviations . 12g33.1 Definit
17、ions 12g33.2 Abbreviations . 12g34 Introduction to Virtual Reality . 13g34.1 Definition . 13g34.1.1 Virtual reality 13g34.1.2 Augmented reality 13g34.1.3 Mixed reality . 13g34.2 Video systems 14g34.2.1 Introduction. 14g34.2.2 Field of view . 14g34.2.2.1 Definition 14g34.2.2.2 Horizontal FOV . 14g34.
18、2.2.3 Vertical FOV. 15g34.2.3 Lenses for a wider FOV 15g34.2.4 Optical aberrations 16g34.2.4.1 Introduction . 16g34.2.4.2 Lens distortion . 16g34.2.4.3 Chromatic aberration . 17g34.2.5 VR Video systems 17g34.2.5.1 Introduction . 17g34.2.5.2 Capture 18g34.2.5.3 Sphere stitching . 19g34.2.5.4 Projecti
19、on 20g34.2.5.5 Region-wise mapping (packing) . 21g34.2.5.6 Encoding 2 presented to TSG for approval; 3 or greater indicates TSG approved document under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third
20、digit is incremented when editorial only changes have been incorporated in the document. Introduction Virtual Reality (VR) is the ability to be virtually present in a space created by the rendering of natural and/or synthetic image and sound correlated by the movements of the immersed user allowing
21、interacting with that world. The immersive multimedia experience has been an exploration topic for several years. With the recent progress made in rendering devices, such as Head mounted displays (HMD), a significant quality of experience can be offered. Before any possible standardization, it is ne
22、cessary to study the field: - to understand how the equipment used for creating such an immersive experience works, e.g. by collecting information on the optical systems and audio rendering processes; - to evaluate the relevance to Virtual Reality for 3GPP; - to identify the possible points of inter
23、operability, and hence potential standardization. Use cases for Virtual Reality need to be listed and mapped to the already existing 3GPP services if applicable. Media formats required for providing the immersive experience need to be identified and potentially evaluated subjectively so as to extrac
24、t requirements on minimum device and network capabilities. ETSI ETSI TR 126 918 V15.2.0 (2018-07)93GPP TR 26.918 version 15.2.0 Release 151 Scope The scope of the present document is to investigate the relevance of Virtual Reality in the context of 3GPP. Virtual Reality is the ability to be virtuall
25、y present in a non-physical world created by the rendering of natural and/or synthetic image and sound correlated by the movements of the immersed user allowing to interact with that world. With recent progress made in rendering devices, such as Head mounted displays (HMD), a significant quality of
26、experience can be offered. By collecting comprehensive information on VR use cases, existing technologies and subjective quality, the report attempts to identify potential gaps and relevant interoperability points that may require further work and potential standardization in 3GPP in order to suppor
27、t VR use cases and experiences in 3GPP user services. The report primarily focuses on 360 degrees video and associated audio, which support three degrees of freedom (3DOF). 2 References The following documents contain provisions which, through reference in this text, constitute provisions of the pre
28、sent document. - References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. - For a specific reference, subsequent revisions do not apply. - For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP d
29、ocument (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document. 1 3GPP TR 21.905: “Vocabulary for 3GPP Specifications“. 2 Savino, Peter J.; Danesh-Meyer, Helen V. (1 May 2012). Color Atlas and Synopsis
30、 of Clinical Ophthalmology - Wills Eye Institute - Neuro-Ophthalmology. Lippincott Williams Vol 121 Issue 2 pp 211-215. 27 Jombk P, Bahyl V, “Short latency disconjugate vestibulo-ocular responses to transient stimuli in the audio frequency range.“ Journal of Neurology, Neurosurgery, and Psychiatry;
31、Vol 76 No 10, Oct 2005 pp 1398-1402. 28 Amin M.S, “Vestibuloocular Reflex Testing“ Medscape Article Number 1836134, Feb 10 2016. 29 Jerald J, “Scene-Motion- and Latency-Perception Thresholds for Head-Mounted Displays“ University of North Carolina PhD Dissertation, 2010. 30 Brungart et al., “Effects
32、of Headtracker Latency in Virtual Audio Displays“, Proceedings of International Conference on Auditory Display; ICAD-05, July 2005. 31 http:/www.york.ac.uk/inst/mustech/3d_audio/higher_order_ambisonics.pdf. 32 Recommendation ITU-R BT.1359-1 (1998): “Relative Timing of Sound and Vision for Broadcasti
33、ng“. 33 EBU Technical Recommendation R37 (2007): “The relative timing of the sound and vision components of a television signal“. 34 3GPP TS 26.116: “Television (TV) over 3GPP services; Video profiles“. ETSI ETSI TR 126 918 V15.2.0 (2018-07)113GPP TR 26.918 version 15.2.0 Release 1535 ISO/IEC AWI 23
34、090-2: “Coded representation of immersive media - Part 2: Application Format for Omnidirectional Media“ - OMAF. 36 MPEG-H 3D Audio Verification Test Report, Geneva, 2017. http:/mpeg.chiariglione.org/standards/mpeg-h/3d-audio/mpeg-h-3d-audio-verification-test-report. 37 3GPP TS 26.114: “IP Multimedia
35、 Subsystem (IMS); Multimedia telephony; Media handling and interaction“. 38 3GPP TS 26.223: “Telepresence using the IP Multimedia Subsystem (IMS); Media handling and interaction“. 39 3GPP TS 26.247: “Transparent end-to-end Packet-switched, Streaming Service (PSS); Progressive Download and Dynamic Ad
36、aptive Streaming over HTTP (3GP-DASH)“. 40 Jerome Daniel, Spatial Sound Encoding Including Near Field Effect: Introducing Distance Coding Filters and a Viable, New Ambisonic Format, 23rd AES Conference, Copenhagen 2003, p. 13. 41 Recommendation ITU-R BS.2076-0 (06/2015): “Audio Definition Model“. 42
37、 ETSI TS 103 223 (V1.1.1): “MDA; Object-Based Audio Immersive Sound Metadata and Bitstream“. 43 C. Nachbar, F. Zotter, E. Deleflie Part 1: Channel based coding“. 45 ETSI TS 103 190-2 (V1.1.1): “Digital Audio Compression (AC-4) Standard; Part 2: Immersive and personalized audio“. 46 ISO/IEC 23008-3:2
38、015: “Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 3: 3D audio“. 47 ISO/IEC 23008-3:2015/Amd 3:2017; “MPEG-H 3D Audio Phase 2“. 48 Wenzel, E.M. - “Analysis of the Role of Update rate and System Latency in Interactive Virtual Acoustic Environ
39、ments“, 103rdAES Convention, New York, 1997. 49 Sandvad, J. - Dynamic Aspects of Auditory Virtual Environments, 100thAES Convention, Copenhagen, 1996 May 11-14. 50 Michael Chapman et al., A standard for interchange of Ambisonic signal sets, Ambisonics Symposium, Graz 2009. 51 Stitt, P., Hendrickx, E
40、., Messonier, J.C., Katz, B. FG - “Effect of Head Tracking Latency on Binaural Rendering in Simple and Complex Sound Scenes“, 140thAES Convention, 2016 June 4-7, Paris, France. 52 Satoshi Yairi, Yukio Iwaya and Yoiti Suzuki - “Investigation of system latency detection threshold of virtual auditory d
41、isplay“, Proceedings of the 12th International Conference on Auditory Display, London, UK June 20 - 23, 2006. 53 Wenzel, E.M., “Effect of increasing system latency on localization of virtual sounds with short and long duration“, Proceedings of the 7thInternational Conference on Auditory Display, pp.
42、185-190, 2001. 54 Recommendation ITU-R BT.2021-1 (02/2015): “Subjective methods for the assessment of stereoscopic 3DTV systems“. 55 Recommendation ITU-T P.915 (03/2016): “Subjective assessment methods for 3D video“. 56 Brungart, D. S., Kordik, A.K., and Simpson, B.D - “The Detectability of Headtrac
43、ker Latency in Virtual Auditory Displays“ In: Proc. Of ICAD 2005 - 11thMeeting of the International Conference on Auditory Display, Limerick, Ireland, July 6-9, 2005. ETSI ETSI TR 126 918 V15.2.0 (2018-07)123GPP TR 26.918 version 15.2.0 Release 1557 Levitt,H. - “Transformed up-down methods in psycho
44、-acoustics.“ J.Acoust Soc America,49(2), 467-477, 1970. 58 Mackensen, P. - “Auditive Localization, Head Movements, an additional cue in Localization.“ PhD thesis, TU-Berlin, 2004. 59 Klein, S. - “Measuring, estimating, and understanding the psychometric function: A commentary.“, Perception Enhanced
45、aacPlus general audio codec; General description (Release 14). 68 3GPP TS 26.441: “Codec for Enhanced Voice Services (EVS); General overview“. 69 3GPP TR 26.952: “Codec for Enhanced Voice Services (EVS); Performance characterization”. 3 Definitions and abbreviations 3.1 Definitions For the purposes
46、of the present document, the terms and definitions given in 3GPP TR 21.905 1 and the following apply. A term defined in the present document takes precedence over the definition of the same term, if any, in 3GPP TR 21.905 1. diegetic: part of the VR scene and rendered according to HMD head-tracking
47、information non-diegetic: independent of the VR scene and rendered independently of HMD head-tracking information 3.2 Abbreviations For the purposes of the present document, the abbreviations given in 3GPP TR 21.905 1 and the following apply. An abbreviation defined in the present document takes pre
48、cedence over the definition of the same abbreviation, if any, in 3GPP TR 21.905 1. 3DOF 3 Degrees of freedom 6DOF 6 Degrees of freedom ACN Ambisonic Channel Number AOP Acoustic Overload Point BRIR Binaural Room Impulse Response CBA Channel-Based Audio CICP Coding Independent Code Point ETSI ETSI TR
49、126 918 V15.2.0 (2018-07)133GPP TR 26.918 version 15.2.0 Release 15CMAF Common Media Application Format DASH Dynamic Adaptive Streaming over HTTP DAW Digital Audio Workstation EPG Electronic Program Guide ERP Equirectangular projectionFOA First Order Ambisonics FOV Field of view HMD Head Mounted Display HOA High Order Ambisonics HRTF Head-related transfer function M2S Motion to Sound MBMS Multimedia Broadcast Multicast Service MDA Multi-Dimensional Audio mTSL minimum Total System Latency
