1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T P.1203 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (11/2016) SERIES P: TELEPHONE TRANSMISSION QUALITY, TELEPHONE INSTALLATIONS, LOCAL LINE NETWORKS Models and tools for quality assessment of streamed media Parametric bi
2、tstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport Recommendation ITU-T P.1203 ITU-T P-SERIES RECOMMENDATIONS TELEPHONE TRANSMISSION QUALITY, TELEPHONE INSTALLATIONS, LOCAL LINE NETWORKS Vocabulary and effects of transmission
3、parameters on customer opinion of transmission quality Series P.10 Voice terminal characteristics Series P.30 P.300 Reference systems Series P.40 Objective measuring apparatus Series P.50 P.500 Objective electro-acoustical measurements Series P.60 Measurements related to speech loudness Series P.70
4、Methods for objective and subjective assessment of speech quality Series P.80 Methods for objective and subjective assessment of speech and video quality Series P.800 Audiovisual quality in multimedia services Series P.900 Transmission performance and QoS aspects of IP end-points Series P.1000 Commu
5、nications involving vehicles Series P.1100 Models and tools for quality assessment of streamed media Series P.1200 Telemeeting assessment Series P.1300 Statistical analysis, evaluation and reporting guidelines of quality measurements Series P.1400 Methods for objective and subjective assessment of q
6、uality of services other than speech and video Series P.1500 For further details, please refer to the list of ITU-T Recommendations. Rec. ITU-T P.1203 (11/2016) i Recommendation ITU-T P.1203 Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming serv
7、ices over reliable transport Summary Recommendation ITU-T P.1203 provides the introductory document for a set of documents that describe model algorithms for monitoring the integral media session quality for TCP-type video streaming. The models comprise modules for short-term audio- and video-qualit
8、y estimation. The per-one-second outputs of these short-term modules are integrated into estimates of audiovisual quality and, together with information about initial buffering delay and media playout rebuffering events, further integrated into the final model output, the estimate of integral qualit
9、y. The respective ITU-T work item has formerly been referred to as P.NATS (Parametric non-intrusive assessment of TCP-based multimedia streaming quality). The structure of the set of recommendations reflects the different functionality of modules described in each document: ITU-T P.1203: Introductor
10、y document (this Recommendation) ITU-T P.1203.1: Video quality estimation module (short-term, providing per-one-second output information) ITU-T P.1203.2: Audio quality estimation module (short-term, providing per-one-second output information) ITU-T P.1203.3: Audiovisual integration and integration
11、 of final score, reflecting remembered quality for viewing sessions between 30 s and 5 min duration The input used by the models consists of information obtained by prior stream inspection. Four different levels of inspection are included, resulting in models of different complexity both of the inpu
12、t information and the model algorithms, which are called “modes of operation“ in the following: Mode 0: Information obtained from meta-information available during progressive download or adaptive streaming, for example from manifest files used in DASH, about codec and bitrate, and rebuffering. Mode
13、 1: All information from Mode 0, with additional video and audio frame information based on packet header inspection Mode 2: All information from Mode 1, and up to 2% (in Bytes) of the overall media stream information based on deep packet inspection and partial bitstream parsing Mode 3: All informat
14、ion from Mode 1, and complete media stream information based on bitstream parsing The ITU-T P.1203-series of Recommendations addresses two application areas, which are respectively indicated in the module-related Recommendations ITU-T P.1203.1, ITU-T P.1203.2, ITU-T P.1203.3: Large-screen presentati
15、on as with fixed-network video streaming Mobile streaming on handheld devices such as smartphones The ITU-T P.1203 module algorithms are no-reference, bitstream-based models. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T P.1203 2016-11-29 5 11.1002/1000/13158 Keywords Adap
16、tive streaming, audio, audiovisual, IPTV, mean opinion score (MOS), mobile video, mobile TV, monitoring, multimedia, progressive download, QoE, TV, video. _ * To access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by the Recommendations un
17、ique ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T P.1203 (11/2016) FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommun
18、ication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assemb
19、ly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which
20、 fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with thi
21、s Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory langu
22、age such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or implementation of this Re
23、commendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of
24、approval of this Recommendation, ITU had received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementers are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB
25、patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2017 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. Rec. ITU-T P.1203 (11/2016) iii Table of Contents Page 1 Scope . 1 2 References . 2 3 Definitions 3 3.1
26、Terms defined elsewhere 3 3.2 Terms defined in this Recommendation . 3 4 Abbreviations and acronyms 3 5 Conventions 4 6 Areas of application 4 6.1 Application range for the models . 5 6.2 Modes of operation . 6 7 Building blocks . 6 7.1 Model input interfaces 7 7.2 Specification of Inputs I.11, I.12
27、 I.13 and I.14 . 7 7.3 Buffering . 9 7.4 Sliding window input specification 9 7.5 Model output information . 10 8 Overview of databases used for model development . 10 9 Description of the ITU-T P.1203 model algorithms . 11 Appendix I Performance figures . 12 Rec. ITU-T P.1203 (11/2016) 1 Recommenda
28、tion ITU-T P.1203 Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport 1 Scope This Recommendation describes a set of objective parametric quality assessment modules that together can be used to form a complete mode
29、l to predict the impact of audio and video media encodings and observed IP network impairments on quality experienced by the end-user in multimedia streaming applications. The addressed streaming techniques comprise progressive download as well as adaptive streaming, for both mobile and fixed networ
30、k streaming applications. Four modes are defined to cover a range of use-cases, from monitoring streams where the video payload is fully encrypted through to unencrypted streams, and where there are no limitations on processing power so that deep packet inspection is possible. The model described is
31、 restricted to information provided to it by an appropriate bit stream analysis module or set of modules. The model described here is applicable to progressive download and adaptive streaming, where the quality experienced by the end user is affected by audio-coding and/or video degradations due to
32、coding, spatial re-scaling or variations in video frame rates, as well as delivery degradations due to initial buffering, rebuffering (which are both perceivable as stalling of the playout of the media), and media adaptations. Here, a “media adaptation“ refers to events where the player switches vid
33、eo playback between a known set of media quality levels while adapting to network conditions. Each of the quality levels typically differs in a significant video and/or audio (and thus audiovisual) quality change. These quality changes are most readily observed by changes in bitrate, resolution, fra
34、me rate, and similar attributes. The model predicts a mean opinion score (MOS) on a 5-point absolute category rating (ACR) scale (see ITU-T P.910) as a global multi-media MOS score (as defined in ITU-T P.911, for instance). In addition, the well-defined modules provide several diagnostic outputs. Th
35、e primary applications for this model are monitoring of transmission quality for operations and maintenance purposes. The ITU-T P.1203 model for adaptive- and progressive-download-type media streaming may be deployed both in end-point locations and at mid-network monitoring points. The location of t
36、he model, together with the location of the measurement probe determines the mode of operation. Note, however, that the present Recommendation only describes the model that maps input parameters obtained from a probe located at a specific point in the network or in the client to the global multimedi
37、a MOS-scores and related quality diagnostic indicators, as described above. The model associated with this Recommendation cannot provide a comprehensive evaluation of transmission quality as perceived by an individual end-user because its scores reflect the perceived impairments due to coded audiovi
38、sual media data being transmitted over an IP connection with certain performance, and does not include specific terminal devices or user-specific. The scores predicted by a general quality model necessarily reflect average perceptual impairments. Effects such as those due to audio levels, signal noi
39、se and effects due to source generation such as video shake or certain colour properties (and other similar video factors) and other impairments related to the payload are not reflected in the scores computed by this model. Therefore, it is possible to have high scores with this model, yet have a po
40、or overall stream quality. As a consequence, this Recommendation can be used for applications such as: In-service quality monitoring for specific IP-based audiovisual services, as specified in more detail below. 2 Rec. ITU-T P.1203 (11/2016) Benchmarking of different service implementations. However
41、, it cannot be used for direct benchmarking of different encoder implementations. 2 References The following ITU-T Recommendations and other references contain provisions which, through reference in this text, constitute provisions of this Recommendation. At the time of publication, the editions ind
42、icated were valid. All Recommendations and other references are subject to revision; users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references listed below. A list of the currently valid ITU-T
43、Recommendations is regularly published. The reference to a document within this Recommendation does not give it, as a stand-alone document, the status of a Recommendation. ITU-T G.1022 Recommendation ITU-T G.1022 (2016), Buffer models for media streams on TCP transport. ITU-T H.264 Recommendation IT
44、U-T H.264 (2012), Advanced video coding for generic audiovisual services. ITU-T P.800.1 Recommendation ITU-T P.800.1 (2006), Mean Opinion Score (MOS) terminology. ITU-T P.910 Recommendation ITU-T P.910 (2008), Subjective video quality assessment methods for multimedia applications. ITU-T P.911 Recom
45、mendation ITU-T P.911 (1998), Subjective audiovisual quality assessment methods for multimedia applications. ITU-T P.1201.1 Recommendation ITU-T P.1201.1 (2012), Parametric non-intrusive assessment of audiovisual media streaming quality Lower resolution application area. ITU-T P.1201.2 Recommendatio
46、n ITU-T P.1201.2 (2012), Parametric non-intrusive assessment of audiovisual media streaming quality Higher resolution application area. ITU-T P.1202 Recommendation ITU-T P.1202 (2012), Parametric non-intrusive bitstream assessment of video media streaming quality. ITU-T P.1202.1 Recommendation ITU-T
47、 P.1202.1 (2012), Parametric non-intrusive bitstream assessment of video media streaming quality Lower resolution application area. ITU-T P.1203.1 Recommendation ITU-T P.1203.1 (2016), Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services o
48、ver reliable transport Video quality estimation module. ITU-T P.1203.2 Recommendation ITU-T P.1203.2 (2016), Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport Audio quality estimation module. ITU-T P.1203.3 Recom
49、mendation ITU-T P.1203.3 (2016), Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport Quality integration module. ITU-T P.1401 Recommendation ITU-T P.1401 (2012), Methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models. Rec. ITU-T P.1203 (11/2016) 3 3 Definitions 3.1 Terms defined elsewhere This Recommendation uses the following terms defi
