1、 ETSI TS 103 256 V1.1.1 (2014-10) Speech and multimedia Transmission Quality (STQ); Reference webpage for subjective testing TECHNICAL SPECIFICATION ETSI ETSI TS 103 256 V1.1.1 (2014-10)2Reference DTS/STQ-226 Keywords internet, quality ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRA
2、NCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org The present document may be made available in e
3、lectronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailin
4、g document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI doc
5、uments is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced or utilized in any form or by any
6、means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. E
7、uropean Telecommunications Standards Institute 2014. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Pa
8、rtners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TS 103 256 V1.1.1 (2014-10)3Contents Intellectual Property Rights 4g3Foreword . 4g3Modal verbs terminology 4g3Introduction 4g31 Scope 5g32 References 5g32.1 Normative references . 5g32.2 Informative r
9、eferences 5g33 Definitions and abbreviations . 6g33.1 Definitions 6g33.2 Abbreviations . 6g34 General aspects of a reference web page 6g34.1 Web QoE reference page composition . 6g34.2 Summary of typical parameters for a Web QoE reference page 7g34.3 Composition rules for a Web QoE reference page .
10、8g3Annex A (informative): Configuration of the Web QoE page 9g3A.1 News content acquisition 9g3A.2 Harvesting script requirements . 9g3A.3 RSS Feed harvesting script configuration 10g3A.4 Database setup 11g3Annex B (informative): Installation of the Web QoE page. 12g3B.1 Installation 12g3B.2 Configu
11、ration . 12g3History 14g3ETSI ETSI TS 103 256 V1.1.1 (2014-10)4Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-membe
12、rs, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/ipr.etsi.org). Pursuant to
13、 the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document.
14、Foreword This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “may not“, “need“, “need not“, “will“, “will not“, “can“ and
15、 “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. Introduction As interactive web services such as web browsing are gai
16、ning considerable importance in mobile broadband networks, it is also crucial to assess its performance in terms of QoS and QoE. While the interaction patterns of web browsing are simple (request - response), proper performance testing of this service in mobile communications networks is not. There
17、is a complex interplay between web content, Internet and fixed network infrastructure, air interface, end-user devices including actual web browser applications and the end users perception. With regards to technical performance testing for web browsing, ETSI has taken efforts by approving the COPER
18、NICUS web page and its successor KEPLER (http:/portal.etsi.org/stq/WebReferencePage.asp) as reference web pages for technically instrumented QoS parameter tests in live networks. However, due to the fact that their content is not interesting for users to interact with, they cannot be effectively use
19、d in subjective tests for web browsing QoE. Therefore, in the present document content for subjective web-browsing QoE is developed. ETSI ETSI TS 103 256 V1.1.1 (2014-10)51 Scope The present document describes the structure of a news web page with an underlying database of news articles, which can b
20、e used for subjective QoE testing of web browsing. In addition, it also describes how the database and the web page are set up on a server and how content of different web pages can be harvested, in order to build up the database of news articles. Different to the approach taken for deriving the par
21、ameters for the Kepler and Copernicus pages described in ETSI TR 102 505 i.3, this page is not an “average“ of several different pages, but is targeted towards the following focuses: 1) provisioning of news content that can be used throughout several consecutive web browsing sessions without repetit
22、ion of already seen or read news content; and 2) create a page that adheres with W3Cguidelines for proper web design in terms of appearance and technical implementation in order to minimize the influence of badly designed or programmed web pages. The page described within the present document is onl
23、y a snapshot of a typical news page at the moment of creation, however it provides content that can be used by different QoE labs for testing and therefore allows comparisons of the results between different labs. 2 References References are either specific (identified by date of publication and/or
24、edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected
25、 location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of the
26、present document. Not applicable. 2.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 Skadberg04 Y. X. Skadberg and J. R. Kimmel: “Visitors flow experience w
27、hile browsing a Web site: its measurement, contributing factors and consequences“. Computers in Human Behavior, vol. 20, pp. 403-422, 2004. i.2 MoellerRaake14 Quality of Experience: “Advanced Concepts, Applications and Methods“. Springer, Cham, 2014. NOTE 1: Running example of the test web page: htt
28、p:/kepler.dataworkers.eu. NOTE 2: Download of current version: https:/ace.ftw.at/downloads/web-qoe-testing-content/web-content-v2.0. i.3 ETSI TR 102 505: “Speech and multimedia Transmission Quality (STQ); Development of a Reference Web page“. ETSI ETSI TS 103 256 V1.1.1 (2014-10)63 Definitions and a
29、bbreviations 3.1 Definitions For the purposes of the present document, the following terms and definitions apply: Quality of Experience (QoE): degree of delight or annoyance of a person whose experiencing involves an application, service, or system NOTE: It results from the persons evaluation of the
30、 fulfilment of his or her expectations and needs with respect to the utility and/or enjoyment in the light of the persons context, personality and current state (MoellerRaake14 i.2). 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: CSS3 Third revision of
31、 the Cascading Style Sheets standard DB Data Base HTML Hyper Text Markup Language HTML5 Fifth revision of the HTML standard JS Javascript JSON JavaScript Object Notation PHP Hypertext Preprocessor QoE Quality of Experience RSS Really Simple Syndication URL Uniform Resource Locator W3CWorld Wide Web
32、Consortium 4 General aspects of a reference web page Quality of web experience represents an important topic for service or content providers. Measurement of such services at the end-user side is not a trivial task and various factors are influencing the overall QoE perception. In order to suppress
33、the influence of the content a standardized web page is necessary. The most important requirement for such a webpage is the ability to establish a certain browsing mode for the test users and create a flow experience that is typical in web browsing (as shown by Skadberg04 i.1). Therefore the page sh
34、ould be interactive and has to provide sufficient content such that the test participant can browse through it over several consecutive test conditions without getting bored. The aim of the Web QoE test content described in the present document here is to ensure above addressed requirements. Additio
35、nally the language of the presented news content should be selectable, such that the page can be used across different countries with identical technical properties (picture count, page size, etc.). This is achieved by the attached content harvesting script that downloads recent news from an RSS fee
36、d that can be specified in the configuration file. The page can be stored on a local server within the test infrastructure, thereby eliminating imponderabilities from different interconnecting networks. 4.1 Web QoE reference page composition After successful recording of the articles from the RSS fe
37、eds, all content of the web page is stored locally in the database, which allows perfect control over page loading times. Interactive content such as the news articles is updated on a daily basis, with the possibility to update the database also manually from the administration control panel. Images
38、, and video files are stored in public folders, and all text information is stored in a local SQLite database, hence any calls to other servers, or network elements are eliminated which allows to out rule variances of the connection to the server via the Internet. ETSI ETSI TS 103 256 V1.1.1 (2014-1
39、0)7As the content of the news page is harvested via the attached script from the RSS feed provided in the configuration file, the page can be easily filled with content of any language. The internal structure of the page is designed to have minimal design and language impact on the overall perceptio
40、n, hence the page depends only on the RSS feed content and original posts. The internal structure of the Web QoE reference page is based on the newest HTML5 and CSS3 standards (see note 1). Although these are not yet fully standardized, currently they represent the most spread technologies among mod
41、ern web pages and applications. Overall page design and source code follows the W3Cstandards. NOTE 1: See http:/www.w3.org/standards/. The Web QoE reference page uses several open-source technologies, which are nowadays widely used around the Internet. Design of the web page utilizes Bootstrap CSS (
42、Cascading Style Sheets) framework in 3.0 revision (see note 2). This framework allows rapid development of new page elements and ensures that the page remains appealing to the user, and the overall perception is not distracted by the badly programmed CSS code. This approach also allows to present th
43、e page on different devices and maintain usability of the application and readability of content. Responsive features of the Bootstrap CSS framework allow to control which parts or elements of the pages are displayed on which device. Hence it is possible to decrease the number of visible elements on
44、 the mobile devices, or to show advances elements (e.g. a video player) on the devices with larger screens. Moreover, the Bootstrap CSS framework is maintained by large online community of developers, which ensures low number of issues and guarantees high cross-browser compatibility. NOTE 2: See htt
45、p:/ Other technologies used for the Web QoE reference page originate from the best practices for web development as published and maintained by Html 5 Boilerplate (see note 3). This contains also the Apache configuration file for proper compression on the server side and optimal caching instructions
46、, which are sent from the server to the client. These settings represent the optimal setup for current web applications and ensure minimal loading times and minimal amount of sent data. NOTE 3: See http:/. 4.2 Summary of typical parameters for a Web QoE reference page Table 1 shows the parameters of
47、 the existing Kepler and Copernicus pages versus the proposed Web QoE reference page as determined by ETSI TR 102 505 i.3 document (defining development of a reference Web page). Table 1 Total size, bytes % non-lossless compressible Object count Composition Kepler 807 076 (Windowssize) 60 75 125 000
48、 bytes in “flash video“ surrogate, 3 jpgs of 45 000 bytes each Copernicus 200 000 57 38 Largest object: 36 000 bytes, type jpg Subjective Web QoE reference page 690 000 (customizable) 50 (customizable) 23 (customizable) Video, content images, text of articles, CSS files, JS files ETSI ETSI TS 103 25
49、6 V1.1.1 (2014-10)84.3 Composition rules for a Web QoE reference page Design and composition of the page was developed by taking into account the recommendations for the development of reference web pages from W3Cand general concepts of various existing news pages on the Internet (Spiegel.de, G). Therefore, the following features are essential. Responsive design, such that the web page is usable via PCs, Tablets and smartphones. Moreover, the site is presented in the optimal, device-de
