CEN TS 17171-2018 Management of observed hydrometric data - Guidance.pdf

1、BSI Standards PublicationWB11885_BSI_StandardCovs_2013_AW.indd 1 15/05/2013 15:06Management of observed hydrometric data - RecommendationsPD CEN/TS 17171:2018National forewordThis Published Document is the UK implementation of CEN/TS 17171:2018.The UK participation in its preparation was entrusted t

2、o Technical Committee CPI/113, Hydrometry.A list of organizations represented on this committee can be obtained on request to its secretary.This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its correct application. The British Standard

3、s Institution 2018 Published by BSI Standards Limited 2018ISBN 978 0 580 91794 3ICS 07.060; 35.240.70Compliance with a British Standard cannot confer immunity from legal obligations.This Published Document was published under the authority of the Standards Policy and Strategy Committee on 31 August

4、2018.Amendments/corrigenda issued since publicationDate Text affectedPUBLISHED DOCUMENTPD CEN/TS 17171:2018TECHNICAL SPECIFICATIONSPCIFICATION TECHNIQUETECHNISCHE SPEZIFIKATIONCEN/TS 17171August 2018ICS 07.060; 35.240.70EUROPEAN COMMITTEE FOR STANDARDIZATIONCOMIT EUROPEN DE NORMALISATIONEUROPISCHES

5、KOMITEE FR NORMUNGCEN-CENELEC Management Centre: Avenue Marnix 17, B-1000 Brussels 2018 CEN Ref. No. CEN/TS 17171:2018: EAll rights of exploitation in any form and by any means reserved worldwide for CEN national MembersManagement of observed hydrometric data - GuidanceGestion des donnes hydromtriqu

6、es observes - RecommandationsMangement gemessener hydrometrischer Datenstze - EmpfehlungenThis Technical Specification (CEN/TS) was approved by CEN on 26 February 2018 for provisional application.The period of validity of this CEN/TS is limited initially to three years. After two years the members o

7、f CEN will be requested to submit their comments, particularly on the question whether the CEN/TS can be converted into a European Standard.CEN members are required to announce the existence of this CEN/TS in the same way as for an EN and to make the CEN/TS available promptly at national level in an

8、 appropriate form. It is permissible to keep conflicting national standards in force (in parallel to the CEN/TS) until the final decision about the possible conversion of the CEN/TS into an EN is reached.CEN members are the national standards bodies of Austria, Belgium, Bulgaria, Croatia, Cyprus, Cz

9、ech Republic, Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey and United K

10、ingdom.English VersionCEN/TS 17171:2018 (E)European foreword .ivIntroduction v1 Scope . 62 Normative references 63 Terms and definitions . 64 Principles of hydrometric data management . 74.1 The requirement for data management 74.2 The sequence of data management . 74.3 Duty of care 84.3.1 General 8

11、4.3.2 Legacy data . 84.4 Data types and terminology 94.5 Time series data . 94.5.1 General 94.5.2 Time of observation 94.5.3 Derived data terminology . 114.5.4 Resolution of data storage 114.5.5 Uncertainty 114.6 Metadata and descriptive material . 124.7 Maximizing data utility . 124.7.1 Availabilit

12、y of metadata 124.7.2 Data quality control 124.7.3 Data gap infilling .134.7.4 Regular data reviews .134.8 Data storage considerations . 144.8.1 Data storage 144.8.2 Changes to data 144.8.3 Data disposal 144.8.4 Electronic data storage system considerations 144.8.5 Tapes, charts and other data in pa

13、per format .154.8.6 Data security .154.8.7 Data rescue 154.9 Archiving hydrometric data: national collections154.10 Electronic transfer of data 165 Metadata 175.1 General 175.2 Monitoring station/site/point metadata. 175.2.1 General. 175.2.2 Station identifier .175.2.3 Station description 185.2.4 Ge

14、ographical location .185.2.5 Operating period .185.3 Observation metadata . 195.3.1 General. 195.3.2 Data set metadata 195.3.3 Data flags and comments . 196 Precipitation data .196.1 Raw data 196.1.1 Data to be recorded 196.1.2 Additional raw data for manual observations .206.2 Resolution of data st

15、orage 206.3 Data processing and formatting 20iiContents PagePD CEN/TS 17171:2018CEN/TS 17171:2018 (E)6.3.1 General. 206.4 Quality control of precipitation data . 206.4.1 General. 206.4.2 Levels of quality control of precipitation data 206.4.3 Methods for quality control of precipitation data 206.4.4

16、 Quality control of frozen precipitation 216.5 Precipitation specific metadata . 217 Water level data 217.1 Raw data 217.1.1 Data to be recorded 217.1.2 Types of level data .227.1.3 Regular measurements and event data .227.1.4 Additional raw data for continuous measurements .237.1.5 Groundwater leve

17、ls and water levels in reservoirs 237.2 Quality control of water level data 247.2.1 General. 247.2.2 Levels of quality control of water level data .247.2.3 Methods for quality control of water level data .247.2.4 Data estimation and infilling 257.3 Water level specific metadata . 268 Velocity and di

18、scharge data .268.1 Raw data 268.1.1 Data to be recorded 268.1.2 Additional raw data for irregular/spot measurements 268.1.3 Additional raw data for regular or fixed site measurements .278.2 Data processing . 278.2.1 General. 278.2.2 Discharge data derived from water levels 278.2.3 Discharge data fr

19、om time of flight ultrasonic systems .298.2.4 Discharge data from velocity index method .298.2.5 Discharge data from electromagnetic systems .298.2.6 Combining discharge data from multiple methods 298.3 Resolution of data storage 298.4 Derived data . 308.4.1 Daily mean flow .308.4.2 Peak discharges

20、.308.5 Naturalization of discharge data 308.6 Quality control of discharge data . 308.6.1 Levels of quality control of discharge data.308.6.2 Methods for quality control of discharge data 318.6.3 Review of extreme flows 328.6.4 Data estimation and infilling 328.7 Discharge specific metadata . 348.7.

21、1 Additional monitoring station/site/point metadata .348.7.2 Additional observation metadata .349 Volume data 359.1 General 359.2 Level/storage relationships 359.3 Frequency of sampling and processing 359.4 Resolution of data storage 359.5 Volume data specific metadata 35Bibliography .36 ISO ISO pub

22、-date year All rights reserved iiiPD CEN/TS 17171:2018CEN/TS 17171:2018 (E)European forewordThis document (CEN/TS 17171:2018) has been prepared by Technical Committee CEN/TC 318 “Hydrometry”, the secretariat of which is held by BSI.Attention is drawn to the possibility that some of the elements of t

23、his document may be the subject of patent rights. CEN shall not be held responsible for identifying any or all such patent rights.According to the CEN/CENELEC Internal Regulations, the national standards organisations of the following countries are bound to announce this Technical Specification: Aus

24、tria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spa

25、in, Sweden, Switzerland, Turkey and the United Kingdom.ivPD CEN/TS 17171:2018CEN/TS 17171:2018 (E)IntroductionWater management decisions and policies ought to be based upon quantitative knowledge of the hydrological system. Commonly, such knowledge results from observational hydrometric data, the co

26、llection of which is the subject of other standards, e.g. EN ISO 18365. The subsequent management of such hydrometric data provides the linkage between field measurement and the eventual use of processed data to address a wide range of strategic and operational water management applications. As both

27、 the demand for and complexity of hydrometric data increase, it is important that the procedures and processes used to manage these data are standardized to allow greater integration of data and ensure their protection for future use.The availability of high-quality observational data are vital to d

28、eveloping an understanding of the hydrological cycle. Optimizing data management systems helps ensure that the maximum benefits are achieved from those resources invested in hydrometric monitoring. Effective standardized procedures for data transmission, manipulation, quality control, expression of

29、uncertainty and storage are vitally important and their use should be promoted throughout hydrometric observation networks.Those responsible for hydrometric data management are encouraged by this Technical Specification to adopt the ethos of professional stewardship and to remember their role as gua

30、rdians of an important national, and sometimes international, resource.This Technical Specification is designed for use by all organisations and individuals collecting, processing or storing hydrometric data. Some of the clauses contained in standard are only applicable for those maintaining nationa

31、l or regional collections of hydrometric data (for example, 4.9). However most recommendations are widely applicable to all users, including organisations, companies or individuals involved in: hydropower production, water supply, environmental protection, scientific research or flood risk managemen

32、t.This Technical Specification is concerned with general aspects of good practice in data management. Techniques for managing data are recommended, covering metadata collection, data storage and quality control. This Technical Specification assumes that the raw data have been collected and transmitt

33、ed from the field in line with other European Standards for hydrometry, so this Technical Specification concentrates on the subsequent processing and management of these hydrometric data.vPD CEN/TS 17171:2018CEN/TS 17171:2018 (E)1 ScopeThis document gives recommendations for the management of observ

34、ed hydrometric data, including raw data and other data as well as statistics derived from these observations. Although the principles of data management can be applied to all hydrometric observations, particular focus is placed on measurements of precipitation, water level (including stage), volume

35、and discharge in open channels.NOTE The range of sites where water levels, and sometimes flow, are measured includes lakes, reservoirs, rivers, canals, tidal waters, sewers, wells, and boreholes.The document covers metadata associated with hydrometric data, including recommendations for the producti

36、on and management of descriptive, analytical and statistical material relating to sites where and measuring techniques, by which hydrometric data are collected. The recommendations of this document can be applied to some forms of data directly derived from observational records (for example, summary

37、 time series of monthly mean river flows). While not primarily designed for the management of data resulting from more complex numerical models or spatially aggregated data sets (for example, remotely-sensed data), many of the recommendations are applicable for such types of data.This document does

38、not cover the field collection of data or its transmission, but focuses on the management of data once they have been received in a hydrometric information management system.2 Normative referencesThe following documents are referred to in the text in such a way that some or all of their content cons

39、titutes requirements of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies.EN ISO 772, Hydrometry Vocabulary and symbols (ISO 772)3 Terms and definitionsFor the purposes of this

40、 document, the terms and definitions given in EN ISO 772 and the following apply.ISO and IEC maintain terminological databases for use in standardization at the following addresses: IEC Electropedia: available at http:/www.electropedia.org/ ISO Online browsing platform: available at http:/www.iso.or

41、g/obp 3.1data flagindicator relating to the quality and characteristics of an observation3.2derived datainformation calculated, or deduced, from raw data (3.5)3.3precipitationwater or ice derived from the atmosphere and deposited at ground levelNOTE Measured in terms of the depth in millimetres (mm)

42、 of its liquid equivalent.3.4quality controlprocess of confirming that the data held are a reliable representation of the variable being measured or derived6 PD CEN/TS 17171:2018CEN/TS 17171:2018 (E)3.5raw datadata resulting directly from the measurement of variables3.6UTCCoordinated Universal Time4

43、 Principles of hydrometric data management4.1 The requirement for data managementHydrometric data management systems should be designed such that the utility of data to end-users at all levels is a central consideration. The value of data can be significantly affected by the treatment of data after

44、collection, so data management systems should be designed to maintain (and where possible improve) the quality and continuity of records.As water management decisions and policies are based upon quantitative knowledge of the hydrological system both now and in the past, the protection of data for fu

45、ture use should be a central requirement of any data management system. As such, the design of such systems should consider, as far as possible, both current and future user requirements.4.2 The sequence of data managementThe management of hydrometric data is a continuous sequence (see Figure 1), wh

46、ich starts in the field at the point of collection and ends if and when data are destroyed. The design of any hydrometric data management system should consider all stages in this sequence.The management of data at the point of collection and their subsequent transmission vary depending on the hydro

47、logical variable being recorded, hydrometric methods employed and instrumentation used. Any data management system used should ensure that adequate data and metadata are recorded at the point of collection to allow future management and use.Some data management processes, such as quality control, ma

48、y occur at more than one stage in the sequence and be completed by more than one organization. In designing, operating and reviewing data management systems, all stages in the acquisition, processing and dissemination of data should be considered.7PD CEN/TS 17171:2018CEN/TS 17171:2018 (E)Figure 1 Da

49、ta management sequence4.3 Duty of care4.3.1 GeneralData often have significant value outside the organization that collected them, and data management systems should be designed, where possible, to capture all information required for future, sometimes unforeseen, uses.Responsibility for the operation of hydrometric monitoring systems may be transferred (for example, to another organization or other personnel), so data management systems should be capable of preserving all data and associated metadata required to inform new operators.4.3.2 Legacy dataThe duty of care t