1、 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.Any updates/errata to this
2、publication will be posted on the ASHRAE Web site at www.ashrae.org/publicationupdates. 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital for
3、m is not permitted without ASHRAEs prior written permission.2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without A
4、SHRAEs prior written permission.ISBN 978-1-933742-73-1 2009 American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. 1791 Tullie Circle, NE Atlanta, GA 30329 www.ashrae.org All rights reserved. Printed in the United States of America Cover design by Joe Lombardo, DLB Associate
5、s. ASHRAE has compiled this publication with care, but ASHRAE has not investigated, and ASHRAE expressly disclaims any duty to investigate, any product, service, process, procedure, design, or the like that may be described herein. The appearance of any technical data or editorial material in this p
6、ublication does not constitute endorsement, warranty, or guaranty by ASHRAE of any product, service, process, procedure, design, or the like. ASHRAE does not warrant that the information in the publication is free of errors, and ASHRAE does not necessarily agree with any statement or opinion in this
7、 publication. The entire risk of the use of any information in this publication is assumed by the user. No part of this book may be reproduced without permission in writing from ASHRAE, except by a reviewer who may quote brief passages or reproduce illustrations in a review with appropriate credit;
8、nor may any part of this book be reproduced, stored in a retrieval system, or transmitted in any way or by any meanselectronic, photocopying, recording, or otherwithout permission in writing from ASHRAE. Requests for permission should be submitted at www.ashrae.org/permissions. _ 2009, American Soci
9、ety of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.v Acknowledgments ix PART 1 BASICS CHAPTER 1 IN
10、TRODUCTION 3 1.1 Objectives for this Book . 11 1.2 How to Use this Book 12 CHAPTER 2 HOW, WHAT, Mike Mangan, DLB Associates; Jeff Jaworksi, DLB Associates Chapter 3 John Beana,b, APC/Schneider; Randall Woffordb, Dell; Ross Ignalla, Dranetz-BMI; Michael Kennedy, DLB Associates Chapter 4 Ken Uhlmanb,
11、Eaton (lead); Harry Rogersb, Microsoft Chapter 5 Robert Wasilewski, DLB Associates (lead) Chapter 6 Jeff Trowera, DataAire (lead); Cliff Federspiel, Federspiel Controls Chapter 7 John Beana,b, APC/Schneider (lead) Chapter 8 Daryn Clinea, Evapco (lead) Chapter 9 Jonathan Spreemana, Trane (lead); Tahi
12、r Cadera,b, HP Chapter 10 Robert Wasilewski, DLB Associates Chapters 11, 12, 13, 14 Steve McCluera,b, APC/Schneider Electric (lead); Bill Campbellb, Emerson Network Power; John Messerb, Emerson Network Power Chapter 15 Mike Pattersona,b, Intel (lead); Bob MacArthurb, EMC Chapter 16 Kevin Engelberta,
13、b, Cisco (lead) Chapter 17 Kevin Wymana, Carrier Corporation (lead); Greg Palmerb, HP (formerly UTC Power) (lead); Appendix A John Beana,b, APC/Schneider (lead) Appendix B Jonathan Spreemana, Trane (lead) Appendix C Tahir Cadera,b, HP (lead); Jonathan Spreemana, Trane 2009, American Society of Heati
14、ng, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.Real-Time Energy Consumption Measurements in Data Centers x
15、 Appendix D Steve McCluera,b, APC/Schneider (lead); Bill Campbella, Emerson Network Power; John Messerb, Emerson Network Power Appendix E Kevin Wymana, Carrier Corporation; Greg Palmera,b, HP (formerly UTC Power) (lead); The following individuals also provided significant feedback and guidance in th
16、e writing of this book: Roger Schmidt, IBM; Don Beaty, DLB Associates (major commenter on 1st edition). Production of final book including creation of most graphics Jeff Jaworski, DLB Associates; Mike Mangan, DLB Associates. Book cover design Joe Lombardo, DLB Associates. a Member ASHRAE TC 9.9 b Me
17、mber The Green Grid 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.2009, Am
18、erican Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.2009, American Society of Heating, R
19、efrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.3 Over the last several years, energy consumption by data center
20、s in the US as well as worldwide has become a topic of intense discussion within the Information and Communication Technologies (ICT) world. There are numerous publications presenting statistics on the impact of data center power consumption on the supply of electricity. One of the more comprehensiv
21、e studies was that requested by the US Congress in Public Law 109-431, in which the EPA was mandated to quantify the electricity usage by US data centers, resulting in Report to Congress on Server and Data Center Energy Efficiency Public Law 109-431, 2007. The key finding of this study is that in 20
22、06, US data centers consumed 1.5% of all electricity used in the US and that according to historical trends, this consumption would rise to 2.9% by 2011. The 1.5% electricity usage included servers and the infrastructure to support servers, but did not include network or storage equipment. A graph o
23、f the findings is shown in Figure 1.1. 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written
24、permission.Real-Time Energy Consumption Measurements in Data Centers 4 Figure 1.1 - Projected data center energy use scenarios (EPA, 2007) The alarming trend of escalating electricity consumption in US data centers has spurred the ICT industry to aggressively increase energy efficiency in order to d
25、ramatically reduce power consumption in data centers. Together, the DOE and The Green Grid have stated that a goal for 2011 is to achieve a reduction of energy to 100B kWh / year instead of the current projection of 120B kWh / year for 2011. One of the key ways in which the industry can achieve the
26、state-of-the-art curve is via real-time energy efficiency, which is achievable only through the use of 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print
27、 or digital form is not permitted without ASHRAEs prior written permission.Introduction 5 real-time energy consumption data using energy efficiency and productivity metrics. An example of a real-time energy efficiency metric is the real-time version of the Power Utilization Effectiveness (PUE) metri
28、c as proposed by The Green Grid (Green Grid Data Center Power Efficiency Metrics: PUE And DCiE, 2008). This metric is defined and discussed further in Chapter 2. The focus of this book is real-time energy consumption measurements, with the resulting data to be used in all the relevant energy efficie
29、ncy and productivity metrics. Real-time energy consumption measurements are only possible if all key subsystems are appropriately instrumented and properly communicating through use of data center level software. Existing data centers have varying levels of instrumentation, ranging from very poor to
30、 excellent. For this book, three approaches to instrumentation and measurement for any given subsystem will be followed. The following loose guidelines are provided: Minimum Practical Measurement Best Practical Measurement State-of-the-Art Measurement When deciding what level of measurement to targe
31、t, a data center owner / operator needs to keep in mind key items such as capital cost, data accuracy and resolution, and end-use of the data. These factors will be dealt with in further detail in subsequent chapters. The following guidelines, summarized in Table 1.1, are suggested: Minimum Practica
32、l Measurement This will require some level of human activity to perform periodic measurements. This approach will require zero to limited infrastructure upgrades, and zero to limited investment in instrumentation. This approach may rely more heavily on staff (most likely existing) to manually record
33、 data, and will also rely on manufacturers equipment data. Best Practical Measurement This will require a lower level of human activity than the minimum case in order to manually record data. For this case, it is anticipated that data will be logged in real-time with extensive trending possible. The
34、 instrumentation used may not necessarily be of the highest accuracy nor will it likely be 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital
35、form is not permitted without ASHRAEs prior written permission.Real-Time Energy Consumption Measurements in Data Centers 6 the most extensive, with the more difficult to instrument parts of the facility remaining uninstrumented. Limited modification to infrastructure should be expected, and some tas
36、ks may be beyond the competency of the existing staff. Less reliance on manufacturers data is expected. State-of-the-Art Measurement This will not require human activity to gather and record data. Data will be collected by automated systems in real-time and will support extensive trending and analys
37、is. The instrumentation will be of accuracy suitable for revenue grade. There will likely be a requirement to upgrade the existing infrastructure, and it is very likely some level of contractor or consultant support will be needed for the implementation. Mixed-use facilities offer the greatest chall
38、enge in which to quantify real time energy consumption. Figures 1.2 through 1.4 show a generic layout in a mixed-use facility. These figures are schematic in nature and are not intended to be fully representative of all possible configurations. Figure 1.2 shows a schematic representation of the elec
39、trical distribution system in a mixed-use data center, while Figure 1.3 shows the mechanical layout of the same data center type. 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or t
40、ransmission in either print or digital form is not permitted without ASHRAEs prior written permission.Introduction 7 Figure 1.2 - Schematic representation of the electrical system in a mixed-use facility 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashra
41、e.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.Real-Time Energy Consumption Measurements in Data Centers 8 Figure 1.3 - Schematic representation of the mechanical layout o
42、f a data center housed in a mixed-use facility 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior
43、written permission.Introduction 9 Figure 1.4 is a simple graphic representing the key metering locations in a typical data center. The meters acquire power consumption data from all the electrical and mechanical subsystems shown in Figures 1.2 and 1.3, respectively. Each metering location is associa
44、ted with its own hardware and software protocols, and in many cases hardware and software is provided by multiple vendors. These systems generally do not communicate with each other, which creates a significant issue in progressing toward the display of real-time energy and productivity metrics. The
45、 subsequent chapters will discuss these issues in further detail. 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproduction, distribution, or transmission in either print or digital form is not permitted wit
46、hout ASHRAEs prior written permission.Real-Time Energy Consumption Measurements in Data Centers 10 Figure 1.4 - Key metering locations in a data center 2009, American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. (www.ashrae.org). For personal use only. Additional reproducti
47、on, distribution, or transmission in either print or digital form is not permitted without ASHRAEs prior written permission.Introduction 11 1.1 OBJECTIVES FOR THIS BOOK The following are key objectives for the book: Provide an overview of the state of real-time energy consumption measurements in the
48、 data center. The book will cover both legacy as well as state-of-the-art data centers. Discuss the minimum and best practical levels of measurement, as well as state-of-the-art measurement for real-time energy consumption measurements (see Chapter 1 Introduction). Provide a detailed discussion of h
49、ow the measured real-time data will be used, and in particular how this information will be turned into knowledge that can lead to actionable items. This will cover the latest industry data center productivity and energy efficiency metrics from organizations such as The Green Grid and ASHRAE TC9.9. Emphasis will also be placed on quantifying the data centers power c