1、Advanced Weather Interactive Processing System (AWIPS II) Overview for Development Collaboration Workshop September 29, 2010,Ed Mandel, Steve Schotz, & Jim Calkins NWS Office of Science and Technology,AGENDA,AWIPS II Technology Infusion Scope and Milestones AWIPS II Migration Approach, Status and La
2、test Schedule AWIPS II Architecture Overview Major Software Components Communications Interfaces Standards and Formats AWIPS II Extended Projects AWIPS II Software Development Strategy in the AWIPS II Era,AWIPS II Technology Infusion Scope,AWIPS II Technology Infusion (FY2005 FY2015) A long-term pro
3、ject which delivers a modern, robust software infrastructure that provides the foundation for future system level enhancements for the entire NWS enterprise Phase 1: (FY2006-FY2011) Migration of WFO/RFC AWIPS (AWIPS I) to a modern Service Oriented Architecture (SOA) infrastructure executed increment
4、ally through a series of task ordersPhase II: (FY2009-FY2013) AWIPS SOA Extension Creation of a seamless weather enterprise spanning NWS operations Migration of NAWIPS into the AWIPS ISOA Delivery of thin client to support for the Weather Service Offices, Center Weather Support Units, Incident Meteo
5、rologists, (e.g., Fire Weather, backup support for RFCs and National Centers) Integration of Weather Event Simulator) CHPS Integration into AWIPS SOAPhase III: (FY2009 FY2015) Enterprise Level Enhancements Data delivery enhancements: “Smart push-smart pull” data access Integrated visual collaboratio
6、n Information generation enhancements Visualization enhancements,AWIPS II Migration Re-Architecture Approach,Perform “black-box” conversion Preserve existing functionality, look and feel on top of new infrastructure Thorough field validation and acceptance before deployment No loss of functionality
7、Deployed system current with deployed AWIPS capability (i.e., OB9) Use open source projects - No proprietary code Objective is to make AWIPS II available for collaborative development,AWIPS II Migration Status,AWIPS-II: Reference Architecture Based on Plug In Extensible services,AWIPS-II Reference A
8、rchitecture, EDEX, CAVE,Meta Data,Data,Core Generic Services,Core Libraries,Enterprise Service Bus (ESB) - Camel,SOA Architecture Logical Layered View Layers Separated by Simple APIs,Client/Presentation Services,Platform Layer,Mission Services Layer,Data Access Layer,Metadata Index,Data Persistence
9、Store,Enterprise Service Bus - Communication,Security Services /Demilitarized Zone (DMZ),Spatial Index,Hydro Models,LAPS,FORTRAN/C/C+ Command Line Programs,External Programs,JMX,PostgreSQL,HDF5,Hibernate,HDF5 API,Ingest Services,ProductSrv,AdapterSrv,NotifySrv,PurgeSrv,Synchronous Interface,CAVE,Uti
10、litySrv,Localization Store,GFE Services,Hydro Services,TextDBSrv,AWIPS II Dependencies: Open Source Based Free of All Fee-Based COTS Dependencies,AWIPS II Deployment Standards & Formats,Ingested Data Formats GRIB1/GRIB2 Gridded data NetCDF3 Support AWIPSI/II interoperability BUFR Observational Data,
11、 e.g., soundings METAR, SHEF Surface and hydrological data GINI Satellite Imagery OPRG L3 Radar Imagery Text Messages Text products Data Store Formats PostGres Metadata and select data type store, e.g., text HDF5 Binary store for grids, imagery and select observations Product Distribution NetCDF3 ND
12、FD Grids ASCII Text Text products,AWIPS II Extended,AWIPS II Extended Projects,AWIPS II Extended - NAWIPS Migration,Objectives Incorporate NAWIPS capabilities into AWIPS SOA Key Benefits Enables more cost-effective software development environment for common requirements across the NWS enterprise; H
13、elps enable software agility Lays ground work for more effective collaboration and seamless products across NWS enterprise (NCs, WFOs, RFCs, CWSUs) by providing common infrastructure Strengthens NWS partnership with University Community by providing entire suite of AWIPS capabilities Helps enable mo
14、re efficient R to O and O to R Improves support for OCONUS Regions by providing common software infrastructure for NAWIPS and AWIPS functionality Potential Synergies with Other Projects Provides opportunities to leverage/share NAWIPS capabilities with broader AWIPS user customer base Grid/Ensemble d
15、iagnostics Drawing/Product generation tools to support collaboration requirements,AWIPS II Extended - AWIPS II Thin Client,Objectives Develop enterprise solution for remote access to AWIPS capabilities Key Benefits Incorporate FX-Net capabilities into baseline Provides common solution to address rem
16、ote access requirements to support Incident Meteorologists, e.g., Fire Wx, Weather Service Offices, etc. Allows remote users to have access to latest set of AWIPS capabilities Provides partial solution for COOP scenarios at NCs and RFCs In combination with Data Delivery Project, allows us to begin t
17、o analyze future opportunities for utilizing cloud computing,AWIPS II Extended - Weather Event Simulator (WES),Objectives Develop enterprise solution to support NWS training requirements Phase I: Provide bridge for current WES capability into AWIPS II. Also serves as a pathfinder for Phase II Phase
18、II: Develop integrated solution for AWIPS enterprise Key Benefits Provides robust, sustainable baseline solution to support NWS training requirements Allows training users to have access to latest built set of AWIPS capabilities Provides training solution for all AWIPS applications,AWIPS II Extended
19、 - Data Delivery,Objectives Develop robust data delivery system within AWIPS II infrastructure that enables efficient access to high volume datasets Develop operational robust infrastructure to support “intelligent” access to non-local datasets User defined sub-setting by space, time, and parameter
20、Subscription or Ad-hoc access methods based on weather events Key Benefits Supports high impact based forecast and decision assistance processes by allowing users to access just the data they need by space, time, parameter; Enables more efficient data mining Enables effective on-demand access to Wea
21、ther Information Database Enables synergy and interoperability with NextGen technologies, e.g., data discovery services, data access services and data providers. Mitigates high growth in data volume e.g. ensembles, high-resolution models Multi-Phase Implementation IOC Focus NWS data providers, e.g.,
22、 NOMADS, MADIS, possibly with basic services only, discovery, sub-setting Target FY13,AWIPS II Extended Data Delivery Overview -Continued,Synergies with NextGen (4-D Cube) Data registry and discovery services “Smart” push/pull technology Sub-setting by user selectable space, time, and parameter Comp
23、lex retrievals, e.g., derived parameters, coordinate transformations, etc Ad hoc and subscription services Operationally robust supports availability, latency and security requirements for operational users Plan to leverage NextGen services including Reg/Rep, WCS, WFS Potential Synergies with Other
24、Projects IRIS for data access/distribution IHIS for data access/distribution GOES-R and NPP/NDE Data Provider and data access/distribution services NWS Infrastructure Project Central Data Server services,Concept of Operations Data Delivery Paradigm,17,Three Main Components: the Data Delivery Agent,
25、the Registry/Repository and the Data Providers,Data Delivery High Level Architecture,AWIPS II Extended - Collaboration,Objectives Develop capabilities to support real-time collaboration Phase I: Develop/Enhance internal NWS collaboration capabilities Phase II: Develop/Enhance IOC collaboration capab
26、ilities with external partners Phase III: Improve collaboration capabilities with external partners Key Benefits Enables more effective collaboration across all levels of NWS promoting a more coordinated and seamless set of products and services Fosters consistency of NWS products and services Enabl
27、es interoperability between NWS and decision makers, e.g., emergency managers to support Decision Support Services Potential Synergies with Other Projects IRIS for collaboration with external partners IHIS for collaboration with external partners Canadian Environment Services /NWS Marine Forecast Co
28、llaboration Project Weather and Emerg. Management Decision Support (RENCI) Project for collaboration with North Carolina Emergency Managers,Phase I Collaboration ConOps,Data display sharing This capability will allow participating NWS offices to view each others AWIPS data displays during collaborat
29、ion sessions Telestrator Functions Simple line drawing capabilities, that will allow forecasters to draw and erase temporary lines and polygons on their AWIPS displays that can be viewed by participating collaborators. Telestrator functions will help forecasters identify and discuss specific feature
30、s of interest, e.g., satellite and radar storm signatures, etc. Creation and editing of hydrometeorological objects Creation, editing and exchange of geo-referenced objects and products such as fronts, areas of severe weather, troughs and ridges, etc. and graphical products such as watches and warni
31、ngs. Meteorological objects and products will be displayed and/or exchanged among the participating collaborators allowing participants to import these graphics and display them in AWIPS applications. The display and exchange of meteorological objects and products will allow sites to collaborate in
32、real-time on object or product features such as location, shape, and intensity. Object and product attributes such as front type, product type, etc; will also be saved so that they are available for forecaster access and editing. An integrated text chat capability that will allow forecasters to chat
33、 during the collaboration session.,AWIPS II Extended Information Generation,Objective Develop infrastructure to support common set of information generation services and tools to support decision assistance Key Benefits Enables AWIPS tools and Decision Maker tools for decision support Streamlines ge
34、neration of products to support emerging industry standards, e.g., CAP and GIS Reduces development time associated with the introduction of new products and services Enables generation of NWS products from both local data bases and the 4-D weather Data Cube Opportunities for synergy with IRIS projec
35、t Potential Synergies with Other Projects IRIS vision is to provide a enterprise solution for information storage for NWS and decisions makers accessInitial Capabilities Encapsulated in IHIS Project,AWIPS II Extended - Advanced Visualization,Objective Develop advanced visualizations techniques, e.g.
36、, 3-D visualization that can be utilized by AWIPS baseline applications Key Benefits Enables more effective forecaster visualization of datasets to support forecast and decision making processes. Methods to improve situational awareness Methods to improve identification of factors that affect high i
37、mpact events,AWIPS II Software Development Strategy In the AWIPS II Era,AWIPS II Software Development Strategy,Vision Enable collaborative AWIPS II Environment to effectively incorporate new science and technology into AWIPS II operational baseline from NOAA development organizations, proving ground
38、s and test beds, and academic and research communities. AWIPS II becomes the premium “Open Source” software platform for the hydrometeorological communitySupporting Objectives Enable effective user and developer collaboration to support new capability development and enhancements Enable agile protot
39、yping and development in the AWIPS Development Environment (ADE) to reduce necessary software development time and cost to “productionize” new science and technology into AWIPS baseline Provide timely and effective feedback to AWIPS program to ensure AWIPS architecture refresh plans keeps pace with
40、new science and technologies,Software Agility Strategy - Continued,Software Agility Requirements Provide well- defined common libraries and toolkits to support data access, hydrometeorological calculations, visualization, and information generation Provide well-documented AWIPS Development Environme
41、nt (ADE) to development community Provide effective training and developer support to development community Develop streamlined governance processes balancing software agility needs with necessary software engineering discipline to ensure high quality software infusion into AWIPS baseline Provide ag
42、ile AWIPS test environment and methods including regression and automated test tools Establish OST in-house AWIPS II software development expertise to provide effective guidance on all phases of the software development life cycle to AWIPS stakeholders,Software Development Strategy Near-Term Activit
43、ies and Plans,Spin-Up OST AWIPS II development team using support contract mechanism Team will be the kernel of OST AWIPS II software expertise Government Team chartered - July 2010 Contractor Team Tasking October 2010 Develop AWIPS II software developers documentation, training and support RTS task
44、ing planned FY11 Improve AWIPS II testing environment Regression Testing Task on Contract Automated Testing Task FY11 Data Pump FY11,SEC AWIPS Software Development Team,Mission - The AWIPS Software Development Team (ASDT) shall serve as the center of expertise for AWIPS II Software for entire AWIPS
45、II enterprise. The ASDT Roles and Responsibilities Leading the evaluation and guidance for all phases of software development life cycle from requirements analysis to testing Managing and/or developing AWIPS II software infrastructure changes and additions Developing select AWIPS applications Facili
46、tating new science and technology infusion into AWIPS operations. Staffing and Resource Plan Government Team of five led by Jim Calkins Contractor Team of five utilizing Chugach contract (Same contractor that supports NCEP) Addition of 6 NCEP contractors January 2011,ASDT Near-Term Activities,Team A
47、ctivities Establishing AWIPS II development environment patterned after RTS Omaha and NCEP development environments Subversion CM/Version Control TRAC Task tracking and management Hudson Software build support Drafting AWIPS II development life cycle processes Initial focus on supporting local application migration,QUESTIONS ?,
