Aurora- a new model and architecture for data stream .ppt

1、Aurora: a new model and architecture for data stream management,Daniel J. Abadi1, Don Carney2, Ugur Cetintemel2, Mitch Cherniack1, Christian Convey2, Sangdon Lee2, Michael Stonebraker3, Nesime Tatbul2, Stan Zdonik2,1 Department of Computer Science, Brandeis University 2 Department of Computer Scienc

2、e, Brown University 3 Department of EECS and Laboratory of Computer Science, M.I.T.,Presenter: Saurin Kadakia,ABOUT ME,MS CS STUDENT GRADUATING IN DEC 08 INTERESTED IN DATABASES AND WEB TECHNOLOGY,WHAT ARE MONITORING APPLICATIONS?,MONITORING APPLICATIONS ARE APPLICATIONS THAT MONITOR CONTINUOUS STRE

3、AMS OF DATA.EXAMPLES? MILITARY APPLICATIONS FINANCIAL ANALYSIS APPLICATIONS TRACKING APPLICATIONS,TRADITIONAL DBMS ASSUMPTIONS,HUMAN ACTIVE, DBMS PASSIVE MODELONLY CURRENT VALUE IMPORTANTTRIGGERS/ASSERTIONS ARE SECONDARYQUERIES MUST HAVE EXACT ANSWERSNO REAL TIME SERVICE REQUIREMENTS,REALITY FOR MON

4、ITORING APPLICATIONS,DBMS ACTIVE, HUMAN PASSIVE MODELHISTORY OF VALUES REQUIREDTRIGGER ORIENTED APPLICATIONSAPPROXIMATE ANSWERS TO QUERIESREAL TIME REQUIREMENTS,SYSTEM MODEL,External data source,User application,Operator boxes,data flow,Continuous & ad hoc queries,Historical Storage,Aurora System,Ap

5、plication administrator,QUERY MODEL,Traditional Structured Query Language Declarative query on static data Aurora Data flow model for data stream Application manager will construct queries using GUI Stream Query Algebra Queries are processed by SQuAl operators on the data stream Some of the operator

6、s are filter, map, union, aggregate, join bsort, resample.,AURORA QUERY MODEL,b1,b2,b3,b4,b5,b6,b7,b8,b9,app,app,continuous query,view,ad-hoc query,Connection point,data input,AURORA QoS GRAPH TYPES,OPTIMIZATION,Filter,BSort,Filter,Union,Aggregate,Join,Aggregate,Map,Hold,Hold,pull data,Continuous qu

7、ery,Filter,Map,Ad hoc query,Join,Static storage,OPTIMIZATION,Dynamic continuous query optimizationInserting projections Combining boxes Reordering boxes,AURORA RUNTIME ARCHITECTURE,Buffer manager,Storage Manager,Persistent Store,Scheduler,Load Shedder,QoS Monitor,Catalog,Box Processors, ,Router,inputs,outputs,SUMMARY,Solution approach itself Rethink about everything for the requirements Query model Data flow style query specification Optimization Dynamic runtime optimization QoS specification based resource management,QUESTIONS?,