Title: DBToaster – Compiling Database Queries for Aggressively Incremental Evaluation

Speaker:
Prof. Dr. Christoph Koch
École polytechnique fédérale de Lausanne (EPFL), Switzerland
http://people.epfl.ch/christoph.koch


Abstract:

DBToaster is a compiler developed at EPFL and Johns Hopkins University that turns database queries into highly efficient machine code that keeps query results (views) fresh at very high update rates. Our compiler enables new applications in online and real-time analytics, monitoring, and low-latency algorithmic trading by offering declarative analytics at the speed that these applications require.

In this talk I present an incremental evaluation framework that allows a query optimizer to extend the use of materialized views from answering user queries to also answering the delta queries that database systems use to incrementally maintain the views. The aggressive recursive use of this idea can eliminate all or most classical operators (such as joins) from query plans. This calls for the compilation to machine code, rather than the interpretation of query plans consisting of large monolithic operators, which is the method prevalent in database management systems. Extensive experimentation with DBToaster, our implementation of these ideas, as well as existing DBMS and stream engines shows that DBToaster has the potential to deliver view refresh rates that are by several orders of magnitude higher than those of state-of-the-art systems, enabling new low-latency and real-time applications.

This is joint work with Oliver Kennedy (EPFL, soon University at Buffalo) and Yanif Ahmad (Johns Hopkins University).


Bio:

Christoph Koch is a professor of Computer Science at EPFL, specializing in data management. Until 2010, he was an Associate Professor in the Department of Computer Science at Cornell University. Previously to this, from 2005 to 2007, he was an Associate Professor of Computer Science at Saarland University. Earlier, he obtained his PhD in Artificial Intelligence from TU Vienna and CERN (2001), was a postdoctoral researcher at TU Vienna and the University of Edinburgh (2001-2003), and an assistant professor at TU Vienna (2003-2005). He obtained his Habilitation degree in 2004. He has won Best Paper Awards at PODS 2002, ICALP 2005, and SIGMOD 2011, a Google Research Award (in 2009), and an ERC Starting Grant (in 2011). He (co-)chaired the program committees of DBPL 2005, WebDB 2008, and ICDE 2011, and was PC vice-chair of ICDE 2008 and ICDE 2009. He has served on the editorial board of ACM Transactions on Internet Technology as well as in numerous program committees. He currently serves as PC co-chair of VLDB 2013 and Editor-in-Chief of PVLDB.