Partner Event - Bring Your Own Kernel! Constructing High-Performance Data Systems

About this Event

Abstract

Data Management Systems increasingly abandon monolithic architectures in favor of compositions of off-the-shelf components. Storage layers like Parquet and Arrow are combined with kernels like Velox and RocksDB, and optimizers like Calcite. The interfaces between these components are, however, the same as 30 years ago: highly efficient but rigid. This rigidity obstructs the adoption of novel ideas and techniques such as hardware acceleration, adaptive processing, learned optimization, or serverless execution in real-world systems. To address this impasse, my group at Imperial is developing a novel approach to database composition inspired by early compiler-construction research: partial query evaluation. Under this paradigm, components communicate using a unified representation for data, code, execution plans, and any combination thereof. I present an implementation of the approach in a new system called BOSS and illustrate how BOSS achieves a fully composable design that is effective, elegant, and virtually overhead-free.

Bio

Holger is interested in all things data: analytics, transactions, systems, algorithms, data structures, processing models, and everything in between. His goal is to broaden the scope for data management which requires research on a wide variety of data models (relations, graphs, documents, …), hardware platforms (CPUs, GPUs, FPGAs, ASICs, …) and workloads (analytics, transaction processing, cleaning, inference, …). Holger is a Senior Lecturer/Associate Professor at Imperial College London. Before joining Imperial, he was a Postdoc at the Database group at MIT CSAIL. He spent his PhD years in the Database Architectures group at CWI in Amsterdam resulting in a PhD from the University of Amsterdam in 2015. He received his Master’s (Diplom) in computer science from Humboldt-Universität zu Berlin in 2010.