Photo of

Stephan Kessler

Developer, SAP

Stephan Kessler is a developer in a Research and Development Team at SAP Walldorf. He is working on the integration of SAPs query execution engines in the Spark eco-system. His main goals are improving the speed of Spark processing even more and bringing new features to the SQL extension. Before joining SAP, he did his PhD and his Diploma (M.Sc.) at the Karlsruhe Institute of Technology at the chair of database and information systems. Before joining the Big Data community his research interest covered privacy in databases as well as sensor networks.


The Pushdown of Everything

The DataFrame API of Spark SQL allows the easy integration of external sources such as SQL Databases, CSV files or Avro sources. In addition to this, Spark uses the computational capabilities of sources to ‘push­down’…