Speaker

Michael Armbrust, Software Engineer at Databricks

Michael Armbrust

Software Engineer, Databricks

Michael Armbrust is the lead developer of the Spark SQL project at Databricks. He received his PhD from UC Berkeley in 2013, and was advised by Michael Franklin, David Patterson, and Armando Fox. His thesis focused on building systems that allow developers to rapidly build scalable interactive applications, and specifically defined the notion of scale independence. His interests broadly include distributed systems, large-scale structured storage and query optimization. He was the 2011 recipient of the Sevin Rosen Award for Innovation.

Sessions

Expanding Apache Spark Use Cases in 2.2 and Beyond

2017 continues to be an exciting year for big data and Apache Spark. I will talk about two major initiatives that Databricks has been building: Structured Streaming, the new high-level API for stream processing, and… Read more

Easy, Scalable, Fault-Tolerant Stream Processing with Structured Streaming in Apache Spark

Last year, in Apache Spark 2.0, Databricks introduced Structured Streaming, a new stream processing engine built on Spark SQL, which revolutionized how developers could write stream processing application. Structured Streaming enables users to express their… Read more

Easy, Scalable, Fault-Tolerant Stream Processing with Structured Streaming in Apache Spark (continues)

Last year, in Apache Spark 2.0, Databricks introduced Structured Streaming, a new stream processing engine built on Spark SQL, which revolutionized how developers could write stream processing application. Structured Streaming enables users to express their… Read more