Speaker

Jingwei Lu, Member of the Data Infrastructure Team at Airbnb

Jingwei Lu

Member of the Data Infrastructure Team, Airbnb

Jingwei Lu is currently a member of the Data Infrastructure team at Airbnb. He was previously a tech-leader in Facebook data infrastucture team in charge of Bumblebee project (hive/hadoop replacement) query processing and language. Prior to Facebook he redesigned SCOPE(Microsoft equivalent of hive) runtime in Microsoft. Spent 10 years in Microsoft SQL Server engine team building commercial relational database engine.

Sessions

Building Data Product Based on Apache Spark at Airbnb

Building data product requires having Lambda Architecture to bridge the batch and streaming processing. AirStream is a framework built on top of Apache Spark to allow users to easily build data products at Airbnb. It… Read more