Speaker

Yizhen Liu, Staff Software Engineer at Huawei Technologies

Yizhen Liu

Staff Software Engineer, Huawei Technologies

Yizhen Liu is a Staff Software Engineer at Huawei Technologies where he works on building a big data analytics platform based on Apache Spark. Prior to joining Huawei, he was a Staff Software Engineer at Netentsec. Yizhen holds a PhD degree in Electrical Engineering from the Beijing University of Posts and Telecommunications.

Sessions

Enhancing Spark SQL Optimizer With Reliable Statistics

In Spark SQL’s Catalyst optimizer, many rule based optimization techniques have been implemented, but the optimizer itself can still be improved. For example, without detailed column statistics information on data distribution, it is difficult to… Read more