Speaker

Fang Cao, Senior Staff Engineer at Huawei Technologies

Fang Cao

Senior Staff Engineer, Huawei Technologies

Fang Cao is a Senior Staff Software Engineer at Huawei Technologies where he works on building a big data analytics platform based on Apache Spark. Prior to joining Huawei, he was a Senior Software Engineer at Cisco and Lucent. Fang holds a Master’s degree in Computer Science from the University of Wisconsin at Madison.

Sessions

Enhancing Spark SQL Optimizer With Reliable Statistics

In Spark SQL’s Catalyst optimizer, many rule based optimization techniques have been implemented, but the optimizer itself can still be improved. For example, without detailed column statistics information on data distribution, it is difficult to… Read more