Yanbo Liang, Software Engineer at Hortonworks

Yanbo Liang

Software Engineer, Hortonworks

Yanbo is an Apache Spark Committer working on MLlib and SparkR at Hortonworks. His main interests center around implementing effective machine learning algorithms and building machine learning applications based on scalable distributed system. He is an active Apache Spark contributor, delivered the implementation of some major MLlib algorithms. Prior to Hortonworks, he was a software engineer at Yahoo! and France Telecom working on machine learning and distributed system.


Scaling Apache Spark MLlib to Billions of Parameters

Apache Spark MLlib provides scalable implementation of popular machine learning algorithms, which lets users train models from big dataset and iterate fast. The existing implementations assume that the number of parameters is small enough to… Read more