Speaker

Kelvin Chu, Engineer at Uber

Kelvin Chu

Engineer, Uber

Kelvin is a founding member of the Hadoop team at Uber. He is creating tools and services on top of Spark to support multi-tenancy and large scale computation-intensive applications. He is creator and lead engineer of Spark Uber Development Kit, Paricon and SparkPlug services which are main initiatives of Spark Compute at Uber. At Ooyala, he was co-creator of Spark Job Server which was an open source RESTful server for submitting, running, and managing Spark jobs, jars and contexts. He implemented real-time video analytics engines on top of it by datacube materializations via RDD.

Sessions

Spark Uber Development Kit

At Uber, the major workload of our Hadoop clusters are running on Spark. Some examples are applications in mappings, frauds, machine learning and data science. To make creation and management of Spark jobs easy, we… Read more

Locality Sensitive Hashing By Spark

Locality Sensitive Hashing (LSH) is a randomized algorithm for solving Near Neighbor Search problem in high dimensional spaces. LSH has many applications in the areas such as machine learning and information retrieval. In this talk,… Read more