Speaker

Haohai Ma, Software Architect at IBM

Haohai Ma

Software Architect, IBM

Haohai Ma is a Software Architect at Spectrum Computing, IBM. In the past 10 years, he is the expertise on HPC, SOA, MapReduce, Yarn, Spark , Docker and Kubernetes. He is one of the major contributors of IBM BigData offerings. Haohai holds PhD in Computer Science from Peking University

Sessions

Running Spark Inside Docker Containers: From Workload to Cluster

This presentation describes the journey we went through in containerizing Spark workload into multiple elastic Spark clusters in a multi-tenant kubernetes environment. Initially we deployed Spark binaries onto a host-level filesystem, and then the Spark… Read more