Speaker

Khalid Ahmed

Chief Architect of Infrastructure Software, IBM

Khalid Ahmed is an STSM, Chief Architect of Infrastructure Software at IBM Spectrum Computing. He works on the design and architecture of large scale grid and cloud computing systems with focus on scheduling, resource, workload and data management. In over 20 years at industry experience he has worked in a number of roles including development, product management and architecture. His latest interests include big data systems, container technology and data center operating system concepts. Khalid has a M.A.Sc from University of Toronto.

Sessions

Running Spark Inside Docker Containers: From Workload to Cluster

This presentation describes the journey we went through in containerizing Spark workload into multiple elastic Spark clusters in a multi-tenant kubernetes environment. Initially we deployed Spark binaries onto a host-level filesystem, and then the Spark… Read more