Speaker

Shivnath Babu, Professor of Computer Science at Duke University

Shivnath Babu

Professor of Computer Science, Duke University

Shivnath Babu is an Associate Professor of Computer Science at Duke University and the CTO at Unravel Data Systems. His research focuses on ease-of-use and manageability of data-intensive systems, automated problem diagnosis, and cluster sizing for applications running on cloud platforms. Shivnath co-founded Unravel to solve the application management challenges that companies face when they adopt systems like Hadoop and Spark. Unravel originated from the Starfish platform built at Duke which has been downloaded by over 100 companies. Shivnath has received a U.S. National Science Foundation CAREER Award, three IBM Faculty Awards, and an HP Labs Innovation Research Award.

Sessions

Understanding Memory Management In Spark For Fun And Profit

Allocation and usage of memory in Spark is based on an interplay of algorithms at multiple levels: (i) at the resource-management level across various containers allocated by Mesos or YARN, (ii) at the container level… Read more