Shubham Chopra, Software Engineer at Bloomberg

Shubham Chopra

Software Engineer, Bloomberg

Shubham is a software engineer on the Spark Platform team at Bloomberg. He has been a long time user of Hadoop and Spark. He previously contributed to Apache Pig and helped develop the ‘illustrate’ function. He is currently working on improving Spark’s reliability for online analytics.


Spark and Online Analytics

Apache Spark was designed as a batch analytics system. By caching RDDs, Spark speeds up jobs that iteratively process the same data. This pattern is also applicable to online analytics. We use Bloomberg’s Spark Server… Read more