Spark Summit 2013 brought the Apache Spark community together on December 2-3, 2013 at the Hotel Nikko in San Francisco. It featured production users of Spark, Shark, Spark Streaming and related projects.
At Conviva we need to navigate the massive diversity that is the video delivery pipeline in order to help deliver high quality video experiences to every viewer. We have developed a real time decision making engine built on top of Spark to help deliver on that goal. The talk will cover in some detail how Spark allowed us to solve a realtime regression problem to predict and intelligently control video traffic over the internet, and how it is now becoming the backbone of our realtime data processing stack.