Spark Summit 2013 brought the Apache Spark community together on December 2-3, 2013 at the Hotel Nikko in San Francisco. It featured production users of Spark, Shark, Spark Streaming and related projects.
This presentation covers an overview of building next generation Big Data Operational Intelligence platform based on Apache Spark. As its use cases demanded near real time stream processing, Guavus enhanced its Hadoop based platform with Spark-Spark Streaming and Shark. The new platform provides both map-reduce and streaming paradigms for machine learning and analytics over time series. The presentation summarizes concepts, issues and adapted solutions in building the platform. The presentation covers its architecture combining pre-compute pattern and decision support analytics. The solution provides a pipeline of data ingestion, analytical computation, columnar storage and decision support queries. The presentation provides spectrum of details on topics ranging from data ingestion to achieving storage and performance optimized analytics using various probabilistic and machine learning algorithms.
Eric is Vice President, Core Systems Group at Guavus where he is responsible for leading design and development of the Guavus Reflex Platform. He has been involved in the mobile industry for more than 14 years in a variety of roles and capacities. Prior to Guavus, Eric was vice president of mobile applications at Teleca, overseeing all aspects of their global mobile applications solutions. In this role, he was responsible for building the strategy, sales and delivery capabilities needed to help accelerate the mobile application demands of the industry. Eric joined Teleca from Loopt, a venture-backed startup, where he served as vice president of Products and Location Technologies. Eric also held senior positions at inCode Wireless (acquired by Verisign), a leading mobile consulting firm where he led the creation of multiple service lines; at Telispark (acquired by InfoWave), a mobile enterprise software company he founded; and at Deloitte Consulting, a global leader in telecommunications strategy and operations services. Eric was a Ph.D. candidate and holds a Masters degree from Stanford University. He also graduated from Carleton College with a BA in Computer Science, Economics and Math.