Spark Summit 2014 brought the Apache Spark community together on June 30- July 2, 2014 at the The Westin St. Francis in San Francisco. It featured production users of Spark, Shark, Spark Streaming and related projects.
Data transfer is one of the most pressing problems facing companies in the telecoms industry today. As data requirements grow by the month, so too do the costs. To a certain point, MapReduce has been sufficient for the company. But huge increases in requirements brought about by using smartphones have started to create serious business bottlenecks, with the need for near real-time analytics reports on the massive warehouse load of petabytes of data and growing by the day. Clearly, a more fundamental shift was required. In this presentation, Jungryong Lee will detail how this problem was dealt with; how to improve CEI(Customer Experience Improvements) with Spark and Spark Streaming; and how Spark, Shark and YARN is used for high-speed large enterprise data processing.
Jungryong Lee is an IT manager of SK Telecom(SKT), South Korea’s largest wireless communications provider. Big data analysis of SKT mainly focuses on the customer retention and customer experience improvements, and it essentially needs sophisticated real-time data processing. This is his first proposal for speaking in the open-source conference and he is really hoping to share his experience with the community.