Spark Summit 2014 brought the Apache Spark community together on June 30- July 2, 2014 at the The Westin St. Francis in San Francisco. It featured production users of Spark, Shark, Spark Streaming and related projects.
Nowadays data-intensive processes and organizations of all sorts require the use of real-time data with increasing flexibility and complexity.
We created Stratio Streaming to meet this demand. Stratio Streaming is the union of a real-time messaging bus with a complex event processing engine using Spark Streaming. Thanks to this technology, Stratio Streaming allows the creation of streams and queries on the fly, sending massive data streams, building complex windows over the data or manipulating the streams in a simple way by using an SQL-like language. We selected the open source Siddhi CEP engine and Apache Kafka, a Real Time messaging bus to this end.
Stratio Streaming’s API masks the complexity of the system so that developers can work with live streams straightaway. The engine Stratio Streaming also offers built-in solution patterns which solve typical use cases and common problems related to streaming. Additionally, we have added global features to the engine such as auditing and statistics.
This talk will describe how Stratio Streaming has been designed, its main capabilities and how it can be used to manage a sensor grid in a live demo.
David Morales joined Stratio as a Big Data Architect at Stratio.
Oscar Mendez is co-founder and CEO of Stratio.