In general, we presented a common benchmark for modern distributed stream computing system. It helps to characterize the stream system like Spark-streaming and Storm, from performance, reliability and availability perspectives. For example, Spark-streaming is good at high throughput and better fault tolerant. Meanwhile Storm can response quickly, but has some defects in complex computation case. In addition, it can also be the integration test suite to evaluate different release candidates.
Grace Huang is currently an engineering manager in Intel SSG (Software and Services Group), responsible for advanced Big Data technology enhancement and optimization including Hadoop, Spark and etc. Prior to that, she had been working in the big data area in Intel for over 6 years, with intensive experience on Hadoop, HBase performance tuning and optimization.