Wesley Miao, Engineer Manager at Microsoft

Wesley Miao

Engineer Manager, Microsoft

Now principle eng mgr leading a team working on Office365’s monitoring infrastructure and its advanced analytics pipeline based on Spark/Kafka/Cassandra. The goal is to enable intelligent monitoring/analytics for Office365’s service quality and user experience by using Spark as its primary big data computing engine and integrating Microsoft’s years of experience in ML and advanced streaming analytics. Prior to Microsoft, was senior engineering manager in Autodesk working on its cloud platform with one focus to create its real-time service monitoring infrastructure by Spark.


Temporal Operators For Spark Streaming And Its Application For Office365 Service Monitoring

While building intelligent monitoring and alerting system for Office365 service quality and user experience on top of Spark Streaming, the requirement is to use event application time for the majority of our monitoring logic -mostly… Read more