Photo of

Gianmario Spacagna


Scala, Distributed Computing, Hadoop, Big Data, Spark, Data Mining, Networking, Stochastic Mathematical Modelling


Hundreds of queries in the time of one

We built a domain specific querying engine that can take an arbitrary number of statistical queries and turn this into a single fixed stage Spark job that has a single pass over our transactional data.…