Databricks was founded by the team who created Apache® Spark™, a powerful open source data processing engine built for sophisticated analytics, ease of use, and speed. Databricks is the largest contributor to the open source Apache Spark project providing 10x more code than any other company. Our mission is to make big data simple, building the tools and technologies that allow everyone to gain deep insights and extract values from real-world data.
Your team will consist of 7-10 engineers who work as a Scrum development team running two-week sprints.
You will join our team in Amsterdam who strive to make the Databricks Runtime the fastest execution engine for Apache Spark, with projects spanning the query optimizer, physical execution, and the I/O layer.
As tech lead, you will be responsible for end-to-end technical ownership of some projects, guiding one or more additional team members. You will also provide feedback on the design and technical direction of other projects undertaken by the wider team.
You will work in close collaboration with PM and Eng. leadership to develop the team’s short and long term roadmap. You will work with engineering management to ensure high technical standards for the team’s output by instituting appropriate process and culture.
As an engineer at Databricks you are responsible for developing the future of Internet-scale distributed production pipelines. You will be empowered to take a customer-first approach to solving problems. Our users range from small companies doing periodic analysis to Fortune 500 companies creating just-in-time data warehouses to do real-time machine learning and artificial intelligence on web-scale data. Your team designs, plans, implements and maintains the platform they build upon. This demands a high degree of critical thinking, customer focused design, and problem solving. We are looking for engineers who will bring revolutionary ideas to an area that is largely siloed to data engineering, data science, and machine learning teams in large organizations. You will help us change that, freeing everyone to analyze and extract value from their data.