Software Engineer – Tech Lead (Databricks)

Databricks was founded by the team who created Apache® Spark™, a powerful open source data processing engine built for sophisticated analytics, ease of use, and speed. Databricks is the largest contributor to the open source Apache Spark project providing 10x more code than any other company. Our mission is to make big data simple, building the tools and technologies that allow everyone to gain deep insights and extract values from real-world data.

Your team will consist of 7-10 engineers who work as a Scrum development team running two-week sprints.
You will join our team in Amsterdam who strive to make the Databricks Runtime the fastest execution engine for Apache Spark, with projects spanning the query optimizer, physical execution, and the I/O layer.
As tech lead, you will be responsible for end-to-end technical ownership of some projects, guiding one or more additional team members. You will also provide feedback on the design and technical direction of other projects undertaken by the wider team.

You will work in close collaboration with PM and Eng. leadership to develop the team’s short and long term roadmap. You will work with engineering management to ensure high technical standards for the team’s output by instituting appropriate process and culture.

As an engineer at Databricks you are responsible for developing the future of Internet-scale distributed production pipelines. You will be empowered to take a customer-first approach to solving problems. Our users range from small companies doing periodic analysis to Fortune 500 companies creating just-in-time data warehouses to do real-time machine learning and artificial intelligence on web-scale data. Your team designs, plans, implements and maintains the platform they build upon. This demands a high degree of critical thinking, customer focused design, and problem solving. We are looking for engineers who will bring revolutionary ideas to an area that is largely siloed to data engineering, data science, and machine learning teams in large organizations. You will help us change that, freeing everyone to analyze and extract value from their data.

Minimum Competencies

  • Excellent problem analysis and solving skills.
  • Excellent communication and teamwork.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Proven ability to guide projects and mentor engineers in teams of 10+
  • Solid understanding of computer systems and networks.
  • Production quality coding standards and patterns.
  • Passion for developing amazing customer experiences.
  • 4+ years of general software programming experience.
  • BS in Computer Science, Math, related technical field or equivalent practical experience.

Preferred Competencies

  • 6+ years of modern, production level experience in one of: Java, Scala, JavaScript, or C++.
  • Experience in a tech lead role at an enterprise software company
  • Experience with: Large scale distributed computing, Database internals, Big Data engines e.g. Spark, Hadoop
  • Experience building production features for an industrial strength Database engine
  • MS or PhD in Computer Science with specialization in Databases


  • Provide guidance on design direction, code structure and quality to team members working across multiple concurrent projects.
  • Ensure high technical standards by working with Eng. managers and instituting appropriate process and culture.
  • Work closely with PM to understand customer needs and develop the team’s feature roadmap in collaboration with PM and Eng. leadership.
  • Write code for Databricks Runtime and provide feedback to the pull requests of other team members.
  • Have full ownership of their own deliverables including: Designing, Implementing, Testing and Metric Analysis.
  • Have a high standard of code quality and testing.
  • Proactively seek feedback and input from other team members and teams.
  • Become familiar with the team’s ongoing projects, current deliverables, roadmap and key stakeholders



Job posted 9/19/2017