Spark Architect (IBM)

Job description
IBM is one of the world‘s largerst providers of information technology solutions and business consultancy. Our vision is to bring a new level of ‚smart‘ to how the world works. A place where people, businesses, governments and systems are interconnected and work together. A place where billions of people will live and work better.

The Spark Development Lead will be responsible for the technical design and execution of the Use case for the Customer. The Spark Development Lead will work with other Analytics Team members to finalize the technical requirements; identify the appropriate technical resources; then manage the technical resources throughout the process and be responsible for the Solution that we deliver towards our client.

This role is a resource with deep technical design and development expertise with experience in Open Source space. You have worked hands on, on Spark SQL, Spark MLlib, Spark R and Spark Streaming and can fit this technology into other technical client requirements.

Experience with technologies including – Hadoop, HBase, Hive, Pig, Jaql, Lucene, Avro, Zookeeper, R and UIMA technologies are very welcome. Modeling NoSql data stores and having a good understanding of working with MapR or map reduced type programming.

This role is a hands on technical expert and has experience in working with large delivery teams delivering complex projects and leading it from Architecture and technical point of view.

Experience in areas of optimizing management of and deriving insights from non-structured non-relational data, and provide business value from content through improved information management is key. Apply semantic correlation, ontology and text analytics techniques and systems to analyze non-structured data and identify critical insights for overall business analytics across various domains. Experience in analyzing text, streams, documents, social media, big data, speech with emerging Hadoop-based big data, NoSQL, Natural Language Processing, Search and Text analytics technologies and techniques. Responsible for leading development and validation of proposed use cases, using Agile Software development methodologies

The Spark Development Lead will possess the following experience:

  • Experienced client facing consultant with strong ability to get requirements and translate to specifications
  • Strong ability to manage project scope, mitigate risk and drive to project completion
  • Experienced with Spark software stack
  • Prior experience in architecting a Spark Solution
  • Experience in advanced analytics, statistical modeling, and mathematics
  • Experience with Open Source analytics
  • Experience in Data Modeling, Analytics and mining

    For AT: Reference Salary EUR EUR 51.940,00,- p.a. Possibility for overpayment is based on education and experience.


  • Master’s Degree
  • English: Fluent


  • Information Technology

Additional information
We gently encourage women to send their applications. Although the opportunities in education and development are the same as for men, there is a discrepancy of gender quantity in IT companies.

IBM will offer you excellent learning and training opportunities, interaction with clients with challenging responsibilities on local and international projects. Furthermore IBM offers unmatched career growth and development opportunities.

Please, don’t hesitate to send your complete application documents online. We are looking forward to meeting you.




Job posted 10/23/2015