Big Data Architect

enableIT

We are looking for a Big Data/Software Architect to help with the strategic architecture, engineering and deployment of a Big Data ecosystem.

  • Big Data solutions with technologies like Hadoop, Hive, Spark
  • Spark Streaming, Apache Flink/Storm, and Apache Kafka
  • You know different ingestion patterns and ETL processing mechanisms


We are looking for a Big Data/Software Architect to help with the strategic architecture, engineering and deployment of a Big Data ecosystem. 

What You'll Do

• You have a successful track record architecting Big Data solutions with technologies like Hadoop, Hive, Spark.
• You know how Hadoop or Spark behaves in large scale map / redistribution events, and how to create efficient jobs minimizing overhead and unnecessary intermediates.
• You have opinions on big data serialization formats like ORC, Parquet, Avro.
• You have experience with Java and/or Scala development, with specific experience in supporting data science activities across both notebook development and production code.
• You know how to design effective streaming systems using technologies like Spark Streaming, Apache Flink/Storm, and Apache Kafka.
• You know different ingestion patterns and ETL processing mechanisms and ability to drive standard implementations across organization.
• You have a high bar for operational excellence; ability to quickly lead team through issues resolution, root cause analysis and successfully prioritize corrective action.
• You're a great teammate with a dedication to grow others around you through technical curiosity and collaboration.
• You enjoy mentoring junior engineers and promote a culture of continuous learning; take an active role improving the overall potential of the group.
• You have a real passion for designing and leading the implementation of resilient, distributed software platforms and large-scale data infrastructures.
• You have a desire to learn about, evaluate and appropriately drive team adoption of new technologies and methodologies.