Lead Engineer - Cloud Engineer for Analytics (DevOps, Data & Services)

Talent Insights Group

Lead Cloud Engineer - DevOps with Big Data, GCP & Machine Learning environment. Great team! Interesting Data!

  • Engineering Lead - Machine learning / large data sets
  • Work with data scientists to build data, machine learning and analytics products
  • Competitive salary package + bonus
We are working with a large brand that has millions of customers and some truly interesting data sets to find a Lead Cloud Engineer working with GCP (Google Cloud Platform). The initial focus of this role will be to provide hands-on technical and team leadership on DevOps, Data, Automation, CI/CD for their new cloud data platform. You will help advise, design and build new greenfield data solutions and platforms to advance their analytics & machine learning capabilities with streaming data and other large datasets.

Your key stakeholders will be the head of data engineering, the lead data + machine learning engineer and the data science team. The ultimate goal is to radically transform and uplift the organisational analytics maturity and to build data-driven tools, recommendation systems and products. 

The Role:

As an integral part of the data engineering team, you will bring expertise in Docker/Kubernetes, CI/CD, automation, security and programming (Java, Scala or Python) in production cloud environments. Your work will enable scalable, robust data foundations and environments for advanced Machine Learning and data science solutions. 

Required skills and experience:
  • Significant hands-on devops / data engineering in a production cloud environments (GCP, AWS OR Azure), including using Docker & Kubernetes
  • Good software engineering skills with; Scala and/or Python or Java and strong understanding about setting up good CI/CD
  • Solid experience securing and supporting data pipelines in a cloud or Spark + Hadoop environment
  • Several years working in big data and/or fast data systems, ideally some exposure to Kafka, Spark and some streaming data frameworks (e.g. Pubsub, Kinesis, Flink, Spark Streaming)
  • Experience with streaming/near real-time data pipelines such as; Kafka, Kineses or Pub-Sub
  • A practical understanding of applying software and engineering best-practices to data and analytics
  • Excellent stakeholder management - the ability to present ideas to diverse teams, and also consider other expert/SME points of view in a collaborative data science + engineering practice
Benefits of this role:
  • A newly created position and great opportunity to have an immediate impact
  • Be responsible for hands-on tech and team leadership with data platform
  • Strong connection between your work and tangible commercial results
  • Working with data scientists to build data, machine learning and analytics ‘products’
  • Competitive salary package + bonus
  • Very strong technical leadership
This is not with a bank, retail company or consulting business. You will be able to work with source data, the key stakeholders and decision-makers and closely with the analytics & data science team! 

This role is not suitable for graduates. 

To apply, please submit your CV, profile and/or Cover Letter with contact details via the links, or alternatively, email Patrick@TalentInsights.com.au with the Job Reference as your email subject