IT Pipeline Engineer

MTP Services

Exciting opportunity for an experienced Pipeline Engineer to join a Federal Government project on a long-term contract

About The Role
The Cloud Pipeline Engineer look to complete development activities across the Azure/AWS cloud-native technologies and some third-party products and transition existing workloads from legacy applications into the new patterns.

Our Ideal Job Seeker
The ideal candidate will possess some if not all of the below skillset:
  • Knowledge or experience in working with Azure/ ASW cloud native services as well as big data/analytics platforms (preferably Teradata Data Warehouse and/or Cloudera Hadoop),
  • Languages including Java/NodeJS, MongoDB/ Mongoose/ DocumentDB, ExpressJS, SQL, python and Scala are essential.
  • Proficiency in Agile project delivery methodology is required.
  • Apache Spark: desirable but not essential
  • Data warehouse: desirable
  • Data modelling: desirable but not essential
  • Apache Hadoop: desirable but not essential
  • Linux: desirable but not essential
  • Amazon Web Services (AWS): essential
  • Azure Cloud services - essential
  • ETL (extra, transform, load): desirable
  • Big data analytics: desirable
  • Software development: essential
Day to Day duties include
  • Develop in approved programming language and tools, construct, test solutions within a cloud-hosted environment
  • Building out the Data acquisition pipeline in a cloud hosted environment across AWS and Azure cloud native technologies
  • Experience with Data Catalogue and Lineage products and integration with cloud services
  • Translate feature documentation into build patterns to apply in the data and analytics landscape taking into account the system landscape context
  • Ensure technical build artefacts comply with build standards and patterns, incorporating security standards and branching compliance (and others)
  • Own issue resolution arising from build reviews (including security, integration, technical challenges), escalating to Technical Chapter Lead via Scrum Master for support when needed
  • Provide system context (where known) as inputs to technical adoption and delivery implementation
  • Identify and validate variations from technical frameworks/practices, and where appropriate either correcting to align with practices or escalating agreed variations for branch updates
  • Conduct code peer reviews and ensure code is checked in on time for production releases and test environments; conducting TDV as appropriate
  • Assist in planning, prioritisation and readiness of features for commitment prior to delivery
  • Responsible for the breakdown of stories within the features; and identifying the tasks within the stories assigned to them
  • Ensure TFS reflects correct integrated releases and tags
  • Participate in unit testing activities – management of data, test resolution where needed and oversee the completion of TFS tasks, incorporating test sign offs
  • Working with environments team to ensure system integration
  • Collaborate with the Test/Environment/ DevOps teams to develop the automated test and deployment processes
  • Investigate bugs or incidents and contribute to tech bridge as required
  • Provide support documentation for the maintenance team
  • Hold demonstrations of delivery outcomes for stakeholders
Candidates must have current Baseline Clearance

For further information, please contact Haani Hussain from MTP Services on 0416 804 514, or via email at haani.hussain@mtpservices.com.au