Exciting opportunity for an experienced Pipeline Engineer to join a Federal Government project on a long-term contract
About The Role
The Cloud Pipeline Engineer look to complete development activities across the Azure/AWS cloud-native technologies and some third-party products and transition existing workloads from legacy applications into the new patterns.
Our Ideal Job Seeker
The ideal candidate will possess some if not all of the below skillset:
For further information, please contact Haani Hussain from MTP Services on 0416 804 514, or via email at haani.hussain@mtpservices.com.au
The Cloud Pipeline Engineer look to complete development activities across the Azure/AWS cloud-native technologies and some third-party products and transition existing workloads from legacy applications into the new patterns.
Our Ideal Job Seeker
The ideal candidate will possess some if not all of the below skillset:
- Knowledge or experience in working with Azure/ ASW cloud native services as well as big data/analytics platforms (preferably Teradata Data Warehouse and/or Cloudera Hadoop),
- Languages including Java/NodeJS, MongoDB/ Mongoose/ DocumentDB, ExpressJS, SQL, python and Scala are essential.
- Proficiency in Agile project delivery methodology is required.
- Apache Spark: desirable but not essential
- Data warehouse: desirable
- Data modelling: desirable but not essential
- Apache Hadoop: desirable but not essential
- Linux: desirable but not essential
- Amazon Web Services (AWS): essential
- Azure Cloud services - essential
- ETL (extra, transform, load): desirable
- Big data analytics: desirable
- Software development: essential
- Develop in approved programming language and tools, construct, test solutions within a cloud-hosted environment
- Building out the Data acquisition pipeline in a cloud hosted environment across AWS and Azure cloud native technologies
- Experience with Data Catalogue and Lineage products and integration with cloud services
- Translate feature documentation into build patterns to apply in the data and analytics landscape taking into account the system landscape context
- Ensure technical build artefacts comply with build standards and patterns, incorporating security standards and branching compliance (and others)
- Own issue resolution arising from build reviews (including security, integration, technical challenges), escalating to Technical Chapter Lead via Scrum Master for support when needed
- Provide system context (where known) as inputs to technical adoption and delivery implementation
- Identify and validate variations from technical frameworks/practices, and where appropriate either correcting to align with practices or escalating agreed variations for branch updates
- Conduct code peer reviews and ensure code is checked in on time for production releases and test environments; conducting TDV as appropriate
- Assist in planning, prioritisation and readiness of features for commitment prior to delivery
- Responsible for the breakdown of stories within the features; and identifying the tasks within the stories assigned to them
- Ensure TFS reflects correct integrated releases and tags
- Participate in unit testing activities – management of data, test resolution where needed and oversee the completion of TFS tasks, incorporating test sign offs
- Working with environments team to ensure system integration
- Collaborate with the Test/Environment/ DevOps teams to develop the automated test and deployment processes
- Investigate bugs or incidents and contribute to tech bridge as required
- Provide support documentation for the maintenance team
- Hold demonstrations of delivery outcomes for stakeholders
For further information, please contact Haani Hussain from MTP Services on 0416 804 514, or via email at haani.hussain@mtpservices.com.au