Data Engineer

Australian Citizens with the ability to obtain Baseline Clearance residing in Australia only respond.

• Contract start 05 February 2024 to 6 months, 2 x 6 months extensions.
• Australian Citizen, baseline Clearance preferred, Canberra or offsite role.

The role of the Policy, Markets and Data Branch is to provide insights, solutions and advice to decision makers, policy makers and the market to improve scheme operations and position the agency as a modern, efficient and effective regulator.

The Data and Innovation section supports the agency to unlock the potential of our data to drive innovation and compliance for the agency. With a major uplift in data capability for the Agency, planned and delivered through our change program, there are vast opportunities to be a key contributor to drive, design and deliver policies, frameworks, and infrastructure to suit the agencys data operation needs.

You will be part of a dedicated team that will clarify accountability to better enable crucial products needed to support program-level transparency and efficiency in data migration, data architecture design and analytics.

• Harmonizing the data migration, data architecture design and analytics across different schemes needed to effectively manage resources and delivery operations.

• Collecting data in an unformed and consistent way.

• Decrease the data migration complexity with well-defined common entity designs across the projects.

• Defining a common set of semantics being managed and reflected in the data architecture.

• Hold workshops to determine common and specific data attribution for each scheme.

• Implement data pipelines across D365 into DataLake and Synapse Analysis

• Minimum 7 years experience as a data engineer within the data and analytics domain

• Strong project delivery toolset experience in data integration tools

• Experience with processing large volumes of complex data.

• Ability to assess complexity of data (volume, structure, relationship etc.)

• A strong understanding of data modelling, data structures, databases, and processes

• Implemented Azure DecOps CI/CD with custom parameters for build and release pipelines for Data Factory, Synapse, and data lake artifacts.

• Hands on technical expertise implementing and delivering data solutions and pipelines in Azure.

• Hands on technical expertise working with DataLake and Synapse Analytics

• Hands on technical expertise working with Dynamics 365 Dataverse and SQL data sources.

• Hands on technical expertise setting up DevOps automation using tools such as GitHub etc.

• Experience building data profiling, data cleansing and data engineering frameworks.

• Exceptional communication, documentation, and presentation skills

• Will require Australian Citizenship with a Baseline Security clearance as a minimum.

Every application requires to address selection criteria as part of application submission.

1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description.

Originally posted on Himalayas