Our local government client is looking for an experienced Data Platform Engineer, temporary contract (1 month) in Melbourne, to assist with ongoing development of Data Platform to support data-driven decision making via reporting, analytics, and data science.
About the role-
Key Responsibility Areas
Data pipeline development:
Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from multiple sources into the data platform.
Data extraction and integration :
Collect and combine data from various sources like databases, APIs, and other storage solutions, ensuring data accuracy and integrity.
Data transformation
Develop and implement processes to transform raw data into clean, structured, and actionable information.
Data optimisation
Create processes for data optimisation and ensure data access and presentation align with business requirements.
Collaboration
Work with the Data Analytics Team and other business stakeholders to understand their needs and deploy solutions.
Qualifications, Experience and Competencies
- Relevant bachelor’s degree or equivalent experience in a related subject; computer science, mathematics, statistics, engineering or similar.
- Experience working with both on-prem and cloud data sources.
- Minimum 3 years’ experience with Azure Cloud environment, including data modelling and data engineering.
- Minimum 3 years’ experience of ingesting data via API, SFTP and Exports via email.
- Demonstrated working application in Azure Data Factory, Logic Apps and Key Vaults.
- Demonstrated working application in developing large, complicated MS SQL statements, procedures and functions.
- Ability to analyse and interpret large datasets to support business goals.
- A high level of skill in solving complex issues related to data systems.
- Experience working with MS Azure data services.
