Senior Data Engineer

Job Details
Careers Logo
Department: Department of Energy, Environment and Climate Action
Work Type: Ongoing - flexible
Job Function: Technology
Classification: VPSG5
Work Location: Negotiable
Reference: VG/50932887A
Closing Date: 29-May-2024
Salary Range: $106,534 - $128,897
Job Duration: N/A
Attachments: Position Description Senior Data Engineer.docx (Word, 601KB)


Contact: Joe Jacobs
0427947692 or Joe.Jacobs@agriculture.vic.gov.au

Position Details

Do you want to be part of the solution to keeping Victoria safe from Bushfires and other emergency events? Is climate response important to you?

Data Analytics and Information Systems (DAIS) is a team of about 80 technical specialists, who discover, design, develop and deliver a complex and integrated suite of products and platforms enabling DEECA to plan, monitor and respond to Bushfires and other Emergencies.

Over the past few months, the DAIS team has been co-designing their new business model, which establishes a product lifecycle framework, launches a Development Security Operations approach and builds a portfolio view of the priority work across the team. In the early days of embedding the new model, we are recruiting key new roles to lead and establish the strategies and new practices with the team. 

We are not looking for a unicorn, but we will give you the opportunity to become one.

Specialist/Technical Expertise/Qualifications

Essential

  • Experience with the Azure Cloud platform including the following services:
    • Azure Data Factory
    • Azure Data Lake and Data Lakehouse concepts
    • CosmosDB
    • Python
  • Demonstrated skills and experience of Microsoft SQL Server including:
    • Ability to develop and maintain complex SQL queries and Stored Procedures involving advanced SQL functionality such as temporal tables, recursive CTEs and TVFs.
    • Query optimisation techniques including reviewing execution plans, creating indexes, using database locking hints, and refactoring T-SQL statements.
    • Deep understanding of the SQL Server database cloud platform.
  • Expertise in creating ADF data pipelines to ingest data from a variety of sources such as SharePoint, REST API, Data Lake storage etc.
  • Demonstrated understanding of Devops principles and implementing and applying Source Code Management using Azure Devops and Git in ADF, Python and Azure Databricks projects.
  • Highly proficient in SQL, Python and accessing data via API calls
  • In-depth ETL / ELT experience
  • Strong experience & advanced knowledge of OLAP data modelling methodologies such as Inmon and Kimball
  • Proficiency in building, maintaining and refactoring transactional (normalized) data models

Desirable

  • Familiarity with EAV (Entity Attribute Value) data structures
  • Azure Function Apps
  • Knowledge of and/or experience with Business Intelligence Reporting
  • Knowledge and experience in design, build, test and deploy stages of advanced API solutions
  • Experience with Databricks
  • Experience with Terraform

This is an ongoing position. The work location for this position is flexible within Victoria with hybrid work arrangements available.

To be considered for this position, applicants are encouraged to submit a resume and cover letter (no longer than 2 pages) summarising their skills and relevant experience.

For further information please refer to the attached position description.

Applications close at midnight on Wednesday, 29 May 2024.

Other relevant information:

For this particular vacancy, priority consideration applies to Victorian Public Service (VPS) and select employees of the Victorian Public Sector who apply through the Jobs and Skills Exchange (JSE) jobs board platform.

Preferred candidates will be required to undertake pre-employment screening, including a Declaration and Consent form and a National Police Check. 

To be eligible for appointment to this role, applicants will possess corresponding work rights for the advertised employment period. Appointment to an ongoing position is only available to an Australian/New Zealand citizen or an Australian Permanent Resident. 

A Diverse, Inclusive and Flexible Workplace

DEECA welcomes applicants from a diverse range of backgrounds and we focus on the essential requirements of the job and being consistent and fair in our treatment of all applicants. We also understand that a balanced life is important to our employees. Talk to us about our flexible options such as working some days from home, starting early or late, working part time, job sharing or accessing paid or unpaid leave.


From here...