Data Engineer - DEFRA

Description:

Senior Data Engineer - Azure

Central government | Outside IR35 | Remote | 6 months +

SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets.

You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial.

Requirements:

Strong commercial experience delivering data engineering solutions in Azure.
Strong hands-on experience working with Azure Databricks
Experience working with geospatial, mapping or location intelligence datasets
Central UK government experience within recent 5 years
Experience developing large-scale distributed data processing workloads.
Strong Python and SQL development skills.
Experience working with Spark-based technologies.
Knowledge of modern cloud data platform patterns and architectures.
Experience building and supporting automated data pipelines.
Familiarity with CI/CD practices and modern software engineering principles.
Strong troubleshooting and performance optimisation skills.Details

Outside IR35
£450 a day
Remote based
6 month contract
Strong likelihood of extension

Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps