Data Platform Engineer

Description:

Data Platform Engineer

London (Hybrid)

6 Month Contract

£(Apply online only)/day (Inside IR35)

Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

In-depth Data Engineering experience + AWS cloud data platform migration experience.

The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions.

Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms.

Strong Terraform + Infrastructure as Code (IaC) skills including developing + maintaining Terraform code to support data platform deployments.

Supporting deployment of data platform components, jobs, permissions + environment configurations.

Analysing current Data Engineering solutions + identifying data migration requirements.

Onboarding datasets, users + workloads onto target platform.

Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation.

AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps principles, Agile Delivery.

Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS / Healthcare data experience.

Government / (url removed) / Public Sector domain experience strongly preferred.

Must be active SC Cleared or fully eligible to undergo the full SC Security Clearance process