Details:
- Salary: £700 - 800 - Day
- Job Type: Contract
- Job Status: Full-Time
- Salary Per: Day
- Location: London
- Date: 3 weeks ago
Description:
This Senior Data Architect role is to work across a major Data Management and Data Analytics Transformation programme.
This will be an initial 6-month contract. INSIDE iR35. £700 - £800 per day (DOE).
The primary focus will be to help guide the company on their Data Management approach alongside the build out of their Enterprise Data Platform (EDP). The candidate will support on design work, and ensure that this is implemented appropriately. You will work closely with Data Architecture, Data Management, The EDP product owner and the Technology team delivering the EDP.
Data Lake Structure and Design:
Validate the medallion model data lake structure (bronze, silver, gold) as the optimal approach and recommend alternatives if needed.
Create a Data Lake design including namespace hierarchy, and naming standards.
Design to optimise storage and retrieval based on data types, usage patterns, and the emerging Data Domain segregation.
Establish policies for moving data between different storage tiers within the data lake (e.g. hot, warm, cold storage) based on access frequency and cost considerations.
Establish policies for data integrity, consistency, conformance, and accuracy when transforming data from Bronze to Silver, and Silver to Bronze.
Develop a Data Modelling Design, including a Data Model and Schema, to ensure data is organised and connected (integrated/interoperable) effectively.
Do it in a way that supports the achievement of prioritised Use Cases and Business Objectives.
Technical and Business Metadata Management:
Develop a strategy for technical and business metadata capture on Databricks Unity Catalog and Purview, ensuring seamless integration between the two.
Define the technical and business metadata required at different layers (Bronze, Silver, Gold).
Implement integration with Azure Purview for data cataloging and governance to maintain consistency in metadata management.
Facilitate FinOps strategy through metadata definition.
Data Management and Governance (working closely with a Data Management team):
Review and assess the Data Ownership Framework, adapt it (without major deviation) to the cloud platform following industry best practices.
Consider whether the emerging Data Domain hierarchy should play a part in Data Ownership.
Partner with Technology to develop an access control model and define data access policies.
Define granular controls on usage