Details:
- Salary: £85,000 - 130,000 - Annum
- Job Type: Permanent
- Job Status: Full-Time
- Salary Per: Annum
- Location: London
- Date: 1 week ago
Description:
TRM-International are hiring on behalf of a Wholesale financial Institute. We are seeking a Data Infrastructure Engineer to develop and maintain their enterprise Data Platform. The platform aims at serving data processing, data consumption, business intelligence analytical tools, and development applications.
This is an attractive opportunity for you as a Data Infrastructure Engineer to integrate into a respectable position within a leading and established organisation. There will also be long-term career progression along-side an intellectual and friendly team.
Objectives and responsibilities of this role
Oversee all the platform’s technical facets to provide best-in-class data and services to users.
Create, automate, and maintain data pipelines originating from diverse data sources, intended for consumption by various systems and users.
Improve the platform’s architecture with respect to the infrastructure and business requirements.
Develop state-of-the-art continuous integration and continuous delivery pipelines to ensure the continuity of the platform’s development and operations.
Work closely with business IT teams, data scientists, and external providers, if the case may be, to deploy, automate, and monitor data processing, machine learning pipelines, and web applications.
Develop and maintain documentation of data infrastructure and processes.
Required Skills and Qualifications
*
Degree in computer science, information technology, technology engineering or equivalent
*
Strong interest in the data infrastructure landscape and related topics
*
Experience with technologies such as Apache, Docker, Parquet, Python, Spark, Airbyte and Airflow
*
Detailed understanding of Linux OS’s.
*
Experience with ETL processes, data lakes, data warehouses, relational databases, and applications running on Docker
*
Experience with data storage solutions such as PostgreSQL, MySQL, or S3
*
Experience in building CI/CD pipelines with Jenkins, Gitlab, or similar is a plus
*
Ability to communicate and collaborate effectively within the team and with external stakeholders
*
Excellent spoken and written English
Your offer as a Data Infrastructure Engineer:
*
Generous bonus
*
Pension scheme
This is a perfect opportunity for you to join an established, well-recognised company and utilise your skills to make a difference in the workplace and ultimately take your career to the next level