Details:
- Salary: £130,000 - 140,000 - Annum
- Job Type: Permanent
- Job Status: Full-Time
- Salary Per: Annum
- Location: City of London London
- Date: 2 weeks ago
Description:
We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team!
Your Role:
Design, optimize, and maintain robust data pipelines for complex knowledge-intensive documents.
Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling.
Implement end-to-end encryption and data isolation for secure data handling.
Collaborate with a diverse team to integrate search infrastructure for large language models.Your First 3 Months:
Enhance data ingestion framework, boosting efficiency and scalability.
Improve scalability and performance of data infrastructure, setting new benchmarks.
Mentor team members and promote best practices in data engineering.What You Bring:
Experience building and optimizing search infrastructure in cloud environments.
Proficiency in Python and cloud/data infrastructure (AWS, GCP, Azure).
Commitment to secure data practices and continuous learning.
Proven track record of scaling data pipelines for large volumes of data.
Proactive problem-solver with a passion for data.Ready to shape the future of knowledge discovery? Apply now