3 of 3 ETL Development Jobs in the City of London

embeddings, vector databases, hybrid search methods, and effective chunking strategies Use AI coding assistants such as Cursor, GitHub Copilot, and Claude Code to accelerate development while maintaining ownership of outcomes and documenting best practices Standards & Enablement Establish and enforce engineering best practices, coding standards, and quality benchmarks … development Improve internal AI development tooling, including shared libraries, SDKs, and reference implementations for RAG, tracing, prompt management, and evaluation Mentor engineers across all levels, conduct code reviews, and elevate engineering standards across the organization (upgraded from "mentor peers") Lead internal enablement and capability-building activities across ...

Senior Data Engineer - Contract - London - 3 days on site - £520-550pd via Umbrella Contract until Feb 27 Key Responsibilities ETL Pipeline Architecture : Design, build, and maintain scalable ETL pipelines using Apache Airflow, Python, PySpark, and AWS Glue to transform complex financial datasets into actionable insights. Data Integration … team, ensuring best practices in coding, architecture, and documentation. Optimization : Drive performance tuning and continuous improvement of data ingestion and transformation processes. Required Skills ETL Development: Extensive experience building, testing, and deploying production-grade ETL pipelines in a cloud environment. Python: Expert-level proficiency in Python ...

pipelines and orchestration tooling. Develop database schemas and data models. Integrate and enrich data from multiple sources, ensuring quality and consistency. Design and implement ETL processes (e.g. using NiFi). Write clean, secure, test-driven code that is reusable by default. Maintain and enhance data ingestion and storage architectures. … into epics and stories. Implement appropriate data security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based ...