126 to 150 of 160 ETL Jobs in the City of London

enhance efficiency, automate processes, and drive strategic decision-making. You will be responsible for gathering, cleaning, and integrating data from diverse sources, developing efficient Extract, Transform, Load (ETL) procedures, and utilizing BI tools such as Tableau and Power BI to create clear, impactful dashboards and reports. Advanced skills in Excel ...

Architecture Define the enterprise-wide integration strategy, including the governance of integration patterns (such as synchronous APIs, event-driven architecture, asynchronous messaging, and batch ETL). Lead the design and documentation of internal and external APIs, ensuring best practice in RESTful design, versioning, and OpenAPI standards. Work with Engineering and … Data teams to standardise the technical approach for messaging, data extraction, transformation, and load (ETL/ELT) processes across underwriting, finance, accounting, and data warehouse systems. Design secure, scalable, and auditable architectures for Generative AI, Agentic AI, and large language model (LLM) technologies. Collaborate with data scientists, engineers, and developers ...

and Delta tables, and addressing vulnerabilities through library version updates. Current Tech Stack: Python, Data Science, Gen AI (GPT, Embeddings, Document Intelligence), Java Spark- ETL, PostgreSQL, Cassandra, Service Bus, AKS (Azure Kubernetes), Terraform, Gitlab CICD, Autosys Your expertise You enjoy contributing collaboratively as part of a team as well … Information Technology, or a related field Worked as a software engineer for ideally 8+ years Experience with Java programming language Proficiency in Spark, Databricks, ETL tools and processes, and APIs. Strong knowledge of SQL and experience with data modeling and database design Strong knowledge of Microsoft Azure, e.g. ...

processing platforms into a new unified ecosystem. The successful candidate will possess strong experience in card processing, large-scale platform migrations, data transformation/ETL pipelines, and cross-functional stakeholder collaboration. Operating across engineering, product, operations, compliance, and partner ecosystems, you will define and govern solution architecture that ensures secure … migration and consolidation of regional card-processing and payments platforms into a modern, unified global environment. Architect large-scale data migration and ETL processes, including data mapping, transformation logic, orchestration, validation, lineage, and technical implementation. Collaborate with cross-functional teams to translate complex business requirements into data models and data ...

plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will … deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS. Some responsibilities include: Build data pipelines to ingest, process ...

future of their data strategy. 🔍 Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering … and solution design Strong skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling and ETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong ...

Senior Data Engineer – HealthTech Startup | £70k–£90k + Equity | London (Hybrid) Python | ETL | Impact-Driven Team Join a VC-backed healthtech startup that’s transforming access to fertility care across Europe. This is your chance to work in a lean, high-performing team where your code directly impacts people … modern cloud platforms, and build the pipelines that power machine learning and real-time decision-making. What You’ll Do Design and optimize ETL pipelines in Python Migrate legacy databases to modern, scalable platforms Clean and transform messy, unstructured data into usable formats Support ML workflows and data-driven product ...

design of innovative solutions using Palantir software, ensuring scalability and long-term impact. Engineer Data at Scale: Build, optimise, and maintain complex pipelines and ETL processes powering mission-critical decision models. Strategic Workflows: Develop enterprise-grade workflows and decision-support tools that reshape operations across industries. AI Leadership: Guide … with proven expertise in Python, SQL, and TypeScript. Ideally experience with Palantir technologies (Foundry, Gotham, or similar platforms). Advanced knowledge of data engineering, ETL pipelines, and workflow design at enterprise scale. Track record of leading teams, mentoring engineers, and delivering complex projects in client-facing environments. Passion ...

develop modern data infrastructure and applications, enabling portfolio managers and researchers to access high-quality, scalable data solutions. The role involves working across ingestion, ETL, data quality, storage, and APIs, while collaborating closely with quantitative engineers, researchers, and technical teams in a global environment. Key Responsibilities Build and optimize data … pipelines and platforms for large-scale, complex datasets. Design and implement robust ETL processes and data models for batch and streaming workflows. Collaborate with quants and engineers to deliver scalable solutions aligned with business needs. Develop APIs and tools to enable efficient data consumption and integration. Ensure performance, reliability, and ...

This is a fully hands-on role within a small, high-calibre team, offering significant impact and ownership. You will develop robust, production-grade ETL pipelines, manage cloud-based and on-prem data environments, and integrate diverse datasets from external vendors, trading systems and internal sources. The role also involves … data engineering or related roles Proven background at a leading finance or big tech firm Strong hands-on expertise in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial ...

hybrid working when possible Must hold active Enhanced DV Clearance Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

models. Key Responsibilities Design & Solve: Break down client problem sets and design innovative solutions using Palantir software. Engineer Data: Build and maintain pipelines and ETL processes to power decision-making models. Create Workflows: Develop operational workflows and decision-support tools that transform enterprise operations. Apply AI: Collaborate with colleagues … Engineer with proven expertise in Python, SQL, and TypeScript. Experience with Palantir technologies: Foundry, Gotham, or similar platforms (preferred) Strong understanding of data engineering, ETL pipelines, and workflow design. Passion for AI, machine learning, and emerging technologies. Excellent problem-solving, collaboration, and communication skills. Curiosity, adaptability, and a drive ...

hands-on IBM DataStage experience to support regulatory and reporting data platforms within a banking environment. This is a delivery-focused role requiring deep ETL, SQL, and data modelling expertise , with exposure to banking and regulatory reporting . Key Skills & Experience Required Strong hands-on IBM DataStage development experience (essential … solving skills Desirable ECB onboarding/AQR reporting exposure Experience with Databricks Exposure to middleware technologies (Kafka, MQ, IIB) The Role Develop and maintain ETL pipelines using DataStage Build and optimise SQL-based data transformations Design and support data models for regulatory and business reporting Ensure data quality, governance, and ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue … extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

them into technical solutions. Design under ambiguity: Break down poorly defined problem spaces and design pragmatic, scalable architectures. Engineer data pipelines: Build and maintain ETL pipelines that support operational and analytical use cases. Develop workflows: Create decision-support tools and operational workflows that real users rely on. Apply AI where … clients through delivery, judgment, and consistency. What We’re Looking For Strong experience in Python, SQL, and TypeScript . Solid grounding in data engineering , ETL pipelines, and workflow orchestration. Experience with enterprise data platforms used in operational settings (Palantir experience is a strong plus, but not mandatory). Comfort operating ...

enabling high-quality, accessible data for downstream users. The Role As a Data Engineer, you will: Design, build, and maintain scalable data pipelines and ETL processes Integrate structured and unstructured data from multiple internal and external sources Ensure data quality, consistency, performance, and security across platforms Collaborate with analytics engineers … Responsibilities Build and manage robust data infrastructure for large-scale data ingestion and processing Develop automated, reliable data pipelines aligned to best practices Optimise ETL workflows for performance and scalability Implement data governance, access controls, and security standards Support self-service analytics by enabling clean, well-structured datasets Proactively identify ...

deployment. Act as Subject Matter Expert (SME) on commodities and oil market data, curves, and pricing structures. Design, enhance, and maintain data parsers and ETL/ELT workflows to ensure standardised, testable, and scalable data delivery. Develop and manage complex oil market curves to support pricing and risk management. Liaise … financial trading environments. Deep understanding of market data onboarding, processing, and distribution from multiple data sources (files, APIs, web scraping). Strong background in ETL/ELT pipelines, data warehousing, and data management best practices. Proficiency with data processing frameworks, automation, and deployment workflows. Hands-on experience in developing data ...

helping modernise the technology landscape. 🔌 You will integrate APIs, connect services, and ensure smooth end-to-end architecture across multiple platforms. 📊 You will support ETL workflows, where light SSIS or general data-movement experience is sufficient. 📚 You will work closely with complex business rules and regulatory behaviours, ensuring systems meet … and engineering capability 🔧 Azure DevOps, Git, CI/CD 💬 Good PowerShell scripting 📚 Understanding of API integration & system architecture Desirable 🐍 Exposure to Python and Databricks 🔄 ETL workflows/SSIS 📜 Regulatory reporting knowledge — especially: EMIR MiFID REMIT Secondary: MASS , Canadian regulations 📈 Experience with business-rule-heavy platforms You don’t need deep ...

and improve' the products. Core Skills and Experience Required Development skills in Python Scripting and Microsoft SQL Server (including SSIS) Experience building and operating ETL pipelines with a focus on data quality, lineage and reconciliation Experience with microservices and APIs, building scalable services and integrating with wider enterprise platforms Experience … Risk/Compliance), Techno-Functional Lead (AML/Sanctions), Lead FinCrime Systems Analyst, Senior Business Analyst (AML Systems), Product Owner (AML Technology), Lead ETL/ELT Engineer, Senior Backend Engineer (Python/SQL). Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every ...

ingest, transform and deliver data to our frontend applications and customers. You'll bring strong Python skills, experience with microservices and data ingestion/ETL pipelines , and an eye for clean, maintainable code. Familiarity with AI-assisted dev tools (GitHub Copilot, Cursor, Windsurf, Devin) is a plus — we encourage using … teammates and share knowledge What we're looking for 5–7+ years' experience building production software Proficiency in Python and microservices architecture Experience with ETL/data pipelines, containerisation (Docker/Kubernetes), and cloud environments (AWS/GCP) Strong grasp of databases (SQL/NoSQL) and API integrations Collaborative mindset ...

Senior Data Engineer – 3-Month Rolling Contract | AWS • Snowflake • ETL • Python • Fivetran | Greenfield Build (Outside IR35) Immersum are supporting a fantastic client who is about to kick off a major greenfield data engineering project — and they’re looking to bring in a Senior Data Engineer on a 3-month rolling … Role My client is increasing their data engineering capability specifically for this project. They need someone who can hit the ground running — building ETL pipelines, implementing robust security practices, and optimising everything for high performance. You’ll work directly with the Data Lead and have full visibility with leadership ...

/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases … service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge of healthcare industry standards, regulations, and data interoperability. Familiarity with AI and machine learning concepts ...

with front-office and technology stakeholders. Key Responsibilities • Develop and maintain Python applications and internal tools used by investment and risk teams • Build reliable ETL/ELT pipelines for financial, market, and operational datasets • Work with structured financial data, market data feeds, and fixed income datasets • Collaborate with traders, analysts … hands-on Python programming experience • Background in investment banking , hedge funds, or financial markets • Good understanding of fixed income (bonds, credit, rates) • Experience building ETL/ELT pipelines and handling large datasets • Strong SQL skills and familiarity with structured data environments • Experience working with trading, risk, or analytics systems • Strong ...