76 to 100 of 173 ETL Jobs in London

pipelines, models, and performance. In this role, you will: Design, build, and maintain scalable data pipelines in Azure and Snowflake Develop and optimise ETL and ELT processes for batch and micro-batch workloads Build and enhance enterprise data warehouse models Write and optimise complex SQL queries for analytics and reporting … platforms (Azure preferred) Strong expertise in Azure Data Factory, Azure SQL, Azure Storage, Azure Functions, and Snowflake (1+ year) Advanced SQL skills, including complex ETL and dimensional/data modeling Experience building batch and micro-batch data pipelines Deep understanding of enterprise data warehouse architecture and methodologies Experience working with ...

Engineer, you will: Digest data requirements, gather and analyse large scale structured data and validates by profiling in a data environment Design and develop ETL patterns/mechanisms to ingest, analyse, validate, normalize and clean data Implement data quality procedures on data sources and preparation to visualize data and synthesize ...

projects for those that are keen to develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and ...

Experience with ERP systems . Advanced Excel skills and proficiency in Power BI or other modern BI tools . Solid understanding of data models, ETL processes, and automation . Ability to communicate effectively with both technical and non-technical stakeholders . ...

and taking ownership of delivery. Key Requirements: Active SC (or higher) clearance Strong Python development experience, building production-grade applications Experience designing and implementing ETL pipelines and data processing workflows Understanding of software engineering best practices such as testing, version control and CI/CD Ability to engage with stakeholders ...

major communication platforms and capture solutions (e.g., Bloomberg, LSEG, ICE, Symphony, whats app, WeCom, Smarsh, Global Relay, Behavox). Experience with communications data structures, ETL/ELT pipelines, and data integrity standards. Strong understanding of CI/CD practices and agile methodologies. Excellent communication and stakeholder-management skills. Desired Understanding ...

range of Data and MI/BI platforms. Experience supporting applications in regulated industries (e.g., government, aerospace, and defence). Knowledge of integration concepts (ETL, Event, APIs, message-based interfaces). Exposure to deployment automation or DevOps practices. Personal Attributes: Strong analytical and problem-solving mindset. Clear communicator able ...

stakeholders across multiple teams. Key Responsibilities: Collaborate with engineers across legacy systems to understand available data and its structure. Design queries and scripts to extract, transform, and migrate data into new platforms. Partner with senior data leadership to define cold-storage solutions for regulatory data retention. Work with solution architects … design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with platform and infrastructure teams on security ...

stakeholders across multiple teams. Key Responsibilities: Collaborate with engineers across legacy systems to understand available data and its structure. Design queries and scripts to extract, transform, and migrate data into new platforms. Partner with senior data leadership to define cold-storage solutions for regulatory data retention. Work with solution architects … design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with platform and infrastructure teams on security ...

days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our Innovation Group is looking for a technical problem-solver to design, build, and codify the rules that power our next-generation data models. … group’s capabilities. Key Responsibilities Design & Build: Develop sophisticated data models and map various data sources to support downstream analytics. Pipeline Engineering: Build scalable ETL pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala ...

design robust, secure, and future-ready data solutions that support analytics, AI, and strategic decision-making. What Youll Do: Build, test, and maintain ETL/ELT pipelines for structured and unstructured data click apply for full job details ...

projects for those that are keen to develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and ...

Looking For Expert-level SQL + solid Python for product analytics Hands-on A/B testing experience (design + interpretation) Strong understanding of ETL/debugging data issues Excellent communication and stakeholder management skills Commercially-minded with experience balancing user and business needs Bonus: marketplace experience or exposure ...

problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive ...

builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus points if youve worked with: large-scale data processing, ETL pipelines, cloud deployments, or DevOps/CI-CD practices. Why join? Competitive salary + benefits Ownership and impact in a high-growth cybersecurity scale-up Work with ...

Understanding of GDPR, HIPAA, or UK Data Protection Act compliance Experience with Infrastructure as Code (Terraform, CloudFormation, AWS CDK) Experience designing data ingestion or ETL pipelines across heterogeneous source systems What's On Offer Competitive salary and equity in an early-stage company with significant upside The opportunity ...

long term remote contract as a Data Engineer, Inside IR35. The key skills required for this Data Engineer position are: Python SQL ETL Azure Databricks If you do have the relevant experience for this remote Data Engineer position, please do apppy. ...

data architecture. Key Responsibilities Support critical data processing between core systems and the Enterprise Data Warehouse, ensuring accurate and timely reporting Manage and monitor ETL pipelines, identifying and resolving data issues and performance bottlenecks Act as a technical point of contact during financial close periods (monthly, quarterly, year-end) Perform … automate and optimise manual workflows Contribute to the design of a cloud-based “Single Source of Truth” data platform Design, develop and maintain ETL workflows using modern tools (e.g. Azure Data Factory, Databricks) Optimise database performance through query tuning, indexing and partitioning strategies Support CI/CD practices using Azure ...

support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines, Delta Lake, data warehousing, and data governance frameworks. Define and enforce best practices, security standards, and performance optimization across Databricks workloads. Design … architecture design on Azure/AWS/GCP (based on organization need) integrated with Databricks. Data Engineering & Platform Build Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta. Oversee data quality frameworks, metadata management, lineage, and monitoring. Leadership & Stakeholder Engagement Work closely with business leaders ...

Data. Responsibilities: Lead the design, build and optimisation of the enterprise data warehouse, including sourcing, validation, ingestion and data architecture. Develop and manage automated ETL pipelines and workflows for financial datasets. Integrate data warehouse outputs with Salesforce, PowerBI, pricing platforms and other analytical endpoints. Ensure accuracy, consistency and scalability … data analysis and enterprise level data systems. Advanced SQL expertise with the ability to build complex queries and tables. Hands on experience managing ETL processes and working to tight project timelines. Must have strong knowledge of financial data, accounting principles and CIB business information frameworks. Experience working with large and ...

reliability carry direct commercial weight. Requirements 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, o click apply for full job details ...

Python (ideally FastAPI) 👉 Proven experience building fullstack products end-to-end 👉 Background working on complexed and data heavy products 👉 Exposure to data pipelines/ETL ➕ Nice to have Azure/cloud experience IaC (Terraform/OpenTofu) Experience with AI tools or LLM integrations ...

significant impact. ROLES AND RESPONSIBILITIES: The Head of Data will: • Build and own a centralised data warehouse using Microsoft Fabric. • Design and implement ETL pipelines and scalable data architecture. • Develop dashboards and reporting for senior leadership and agency heads. • Act as a data evangelist and educating non‐technical stakeholders ...

and data replication patterns. Knowledge of CDC mechanisms: database log-based CDC, trigger-based CDC, and timestamp-based extraction. Experience with Talend or equivalent ETL tooling for on-premises source extraction. Familiarity with MongoDB data extraction and transformation patterns. Experience designing integration architectures for multi-source estates of 10+ systems. ...

Azure integrations primarily utilising AIS (Azure Integration Services) including optimising enhancement with the MDM platform and integrating data via ADF albeit in conjunction with ETL developers. Working in an SME/Lead capacity you will: Liaise with other technical teams, vendors and wider business stakeholders Design, config and deploy application ...