26 to 50 of 146 ETL Jobs in London

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

Proven expertise in automated data testing and validation (e.g. expectations-based frameworks). Advanced skills in Python and SQL, with a solid understanding of ETL/ELT and data modelling. Experience working with cloud data platforms (e.g. Databricks, Snowflake, BigQuery). Deep understanding of data quality, governance, lineage, and observability ...

strategies, and performance optimisation Defining and enforcing engineering standards across code quality, testing, CI/CD, IaC, and observability Building and optimising ELT/ETL pipelines using Glue (PySpark) , Lambda, Step Functions, and event-driven patterns Championing security-by-design in collaboration with security and assurance teams (IAM, KMS, encryption ...

and maintain data pipelines using Azure tools Develop data models and analytics solutions Work closely with clients to understand requirements and deliver solutions Optimise ETL/ELT processes for performance and reliability Troubleshoot and resolve data issues Contribute to best practices and mentor junior team members Skills & Experience Strong experience ...

across the full lifecycle of data products, helping design, build, and maintain data pipelines and platforms using modern technologies. Key Responsibilities: Build and maintain ETL/ELT data pipelines and platforms. Collaborate with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work ...

transitioning from Data Analyst to Data Engineer . Proven expertise in SQL and building complex data models. Strong proficiency in Python for data processing, ETL, and workflow automation. Experience with cloud data platforms (Snowflake experience highly desirable). Exposure to or experience with Terraform or similar infrastructure-as-code tools ...

architecture, designing and delivering enterprise-scale data solutions Strong expertise in data modelling with excellent SQL skills Deep knowledge of modern data engineering patterns (ETL/ELT, data lakes, lakehouse, warehousing) Hands-on experience with cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue; Azure or GCP beneficial) Experience with ...

support Pragmatic approach to balancing technical delivery with business needs Desirable Python experience for infrastructure automation and tooling Familiarity with data pipeline infrastructure (supporting ETL workloads, data warehousing) Experience with data governance and compliance requirements Cloud cost and resource utilisation optimisation Experience migrating from monolithic to microservice architectures What ...

Reporting tools: Aqua scan, Checkmarks, SonarQube, Datadog, Soda, SSRS, etc. • Cloud: Azure, AWS (S3) basic • Others: REST APIs, ElasticSearch, New Relic, CI/CD, ETL, Swagger, Postman, Rancher, Data Analytics, ML Models, GitHub Copilot, Jira and Confluence. Key Responsibilities Full Stack Development: Build and maintain scalable web applications using Java ...

delivery of datasets. Document and relay clear updates to users during production events. Technical responsibilities: Ingest, configure and operationalise new datasets. Develop and maintain ETL/ELT data pipelines to feed real time trading and research systems. Implement data quality checks, anomaly detection and monitoring frameworks. Build and maintain high ...

design of scalable, secure data architectures on cloud platforms (AWS, Azure, or GCP) Working with modern data technologies such as Snowflake, Databricks, dbt, and ETL/ELT tooling Helping define data models, ingestion patterns, and governance approaches Collaborating with engineers, analysts, and client stakeholders to deliver production-ready data solutions ...

growth. Essential Requirements: Experience leading teams of engineers in implementing data-intensive systems. Proficient in Java, Scala, or Python for software development. Experience with ETL/data-processing platforms (e.g., Informatica, Azure Databricks) and advanced SQL. Strong understanding of distributed data stores, frameworks, and data modelling for analytical and operational ...

consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift and Python, and ecommerce and mobile applications background Additional Information Were a community here that cares as much about your life outside ...

Roles: Project Manager Location: London/Wimbledon, UK Contract: 6 months Contract Hybrid 3 days/week onsite is mandatory Keywords: Insurance,Project Manager,ETL,data Migration Job Spec The project manager role requires leading complex data migration programs, specifically transitioning legacy insurance and warranty data to modern platforms. Ability … demonstrated in a work environment. Core Responsibilities End-to-End Migration Delivery: Own all phases of the migration lifecycle, including planning, data profiling, cleansing, ETL (Extract, Transform, Load), testing, and final cutover execution . Migration Strategy & Governance: Develop detailed migration roadmaps and RAID logs, ensuring all activities align with broader ...

with users to gather requirements for new reports, data extracts, and analytical outputs. Handle ad-hoc reporting requests and help users resolve data issues. ETL & Data Pipeline Support Monitor, manage, and support ETL processes, ensuring timely and accurate data flows. Diagnose issues across the full data path, Power BI semantic … models, stored procedures, views, tables, and underlying source data. Develop, maintain, and expand ETL pipelines for ingestion into the data lake and data warehouse. Liaise with third parties regarding file deliveries and resolve import or data quality issues. Perform log and error analysis, tracing data problems back to their source. ...

needed to transform raw data into meaningful insights, create performance dashboards + support strategic decision-making. In-depth experience of Power BI, Tableau + ETL tools for reporting dashboards + data visualisation. Strong SQL + advanced MS Excel skills for data extraction, analysis + modelling. Experience of AWS Cost Management ...

needed to transform raw data into meaningful insights, create performance dashboards + support strategic decision-making. In-depth experience of Power BI, Tableau + ETL tools for reporting dashboards + data visualisation. Strong SQL + advanced MS Excel skills for data extraction, analysis + modelling. Experience of AWS Cost Management ...

will be a key architect and builder of our modern data platform. You will be responsible for: Pipeline Engineering: Designing and implementing robust, scalable ETL/ELT pipelines to ingest data from a variety of internal and external sources. Infrastructure: Leveraging the full power of Google Cloud Platform to ensure ...

security models). Platform & Integration Lead the design of data flows between ARGUS investment models and Yardi operational and financial systems. Architect APIs, middleware, ETL pipelines, and event-based integrations where appropriate. Ensure consistent master data management across properties, leases, tenants, and financials. Support cloud and SaaS-based architectural approaches ...

security models). Platform & Integration Lead the design of data flows between ARGUS investment models and Yardi operational and financial systems. Architect APIs, middleware, ETL pipelines, and event-based integrations where appropriate. Ensure consistent master data management across properties, leases, tenants, and financials. Support cloud and SaaS-based architectural approaches ...

querying and transforming data Experience designing and deploying automated systems and workflows Familiarity with modern front-end frameworks (such as React) Exposure to ETL/ELT processes and tools is a plus Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free ...

definition, clean code, CI/CD, path to production Worked with AWS as a cloud platform Extensive hands-on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more ...

Secure coding and API versioning Data & Integration SQL Server, Azure SQL, Cosmos DB ORM optimisation, caching (Redis, Azure Cache for Redis) Data migration and ETL integration (APIs, pipelines) Cloud & DevSecOps Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans) CI/CD automation, gated releases, and environment governance Infrastructure-as-Code ...

platform. You will work closely with data engineers, analysts, and architects to deliver high-quality, scalable data pipelines and models. Strong expertise in Snowflake, ETL/ELT, data modelling, and data warehousing is essential. Responsibilities Snowflake Development: Build and optimise Snowflake objects (databases, schemas, tables, views, tasks, streams, resource monitors … . ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar. Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics. Performance Tuning: Optimise queries, manage clustering, caching, and warehouse sizing for cost ...

Salary: Up to £70,000 Location: London Data Engineer Responsibilities Design, build, and maintain robust data pipelines from the ground up Develop and optimise ETL workflows using Python and AWS Work closely with Accounting and Finance teams on month-end, IBNR, and financial reporting data Ensure data quality, accuracy, and ...