651 to 675 of 1,168 ETL Jobs in England

enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systemsWhat You Need to Have: Work experience ...

project deliverables and all aspects of data visualisation and analytics within agreed timescales. Apply advanced knowledge and experience in extraction, transformation, and loading (ETL) processes to data. Create advanced dashboards in Power BI and other visualisation tools. Produce solutions in accordance with current best practices and company standards. Generate advanced ...

have: Strong experience in creating, maintaining and peer reviewing test automation code in Scala/Python Strong experience with data testing or ETL testing, including hands‐on experience with the tools used in these areas Excellent knowledge and skills in software testing & industry best practices Excellent knowledge & experience with Agile ...

frameworks (e.g., Braintrust, AutoEval) and/or MLOps tools (e.g., Airflow, MLflow, Vertex AI, or similar). Solid understanding of data engineering practices, including ETL, batch/streaming pipelines, and data quality monitoring. Familiarity with cloud infrastructure (we use AWS) and containerization. You have experience with shortening “build-measure-learn ...

passionate about, we even have a dedicated Developer Tooling team)Building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and/or analytics pipelinesManipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality/integrityOur perks and quirks. What makes ...

navigating executive, technical, and line-of-business stakeholders. Orchestrate proof-of-value and POCs that validate Lakebase's benefits for OLTP-style workloads, reverse ETL, and AI/ML-driven applications, in partnership with solution architects and specialists. Compete and win against legacy and cloud-native operational databases by leveraging ...

with a focus on Google Cloud Platform (GCP), Amazon Web Services (AWS), and Snowflake. Fluency in Structured Query Language (SQL). Deep understanding of Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes. Ability to understand and discuss technical concepts and manage technical trade-offs. Desired Skills Master ...

noting that you will be unable to work at home 100% of the time.**Your Role:*** Design, develop, and maintain scalable data pipelines and ETL processes.* Develop and optimize data processing solutions using Python and PySpark.* Write complex and high-performing SQL queries for data extraction, transformation, and analysis.* Work … Scala.* Experience working with cloud-based or enterprise data platforms.* Strong analytical, problem-solving, and communication skills.**Preferred Skills*** Experience with data warehousing and ETL frameworks.* Exposure to cloud platforms such as Azure, AWS, or GCP.* Familiarity with DevOps, CI/CD, and version control tools.**We are a Disability ...

Data Engineer will ensure data integrity, performance, and compliance throughout the migration and operational phases. Key Responsibilities: Data Pipeline Development: Design and implement ETL processes to migrate data from Legacy SAS environments to SAS Viya 4. Optimise data flows for performance and scalability in a cloud-native architecture. Integration & Transformation … migration requirements. Support UAT and production readiness activities by providing test data and validation scripts. Required Skills & Experience: Strong experience in: Building and managing ETL pipelines using tools such as SAS Data Integration, Pentaho, or Talend. Working with SAS technologies (SAS 9.4, SAS Viya 3.x/4). Proficiency ...

appropriately designed for performance, resilience, security, maintainability, scalability and reuse. Lead data orchestration, transformation and production engineering establish robust and consistent approaches to ingestion, ETL/ELT, transformation, analytical data modelling, deployment, monitoring and production operation. Drive automation and productivity across DataOps and the wider analytical function identify manual, repetitive … specifically places responsibility for architecture and operation of the platforms with this role. Lead data orchestration, transformation and production engineering design and optimise automated ETL/ELT pipelines covering ingestion, wrangling, cleansing, transformation, validation, modelling and delivery, reducing unnecessary manual intervention and improving the flow of data from source ...

drive remediation activities with technology teams. Document data lineage, business logic, assumptions and calculation methodologies so that outputs are auditable and reproducible. Design basic ETL and ELT pipelines that transform billing, tagging, inventory and telemetry data into analysis-ready models. Translate complex analysis into concise, accurate and data-driven materials … financial modelling. Working knowledge of Python for data manipulation and automation, for example using pandas and scripting against vendor APIs. Experience building or maintaining ETL and data pipelines and working with structured data at scale. Understanding of IT infrastructure and public cloud concepts, including compute, storage, network, containers and managed ...

home; noting that you will be unable to work at home 100% of the time.Your Role:Design, develop, and maintain scalable data pipelines and ETL processes.Develop and optimize data processing solutions using Python and PySpark.Write complex and high-performing SQL queries for data extraction, transformation, and analysis.Work with large datasets … working knowledge of Scala.Experience working with cloud-based or enterprise data platforms.Strong analytical, problem-solving, and communication skills.Preferred SkillsExperience with data warehousing and ETL frameworks.Exposure to cloud platforms such as Azure, AWS, or GCP.Familiarity with DevOps, CI/CD, and version control tools.We are a Disability Confident Employer:Capgemini ...

controls, cost governance, multi-environment deployment, data sharing, replication and disaster recovery. Define scalable batch, real-time, event-driven, API, orchestration and ELT/ETL integration patterns using modern data integration technologies. Establish standards for analytics engineering, dbt, the modern data stack, DataOps, testing, documentation, CI/CD, Infrastructure … data, storage, networking, security and monitoring. Experience with BigQuery, Databricks, Synapse, Redshift or similar platforms is highly desirable. Expertise in scalable enterprise ELT/ETL, data integration, real-time and batch processing, event-driven systems, APIs and orchestration patterns. Experience with Fivetran, Workato, Boomi, Airbyte or similar integration platforms. Ability ...

and dashboards. Design and build data models that support self-service analytics. Gather and translate business requirements into effective reporting solutions. Develop and maintain ETL/ELT processes to ensure data accuracy and availability. Create and manage SQL queries, views and stored procedures. Monitor data quality and implement validation processes. … and Power Query (M). Strong SQL skills, including query writing and performance optimisation. Experience building and maintaining data models. Understanding of ETL/ELT processes and data warehousing concepts. Strong analytical and problem-solving abilities. Experience working with large datasets and multiple data sources. Excellent attention to detail and ...

building, and supporting cloud-based data solutions across AWS and Azure platforms. The successful candidate will have strong experience in data engineering, data integration, ETL/ELT development, data migration, data quality, and cloud-native analytics platforms. They will work closely with technical and business stakeholders to deliver scalable, secure … and high-quality data solutions. CANDIDATES MUST BE ELIGIBLE FOR UK SECURITY CLEARANCE FOR THIS ROLE Key Responsibilities Design, develop and maintain scalable ETL and ELT pipelines. Build data integration solutions across cloud, on-premise, and third-party systems. Design and implement robust data migration solutions, including extraction, transformation, validation ...

client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ML and emerging AI technologies It's a strong opportunity … Work with relational and non‐relational databases. Contribute to front‐end development where required. Data Engineering Build, maintain and optimise data pipelines . Develop ETL/ELT workflows and data integrations. Work with data warehouses, data lakes and analytics‐ready platforms. Ensure data quality, reliability and performance. Production & Delivery Take ...

Data Engineer will ensure data integrity, performance, and compliance throughout the migration and operational phases. Key Responsibilities: Data Pipeline Development: Design and implement ETL processes to migrate data from Legacy SAS environments to SAS Viya 4. Optimise data flows for performance and scalability in a cloud-native architecture. Integration & Transformation … migration requirements. Support UAT and production readiness activities by providing test data and validation scripts. Required Skills & Experience: Strong experience in: Building and managing ETL pipelines using tools such as SAS Data Integration, Pentaho, or Talend. Working with SAS technologies (SAS 9.4, SAS Viya 3.x/4). Proficiency ...

line with functional requirements, non-functional requirements and acceptance criteriaValidate data quality dimensions. Implement source-to-target reconciliation, schema validation, and transformation testing in ETL/ELT environmentsCollaborate with cross-functional teams in a multi-vendor environment to understand business requirements and translate them into technical testing solutions Test Development … using approved automation frameworksTest data feed pipeline migrations repointing from an existing Data Warehouse to a new AWS Data Lakehouse architecture, underpinned with AI ETL accelerators, Python/PySpark, SQL and YAML configs. Test initial bulk then deltas from legacy to new. Execute automated test suites as part of sprint ...

Design and build production data solutions using Microsoft Fabric Develop and evolve Fabric Lakehouse, Warehouse and OneLake capabilities Build and optimise data pipelines and ETL/ELT processes Develop data models and analytics solutions, working extensively with Power BI Integrate internal and third-party systems through APIs Work with Azure … them in production, dealing with operational issues and improving them as requirements, volumes and the platform have evolved. Strong SQL and Data Engineering fundamentals ETL/ELT and data modelling Azure data platforms API integration Source control, CI/CD and deployment Experience building, operating and supporting production data solutions ...

engineering and technical strategy for a scalable multi‐tenant data integration platform leveraging Apache Airflow and GCP technologies. Build and maintain production‐grade ETL/ELT pipelines orchestrated with Apache Airflow. Utilize container platforms such as GKE and Cloud Run. Apply strong software engineering skills in Python, APIs, configuration management … lead capacity. Proven experience owning a technical roadmap and aligning engineering delivery with business priorities. Strong hands‐on experience designing and building production‐grade ETL/ELT pipelines orchestrated with Apache Airflow (or Cloud Composer). Strong experience with GCP services including BigQuery, GKE, and Cloud Run, applying GCP cloud ...

technologies and best practices. Key Responsibilities Data Engineering & Development Design, develop and maintain scalable data pipelines using Python, Databricks and PySpark Build and optimise ETL/ELT solutions processing large-scale datasets Develop high-quality, reusable code and engineering frameworks Deliver robust, performant and maintainable data solutions Troubleshoot and resolve … experience with Databricks in enterprise environments Strong Apache Spark and PySpark expertise Advanced SQL development and optimisation skills Experience designing and building large-scale ETL and data integration solutions Strong understanding of distributed computing concepts and data processing frameworks Experience working with modern cloud platforms including Azure ...

central to the organisations data environment. Youll work across: Designing and building solutions using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … than simply whether youve crossed an arbitrary two-year threshold. Youll also need a strong grounding in Data Engineering, including: SQL and data modelling ETL/ELT Azure data platforms API integration Git/source control CI/CD and deployment Building and supporting production data solutions Azure Synapse experience ...

Studio. This may include connections, datasets, profiling, validation, standardisation, cleansing, matching, transformation and export processes. You’ll also support the design and implementation of ETL and ELT processes, data models and integration patterns. Where possible, you’ll automate data quality monitoring and processing, supported by appropriate controls, logging, documentation and … Strong practical experience of SQL and at least one relevant programming language, such as Python, Postgres, PySpark or Java. Experience designing, developing and supporting ETL or ELT pipelines and data integration processes within a cloud data platform. A strong understanding of data quality principles and processes, including data profiling, validation ...

What You’ll Do Design, build, and maintain end‐to‐end data pipelines, from source systems through to analytics‐ready datasets. Own and improve ETL/ELT workflows, understanding how changes propagate across the data lifecycle. Design analytics‐ready data models that balance correctness, usability, and maintainability, applying patterns suited … design analytics‐ready data models that support historical accuracy, analytical performance, and evolving business needs. Experience designing, maintaining, and evolving end‐to‐end ETL/ELT pipelines, understanding how changes propagate downstream. Deep knowledge of data governance, data quality management, lineage, and impact analysis within complex data ecosystems. Skilled ...

build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development ...