1 to 25 of 29 ETL Jobs in Leeds

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

Qlik Sense (Power BI also considered). Strong stakeholder management and requirements-gathering skills. Solid SQL development skills with experience in data warehousing and ETL processes. Good knowledge of Microsoft Office applications. Experience working within Agile environments. Strong analytical, problem-solving, and organisational skills. Excellent communication skills and attention ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

and best practices. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS ...

architectural patterns, data modelling approaches, and AI/Data Science. End-to-End Capabilities: You understand the full lifecycle of data: discovery, storage, pipelines, ETL, and streaming, right through to data quality, metadata management, and advanced analytics for core decision-making. Data Product Mentality: You design Data Products ensuring that ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

Engineer , you'll help shape and maintain the data infrastructure that supports decision-making across Lowell. You'll work hands-on with SQL, SSIS, ETL processes and large datasets, ensuring our data warehouse is accurate, efficient and scalable. You'll also have the freedom to identify opportunities to automate processes ...

Engineer, you’ll help shape and maintain the data infrastructure that supports decision-making across Lowell. You’ll work hands‐on with SQL, SSIS, ETL processes and large datasets, ensuring our data warehouse is accurate, efficient and scalable. You’ll also have the freedom to identify opportunities to automate processes ...

backup strategies, restoring databases and validating successful recovery, supported by a demonstrable understanding of recovery models. Familiarity with data migration approaches and tools, including extract, transform and load (ETL) processes. Demonstrable understanding of database access controls and the principle of least privilege. Ability to write and maintain reliable SQL and ...

engineer who is customer focused, analytical and technically skilled to drive performance measurement, innovation and execution. You will design and operate data platforms and ETL components using Python, SQL and AWS services to deliver scalable insights for AMXL teams. You will collaborate with program managers, engineers, analysts and business partners ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

central to the organisations data environment. Youll work across: Designing and building solutions using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … than simply whether youve crossed an arbitrary two-year threshold. Youll also need a strong grounding in Data Engineering, including: SQL and data modelling ETL/ELT Azure data platforms API integration Git/source control CI/CD and deployment Building and supporting production data solutions Azure Synapse experience ...

seeking a Data Engineer to shape and maintain the data infrastructure that supports decision-making. You will work hands-on with SQL, SSIS and ETL processes across large datasets to keep the data warehouse accurate, efficient and scalable. Hybrid working is offered in Leeds. The role focuses on turning complex ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

responsibilities Work with external data partners to establish AMXL connections to ingest various datasets Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using different AWS products such as Lambda, Glue, EMR, Kinesis Firehose Maintain and enhance existing data pipelines Create … solutions, create new solutions as required based on team and stakeholder needs Basic Qualifications Experience in data engineering Experience with data modeling, warehousing and building ETL pipelines Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) Experience with one or more scripting ...

Developer in central Leeds. The role is hybrid with 2 days in the office, and focuses on leading a team across SQL Server, ETL, and data warehousing. You will shape the data platform and drive data initiatives using Microsoft technologies. The successful candidate will combine hands-on engineering with leadership ...

stakeholders to design scalable data platforms. You will mentor engineers, drive quality, and champion best practices across the data product lifecycle, including discovery, pipelines, ETL/streaming, and analytics to enable informed decision-making. #J-18808-Ljbffr ...

and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...