1 to 25 of 28 ETL Jobs in Leeds

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Qlik Sense (Power BI also considered). Strong stakeholder management and requirements-gathering skills. Solid SQL development skills with experience in data warehousing and ETL processes. Good knowledge of Microsoft Office applications. Experience working within Agile environments. Strong analytical, problem-solving, and organisational skills. Excellent communication skills and attention ...

Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

and best practices. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

architectural patterns, data modelling approaches, and AI/Data Science. End-to-End Capabilities: You understand the full lifecycle of data: discovery, storage, pipelines, ETL, and streaming, right through to data quality, metadata management, and advanced analytics for core decision-making. Data Product Mentality: You design Data Products ensuring that ...

using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

Engineer , you'll help shape and maintain the data infrastructure that supports decision-making across Lowell. You'll work hands-on with SQL, SSIS, ETL processes and large datasets, ensuring our data warehouse is accurate, efficient and scalable. You'll also have the freedom to identify opportunities to automate processes ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

backup strategies, restoring databases and validating successful recovery, supported by a demonstrable understanding of recovery models. Familiarity with data migration approaches and tools, including extract, transform and load (ETL) processes. Demonstrable understanding of database access controls and the principle of least privilege. Ability to write and maintain reliable SQL and ...

central to the organisations data environment. Youll work across: Designing and building solutions using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … than simply whether youve crossed an arbitrary two-year threshold. Youll also need a strong grounding in Data Engineering, including: SQL and data modelling ETL/ELT Azure data platforms API integration Git/source control CI/CD and deployment Building and supporting production data solutions Azure Synapse experience ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

automated batch processes. You will design and optimize SQL, implement batch jobs, and contribute to automation in a UNIX/Linux environment. Responsibilities include ETL data pipelines, data modeling, and production support for complex workloads, collaborating with System Analysts, QA, and Admin teams to ensure reliability and scalable #J ...

Developer in central Leeds. The role is hybrid with 2 days in the office, and focuses on leading a team across SQL Server, ETL, and data warehousing. You will shape the data platform and drive data initiatives using Microsoft technologies. The successful candidate will combine hands-on engineering with leadership ...

and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product ...

stakeholders to design scalable data platforms. You will mentor engineers, drive quality, and champion best practices across the data product lifecycle, including discovery, pipelines, ETL/streaming, and analytics to enable informed decision-making. #J-18808-Ljbffr ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...

and software engineers, you'll help deliver modern cloud-based data solutions using engineering best practices. What you'll be doing Building and maintaining ETL/data pipelines Developing data solutions using Python and SQL Designing secure, scalable cloud-based data platforms Applying DataOps and DevOps best practices Working with … orchestration and governance Collaborating across multidisciplinary engineering teams Experience we're looking for Strong Python and SQL development skills Experience building data pipelines and ETL processes Cloud experience (AWS preferred) Data modelling and database design CI/CD and version control Agile delivery experience Requirements You must be a Sole ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills SQL Server/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source ...

optimize code performance by tuning complex SQL statements and PL/SQL blocks using tools like EXPLAIN PLAN, TKPROF, Oracle Hints, and indexing strategies. ETL & Data Integration: Design and manage Extract, Transform, Load (ETL) data pipelines using SQL*Loader, external tables, or native PL/SQL to migrate data from ...