23 of 23 ETL Jobs in Leeds

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

least one cloud data technology (for example Microsoft Fabric, Databricks, Snowflake or a cloud warehouse). A solid grasp of data modelling, ETL/ELT and data governance, including medallion or Lakehouse-style architectures. It would be great if you also had experience in some of these ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

Responsibilities: Designing and building robust,scalable,automatedand genericdata engineer tooling to improve ramp-up time for new pipelines, primarily using Python. Designing,writingand maintaining ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally. Designing and building data pipelines that integrate ML and GenAI capabilities (e.g. ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

and best practices. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS ...

managing Microsoft Azure environments and data services, such as Azure SQL, Data Factory, Storage, Data Lake or Fabric Experience designing, building and supporting robust ETL or ELT pipelines and data integrations Knowledge of automation, source control, CI/CD or infrastructure-as-code using tools such as PowerShell, Python, Azure ...

implementing cloud-based data solutions, with a focus on scalability and security. You'll apply advanced scripting skills to automate data processes and integrate ETL workflows, and use business intelligence tools and techniques to turn that work into actionable insights for clients. You'll also implement and oversee CI/ ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

systems integrate with ERP platforms through various business and technical approaches. Strong knowledge of Enterprise Resource Planning (ERP) systems. Knowledge in data modeling, ETL processes, and data warehousing. Knowledge in SQL and experience with database management systems (e.g., Oracle, SQL Server, MySQL). Experience with data integration tools and technologies. ...

and contribute to shaping our analytics strategy while leveraging AI to enhance outcomes for clients. You will design scalable, secure cloud data platforms, automate ETL workflows and oversee CI/CD pipelines, working in a consultancy environment with diverse sectors including healthcare. #J-18808-Ljbffr ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

using Databricks, Apache Spark, and Python. Develop & Deliver: Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective … with Apache Spark, and SQL. Strong proficiency in Python (PySpark preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge ...

and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...

and software engineers, you'll help deliver modern cloud-based data solutions using engineering best practices. What you'll be doing Building and maintaining ETL/data pipelines Developing data solutions using Python and SQL Designing secure, scalable cloud-based data platforms Applying DataOps and DevOps best practices Working with … orchestration and governance Collaborating across multidisciplinary engineering teams Experience we're looking for Strong Python and SQL development skills Experience building data pipelines and ETL processes Cloud experience (AWS preferred) Data modelling and database design CI/CD and version control Agile delivery experience Requirements You must be a Sole ...

range of business-critical SAP development and transformation initiatives, with a particular focus on SAP ABAP, S/4HANA, SAP Data Services (BODS), ETL processes and enterprise data integration. The role will involve working closely with technical teams, architects and business stakeholders to develop, enhance and integrate SAP solutions within … across SAP transformation programmes, including S/4HANA and platform upgrades Designing, developing and supporting data integration pipelines using SAP Data Services (BODS) Supporting ETL processes, data migration and transformation across multiple systems Working with SAP HANA database environments, including data modelling and performance optimisation Supporting the integration ...

complex SQL queries, stored procedures, views, and functions ✔ Optimize and tune SQL queries for performance ✔ Design and maintain relational databases and data models ✔ Perform ETL processes and ensure data integrity ✔ Troubleshoot database issues and implement solutions What We’re Looking For ✅ Strong SQL expertise (T-SQL/PL-SQL) ✅ Broader … database experience with some of the following (Oracle, MySQL, PostgreSQL) ✅ Knowledge of ETL tools and data warehousing concepts ✅ Understanding of indexes, joins, normalization, and performance tuning ✅ Financial services or Fintech experience Details 💰 Salary: Flexible based on experience 📍 Location: Leeds (Hybrid – 2 days onsite) ⏳ Fixed Term Contract: 6 months 🚀 Start: Immediate ...