1 to 25 of 27 ETL Jobs in Leeds

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Qlik Sense (Power BI also considered). Strong stakeholder management and requirements-gathering skills. Solid SQL development skills with experience in data warehousing and ETL processes. Good knowledge of Microsoft Office applications. Experience working within Agile environments. Strong analytical, problem-solving, and organisational skills. Excellent communication skills and attention ...

Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

maintain end-to-end data pipelines using Palantir Foundry (Pipeline Builder, Code Repositories, Data Lineage, Ontology, Workshop, Quiver). Implementing batch, incremental + streaming ETL/ELT workflows with reusable, production ready components. Data modelling, schema design, build data products, semantic layers, metadata management + governance. Designing + maintaining Foundry ...

will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

architectural patterns, data modelling approaches, and AI/Data Science. End-to-End Capabilities: You understand the full lifecycle of data: discovery, storage, pipelines, ETL, and streaming, right through to data quality, metadata management, and advanced analytics for core decision-making. Data Product Mentality: You design Data Products ensuring that ...

validate payroll and employee data to ensure accuracy and integrity throughout the SAP Payroll implementation. Support data migration activities, including data extraction, transformation, loading (ETL), mapping and reconciliation between legacy and SAP systems. Develop and execute data validation processes, identifying and resolving data quality issues, discrepancies and anomalies. Support System ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

central to the organisations data environment. Youll work across: Designing and building solutions using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … than simply whether youve crossed an arbitrary two-year threshold. Youll also need a strong grounding in Data Engineering, including: SQL and data modelling ETL/ELT Azure data platforms API integration Git/source control CI/CD and deployment Building and supporting production data solutions Azure Synapse experience ...

IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from legacy SQL environments, building scalable pipelines, and enabling authoritative reporting ...

will work with modern AWS technologies to develop scalable data solutions powering reporting, analytics and strategic decision-making. You will build PySpark-based ETL pipelines on EMR, Lambda and EC2, collaborating with stakeholders to translate reporting requirements into robust data solutions. Hybrid working model with time split between home and ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

Developer in central Leeds. The role is hybrid with 2 days in the office, and focuses on leading a team across SQL Server, ETL, and data warehousing. You will shape the data platform and drive data initiatives using Microsoft technologies. The successful candidate will combine hands-on engineering with leadership ...

and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product ...

stakeholders to design scalable data platforms. You will mentor engineers, drive quality, and champion best practices across the data product lifecycle, including discovery, pipelines, ETL/streaming, and analytics to enable informed decision-making. #J-18808-Ljbffr ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...

play a key role in supporting commercial modelling, pricing and underwriting teams. This role would suit someone with strong experience in data engineering, ETL processes, reporting and analytics, who is keen to develop their technical skills in a rapidly evolving data environment including AI. You'll have demonstratable experience working … join a central and highly visible team responsible for delivering innovative and effective data solutions across the business. The role focuses on ETL development, reporting and data analysis ensuring data is accurate, timely and fit for purpose. You will have a strong understanding of data governance and GDPR. Working closely ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills SQL Server/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source ...

future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy SQL environments into a cloud-native architecture Essential Skills SQL and Python Hands … experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

play a key role in supporting commercial modelling, pricing and underwriting teams. This role would suit someone with strong experience in data engineering, ETL processes, reporting and analytics, who is keen to develop their technical skills in a rapidly evolving data environment. You'll be comfortable working with a variety … join a central and highly visible team responsible for delivering innovative and effective data solutions across the business. The role focuses on ETL development, reporting and data analysis using tools such as Alteryx, Tableau and SQL, ensuring data is accurate, timely and fit for purpose. Working closely with pricing, underwriting ...

Aviva plc is seeking a Data Engineering Specialist to drive ETL development, reporting and data analysis across pricing, underwriting and commercial teams. You will work with large, complex datasets and ensure data is accurate, timely and fit for purpose. The role requires strong hands-on experience with Alteryx, Tableau and ...