24 of 24 ETL Jobs in West Yorkshire

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and Real Time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Qlik Sense (Power BI also considered). Strong stakeholder management and requirements-gathering skills. Solid SQL development skills with experience in data warehousing and ETL processes. Good knowledge of Microsoft Office applications. Experience working within Agile environments. Strong analytical, problem-solving, and organisational skills. Excellent communication skills and attention ...

Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

maintain end-to-end data pipelines using Palantir Foundry (Pipeline Builder, Code Repositories, Data Lineage, Ontology, Workshop, Quiver). Implementing batch, incremental + streaming ETL/ELT workflows with reusable, production ready components. Data modelling, schema design, build data products, semantic layers, metadata management + governance. Designing + maintaining Foundry ...

will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

architectural patterns, data modelling approaches, and AI/Data Science. End-to-End Capabilities: You understand the full lifecycle of data: discovery, storage, pipelines, ETL, and streaming, right through to data quality, metadata management, and advanced analytics for core decision-making. Data Product Mentality: You design Data Products ensuring that ...

using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

holiday entitlement, Health and wellbeing programme, health cash plans + dozens more. Potential bonus Experience: Microsoft Power Platform (Power Automate and PowerApps) Data Modelling ETL processes Experience with Reporting tools like Power BI, SSRS etc SQL Server Desirable tech – Azure, .NET, GIT, Azure DevOps Effectively, this role is responsible ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

Data and Research Team, some of which will be ongoing and may require adjustment to accommodate changing demands and situations Knowledge Essential Knowledge of ETL methods, SQL Server Integration Services (SSIS), and SQL Server Reporting Services (SSRS) Knowledge of business intelligence (BI) development applications and tools Understanding of Information Governance ...

central to the organisations data environment. Youll work across: Designing and building solutions using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production … than simply whether youve crossed an arbitrary two-year threshold. Youll also need a strong grounding in Data Engineering, including: SQL and data modelling ETL/ELT Azure data platforms API integration Git/source control CI/CD and deployment Building and supporting production data solutions Azure Synapse experience ...

will work with modern AWS technologies to develop scalable data solutions powering reporting, analytics and strategic decision-making. You will build PySpark-based ETL pipelines on EMR, Lambda and EC2, collaborating with stakeholders to translate reporting requirements into robust data solutions. Hybrid working model with time split between home and ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

used the platform in a genuine delivery environment rather than someone with only limited exposure. Key responsibilities • Design and build end to end ETL and ELT solutions using Microsoft Fabric • Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with … experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

Developer in central Leeds. The role is hybrid with 2 days in the office, and focuses on leading a team across SQL Server, ETL, and data warehousing. You will shape the data platform and drive data initiatives using Microsoft technologies. The successful candidate will combine hands-on engineering with leadership ...

and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service), ML Data Product ...

stakeholders to design scalable data platforms. You will mentor engineers, drive quality, and champion best practices across the data product lifecycle, including discovery, pipelines, ETL/streaming, and analytics to enable informed decision-making. #J-18808-Ljbffr ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills SQL Server/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source ...

complex SQL queries, stored procedures, views, and functions ✔ Optimize and tune SQL queries for performance ✔ Design and maintain relational databases and data models ✔ Perform ETL processes and ensure data integrity ✔ Troubleshoot database issues and implement solutions What We’re Looking For ✅ Strong SQL expertise (T-SQL/PL-SQL) ✅ Broader … database experience with some of the following (Oracle, MySQL, PostgreSQL) ✅ Knowledge of ETL tools and data warehousing concepts ✅ Understanding of indexes, joins, normalization, and performance tuning ✅ Financial services or Fintech experience Details 💰 Salary: Flexible based on experience 📍 Location: Leeds (Hybrid – 2 days onsite) ⏳ Fixed Term Contract: 6 months 🚀 Start: Immediate ...