1 to 25 of 33 Data Pipeline Jobs in West Yorkshire

Senior Data Engineer LEEDS | ASSET MANAGEMENT | COMPETITIVE PACKAGE Border to Coast Pensions Partnership is one of the UK's largest pension pools and the largest asset manager outside London and Edinburgh. Owned by 18 Local Government Pension Scheme partner funds, we manage approximately £120 billion of assets … Pension Scheme. Integrity, collaboration and sustainability are at the heart of how we work, and we are continuing to invest in our technology, data and innovation capabilities to support our long-term strategic ambitions. Our client is an FCA regulated asset manager with a reputation for taking ...

benefits (shared openly at first conversation) Working Type Hybrid Work Hours 37.5 Responsibilities Lead the design, build and optimisation of robust, scalable data pipelines and platforms behind analytics, reporting, AI and machine learning Qualifications Ind Standard Skills Strong expertise across data engineering tooling & platforms: pipelines, cloud … Pension Scheme. Integrity, collaboration and sustainability are at the heart of how we work, and we are continuing to invest in our technology, data and innovation capabilities to support our long-term strategic ambitions. Our client is an FCA regulated asset manager with a reputation for taking ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with ...

Data Engineer Up to £50,000 Leeds (hybrid) This is a great opportunity to join a high-growth organisation where you can take ownership of modern data engineering initiatives, helping to shape scalable data platforms and support cutting-edge analytics and AI projects. Data … will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS: You will receive ...

Data Engineer Up to £50,000 Leeds (hybrid) This is a great opportunity to join a high-growth organisation where you can take ownership of modern data engineering initiatives, helping to shape scalable data platforms and support cutting-edge analytics and AI projects. Data … will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS: You will receive ...

About the role. As part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport network. … focus of this campaign is creating new opportunities, and as a result, we are recruiting Lead Data Engineers. This is a pivotal role within the organisation. In this role, you will work as part of a collaborative team, partnering with stakeholders across the business to understand user needs ...

seeking an experienced Business Analyst to support enterprise data and reporting initiatives across an Azure-based data platform. This role plays a critical part in translating business requirements into clear, structured data, KPI, and reporting specifications. The ideal candidate will bring strong analytical capabilities … definitions. Experience defining KPIs, dashboards, and semantic models for enterprise reporting. Working knowledge of Azure-based data platforms and data pipeline concepts. Hands‐on experience coordinating Power BI reporting requirements. Strong stakeholder management, communication, and facilitation skills. Preferred Qualifications Domain experience in Water Utilities ...

contribute to standards, patterns, and best practices across the team. What You’ll Bring Strong ownership mindset: ability to move from task execution > pipeline ownership > system design accountability. Ability to balance scale, latency, cost, and governance when making design decisions. Solid communication skills to: - Explain technical trade-offs clearly … keys, and data grain, and balances normalisation versus performance using established and reusable modelling patterns. Data Governance: Embeds governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification ...

summary NHS West Yorkshire Integrated Care Board (ICB) is seeking an experienced and innovative Lead Data Engineer to provide technical leadership across our data engineering function. This is a key senior role responsible for shaping and delivering the data and analytics platforms, pipelines … from all the functions of the ICB as well as partner organisations, you will lead the development of scalable, innovative and high performing data solutions, drive automation and continuous improvement, and support the delivery of our data strategy. This is an exciting opportunity for an experienced ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

Data Engineer (Palantir Foundry) Leeds (Hybrid) Permanent £75,000 - £80,000 + Benefits Data Engineer needed with strong Palantir Foundry experience. Permanent position based in Leeds (Hybrid). Start ASAP in September/October 2026. Working remotely from home (WFH), with occasional travel into the office … foundations that support analytics, automation + operational decision making. Design, develop + maintain end-to-end data pipelines using Palantir Foundry (Pipeline Builder, Code Repositories, Data Lineage, Ontology, Workshop, Quiver). Implementing batch, incremental + streaming ETL/ELT workflows with reusable, production ready ...

Lead Data Engineer (Contract)* Leeds | Flexible Hybrid Arrangement 6-Month Contract £550-£600 per day (Outside IR35) Immediate Start Available We're looking for a Lead Data Engineer to join a growing data team and take ownership of a key data integration … available for reporting and decision-making. You'll act as the engineering lead on the project, providing technical direction while remaining hands-on with pipeline development, integration, and data platform design. Responsibilities Design, build and optimise scalable data pipelines Provide technical leadership across Data ...

platform infrastructure on Azure for a public sector client. You'll work with a reasonable degree of autonomy, contributing to infrastructure automation, pipeline reliability, and platform improvements, while collaborating closely with senior engineers, data engineers, and the wider delivery team. Key Responsibilities Support the build … platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines using GitLab, supporting automated build ...

production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection engineering, vulnerability and exposure management … production knowledge graph or graph analytics solution, preferably in cybersecurity. Strong portfolio of hands-on Python and graph-query development, data pipeline engineering, testing, and production deployment. Ability to translate complex security problems into data models, algorithms, measurable experiments, scalable services, and clear technical documentation. ...

Data & AI Engineer Location: Leeds Salary: Competitive Salary + Package (dependent on experience) Career level: Specialist/Consultant Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these services. … more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering - or both CI/CD tooling for data and platform delivery (Git, Azure DevOps, GitHub Actions) Practical ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

analytics, operational workflows, and machine learning use cases. Embed strong data quality principles through validation checks, lineage tracking, and governance frameworks. Monitor pipeline performance and optimize for scalability, cost efficiency, and speed. Implement automated testing, CI/CD patterns, and deployment best practices for Foundry-based data … apps, dashboards, and end-user analytical experiences. Communicate clearly with technical and non-technical stakeholders, ensuring shared understanding of data design and pipeline behavior. Required Qualifications Bachelor’s or master’s degree in computer science, Engineering, Information Systems, or related field. 5+ years of experience in data ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … away from engineering. A UK Wealth Management business is modernising its enterprise data platform and moving from Azure Synapse to Microsoft Fabric. Theyre looking for a Senior Data Engineer who has genuine production experience with Fabric: not simply implementing something and moving on, but supporting ...

Senior Data Engineer Microsoft Fabric Location: West Yorkshire Working pattern: Hybrid, 2 days per week onsite Salary: £70-80k We are looking for a Senior Data Engineer with strong hands on Microsoft Fabric experience to help design and build a modern data platform … Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

multiple years in a row. Join us on our journey. Let’s create tomorrow, together, today. We're looking for a Principal Data Engineer to join our Data Practice and lead the technical direction of our engineering capability. You'll work across a portfolio of clients … spanning multiple industries, helping some of the most ambitious organisations in the UK solve their hardest data problems. A Principal at CreateFuture operates above the delivery line as well as within it. You'll define how we solve the hardest data engineering problems across our client ...

Could you be the Engineer behind the platforms that power better decisions? As a Platform Engineer within our Fabric Data Platform team , you'll help deliver the cloud-based data capabilities that support Yorkshire Building Society's strategic ambitions. From automation and infrastructure as code … platform support and continuous improvement, you'll play an important role in ensuring our data services remain secure, reliable and fit for the future. This is a hybrid role with remote working and some time in our central Leeds office & Bradford office. About the Role As a Platform ...

Data Scientist in Leeds, you'll focus on analysing data and creating models to support business decisions within the financial services industry. Your work will help uncover insights and drive strategies that provide actionable insight and deliver value. Client Details Our client, is a market leading … financial services business, based in Leeds. Due to continued growth they are looking for a Data Scientist to support the strategic use of data within the business. Description Duties of the Data Scientist: Analyse large datasets to identify trends and actionable insights. Develop predictive ...

Data Engineer (Databricks/AWS) Leeds (Hybrid) Permanent £60,000 - £65,000 + Benefits Data Engineer needed for a permanent full-time position based in Leeds (Hybrid). Must have strong Databricks and AWS experience. Hybrid Working Model - primarily working from home with travel … Start ASAP in October/November 2026. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills. Hands-on Data Engineer to run + maintain production data ...

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily … Leeds office 1-2 days per month. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills. Hands-on Data Engineer to run + maintain production data ...

Harnham is seeking a Data Engineer in Leeds with hybrid working options. You will own the design, build, and maintenance of modern data pipelines and scalable data platforms to support analytics and AI initiatives. The role requires strong Python and SQL skills, experience with … cloud platforms (Azure/AWS/GCP), and a hands-on approach to ETL/ELT development. Collaboration with Analytics and Data Science teams is key. #J-18808-Ljbffr ...