1 to 25 of 187 Data Pipeline Jobs in the UK excluding London

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes … Engineer or similar role Full UK Driving Licence required Strong SQL skills with relational and NoSQL databases Demonstrated experience with data pipeline and ETL tools (e.g. Azure Data Factory, Azure Logic Apps, Databricks, API's) Understanding of different data environments (Data ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Data Engineering Manager, you will lead delivery of AI-powered data engineering programmes owning the full journey from pipeline design and build through to the data products that serve our clients AI, analytics and business needs. We operate in an AI-augmented delivery … model where AI-assisted pipeline development, automated data quality and agentic data operations are current practice, and our managers are expected to lead teams in adopting and embedding these approaches as standard. Youll learn, grow and advance in an innovative culture that thrives on shared ...

Senior Data Engineer LEEDS | ASSET MANAGEMENT | COMPETITIVE PACKAGE Border to Coast Pensions Partnership is one of the UK's largest pension pools and the largest asset manager outside London and Edinburgh. Owned by 18 Local Government Pension Scheme partner funds, we manage approximately £120 billion of assets … Pension Scheme. Integrity, collaboration and sustainability are at the heart of how we work, and we are continuing to invest in our technology, data and innovation capabilities to support our long-term strategic ambitions. Our client is an FCA regulated asset manager with a reputation for taking ...

Data Engineer - Belfast £45,000 to 60,000 GBP Hybrid WORKING Location: Belfast, Northern Ireland - United Kingdom Type: Permanent Data Engineer Location: Belfast Salary: Up to £60,000 Department: Data & Analytics We are looking for an experienced Data Engineer to join … problem-solving skills. Ability to work proactively and independently while collaborating effectively with wider teams. Desirable Experience Python for data engineering or pipeline development. Fivetran, Alteryx or dbt . Data migration from legacy platforms or systems. Experience working with both relational and non-relational databases. ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with ...

Data Architect (Senior/Principal) Location: Remote, with occasional travel to Blandford, Dorset Security Clearance: SC required Why Apply? An opportunity for a Senior or Principal Data Architect to shape the design and strategy of complex data platforms within an Army Digital environment. This … Engineering into architecture and strategy. Strong experience in data platform architecture, data integration, data modelling and complex pipeline design. Knowledge of data governance, assurance frameworks and data migration. Experience delivering data capabilities associated with ...

Opportunity We're working with a leading professional sports organisation that is looking to recruit an experienced Data Engineer to join its growing Data Science team. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to see their … work make a genuine difference within the world of professional sport. Data is playing an increasingly important role in modern sport, helping organisations make smarter decisions through performance analysis, player tracking and advanced analytics. Our client is continuing to invest in its data capabilities ...

Data Engineer Location: Birmingham Hybrid Working Permanent Full Time Salary: up to £45,000 We’re looking for a Data Engineer to join a growing Data & Analytics team, helping to build and develop the data platform that supports reporting, analytics and emerging … cases across the organisation. This is a broad Data Engineering position covering the full data lifecycle. You’ll work from the point data is connected at source, through ingestion, transformation and modelling, into the central data platform where it can be used ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS … across financial, operational, and leasing functions, providing a single source of truth for asset, fund, and portfolio performance. Key Responsibilities Data Pipeline Development Data Platform Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some ...

Title: Senior Data Platform Engineer - Compliance Assurance Contract: 12 Months Location: Chester -3 days per week onsite Rate: Highly Competitive Status: Inside IR35 Working pattern: Fulltime About the role We are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable … code reviews and CI/CD pipelines to manage code changes and promote solutions through Development, UAT and Production. Troubleshoot production issues, improve pipeline performance and establish operational monitoring and support procedures. Collaborate with architects, platform engineers, control owners, risk teams and vendors to deliver reusable engineering solutions. Explore ...

Data Engineer Up to £50,000 Leeds (hybrid) This is a great opportunity to join a high-growth organisation where you can take ownership of modern data engineering initiatives, helping to shape scalable data platforms and support cutting-edge analytics and AI projects. Data … will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS: You will receive ...

Senior Data Engineer Azure/SQL/Python Hampshire Hybrid We are looking for an experienced Senior Data Engineer to join a growing data and analytics function, taking technical ownership of complex data pipelines and platform components from initial design through … production support. This is a hands-on senior individual contributor position with no line management responsibilities, ideally suited to an experienced Data Engineer who enjoys solving complex technical problems, taking ownership of delivery and helping improve engineering standards and data platforms. You will design, build ...

civil engineering and construction sectors, with specialisms in rail, highways, airports, marine, defence, energy, water, and environmental infrastructure. Are you an experienced data and analytics leader looking for the opportunity to build something truly impactful? Join VolkerWessels UK at a pivotal stage in our data journey … developing high-performing teams. Expert-level knowledge of Power BI, DAX, Power Query, Microsoft Fabric, Databricks, SQL and ETL/data pipeline technologies. Strong experience in data governance, data quality and Master Data Management (MDM). A track record of delivering ...

Data Analyst Location: Cardiff (1 Day p/week in the office) Salary: Up to £50,000 + Annual Bonus CPS Group are supporting a growing Technology Healthcare organisation who are looking for a Data Analyst to join their team in Cardiff. This is an excellent … opportunity for a Data Analyst with commercial experience of Data Engineering responsibilities to step into a genuinely hybrid role, combining data analysis, data modelling, reporting and elements of data engineering. The role offers amazing career development and progression opportunities, with ...

client is a global professional services and technology consultancy. Data Engineer Role: Data Engineer Location: Newcastle Upon Tyne Salary: TBC Depending on experience Levels: Senior Analyst, Specialist Hybrid Working: 3 days per week in our Newcastle, Cobalt business park office Please Note: Any offer of employment … data pipelines, ensure data reliability, and support cloud-based architectures that power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support ...

engineering discipline with cutting-edge AI expertise to deliver robust, scalable foundations that turn ambitious transformation into reliable reality. Role Purpose We see data as the foundations for AI and are growing our data practice to help businesses embrace the future and make their data … decisions and technical trade-offs (e.g., lakehouse vs. warehouse, AI context stores). Translate business and functional requirements into scalable, resilient data pipeline architectures and detailed technical roadmaps. Embed non-functional requirements, data security, privacy, lineage, quality controls, and FinOps guardrails directly into the engineering ...

next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets. What You'll Do * Data pipeline development - Data ingestion and pipeline orchestration design and tooling. * Database schema design/database modelling * Data integration - Integrating ...

next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets. What You'll Do * Data pipeline development - Data ingestion and pipeline orchestration design and tooling. * Database schema design/database modelling * Data integration - Integrating ...

Data Engineer +6 months + +Hybrid Malvern +Inside IR35 +£550 - £600 a day +DV cleared - current active clearance is essential for this role We are seeking an experienced Data Engineer to support a major Ministry of Defence (MOD) programme, helping design, develop and maintain secure … data solutions within a highly regulated defence environment. The successful candidate will have strong data engineering experience, with the ability to build and optimise data pipelines, manage complex datasets and ensure data is reliable, secure and accessible to support critical business ...

Join Microlise as a Senior AWS Data Engineer on a 12-month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where youll help turn operational, telematics, customer and third-party data into trusted, reusable data products that power dashboards, APIs, self-service analytics, machine learning and future generative AI services. Youll work with modern AWS managed services, lakehouse architecture, Data ...

Data Engineer Location: London (Hybrid) Salary: £50,000£70,000 + bonus and benefits The Opportunity Im working with a leading organisation in the cyber and defence sector that delivers critical technology solutions across national security. Theyre looking to expand their data engineering capability with engineers … platforms and pipelines rather than data analysis alone. Strong hands-on skills in Python, SQL and ETL/data pipeline technologies. Experience working with large-scale or complex datasets. Understanding of data modelling, pipeline orchestration and end-to-end data ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

client is a global investment management company. Job Title Data Engineering Technical Lead The Role The Data Engineering Technical Lead will play a critical role in shaping and delivering our Europe's data and analytics capabilities. Working within the Chief Data & Analytics … Office (CDAO), this role will lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful ...

Principal Data Engineer Hounslow, Hybrid | £90,000 - £110,000 + Benefits This is an opportunity for a Principal Data Engineer to take ownership of enterprise-scale data engineering initiatives within a well-established organisation undergoing significant investment in its data and technology … combine hands-on technical leadership with team mentorship, shaping engineering best practice while driving the delivery of secure, scalable, and high-performing data products. The Company They are a large, complex organisation investing heavily in its digital and data transformation agenda. Data plays ...