76 to 100 of 515 Data Pipeline Jobs in the UK excluding London

alongside the opportunity to grow towards senior-level responsibilities. Tech Stack Spark | Airflow | Kubernetes | Azure | CubeJS What You'll Be Doing Data Pipeline Development - designing & developing efficient, scalable & robust Data Pipelines Support and main the data platform to ensure security, reliability, and scalability. … Working with the wider engineering team to gather pipeline requirements, project goals & deliver insights where applicable. Collaborating with engineers, product teams, and customer-facing stakeholders What We're Looking For 3-7 years' commercial Data Engineering experience Excellent understanding of data modelling principles and data ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

quality, consistency, security, and lineage throughout all stages of data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across … pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands ...

technical problems. Our globally distributed team values technical excellence, ownership, proactive communication, and collaboration. About the Role We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners, a global leader in wealth-management technology. This is a hybrid … this position to go to the office between 1 to 2 times per week. You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data. ...

Role: Data Engineer Salary: up to £90k Location: City of London Flexible working: Hybrid My client is looking for a Data Engineer with strong Microsoft Fabric expertise to own and develop the data platform, pipelines and reporting that support the business. You'll work … closely with Engineering, Product and commercial teams to turn business requirements into scalable, secure and trusted data solutions. Key skills/Responsibilities Microsoft Fabric: Own and optimise the Fabric environment across OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Spark notebooks, semantic models and DirectLake. Data ...

Data Engineer needed in Lincoln Paying £27.95 per hr ref 376144 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain scalable data pipelines and data integration solutions. Build and optimise ETL/ELT processes to extract data from … various source systems. Develop and maintain data warehouses, data lakes, and cloud-based data platforms. Ensure data quality, accuracy, integrity, and consistency across all data assets. Monitor and troubleshoot data pipelines, resolving performance and reliability issues. Collaborate with ...

hackajob is partnering directly with Accenture to hire for this role. Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout … Python Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/ ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Azure Data Engineer Salary: £36,644 - £45,151 Glasgow Permanent I'm currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards … Microsoft-based technology stack and is looking for someone who can help develop a more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data ...

Data Engineer 6-months £400 - £450 per day (outside IR35) Remote This is an opportunity to join a leading organisation within the media sector, supporting a major data transformation programme across their cloud data platform. You'll play a key role in building … Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline development. Ability to analyse, transform, and optimise complex datasets. Strong problem-solving skills and ability to work collaboratively with technical and business stakeholders. ...

Languages: Expert-level SQL (ability to read Teradata SQL/BTEQ and write highly optimized Spark/Databricks SQL) and strong Python skills for pipeline development and Airflow DAGs. Legacy Systems: Familiarity with Teradata architecture and utilities (FastExport, BTEQ) to effectively understand the source systems being decommissioned. Experience & Qualifications … code conversions, transforming up to 500 legacy Teradata BTEQ scripts into modular, version-controlled, and highly performant dbt (data build tool) models. Pipeline Orchestration: Design, develop, and monitor complex Directed Acyclic Graphs (DAGs) using Astronomer (Apache Airflow) to orchestrate end-to-end data workflows. Data ...

Data Engineer £600-£700 pd Via Umbrella/Mostly Remote Initially for 6 months Leading Southwest based company is looking to bring in 3x Data Engineers to join the Data & Analytics team and help deliver a mix of strategic initiatives and business-critical priorities. … cross-functional product squad, you'll partner with engineers, analysts, product teams and business stakeholders to build scalable, reliable and well-governed data products that drive decision-making and customer value. The core data stack includes Snowflake, dbt, AWS and Tableau , and they are investing heavily ...

needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. ...

Senior AWS Cloud Engineer | S4 | Data & AI Domain | Multiple LocationsCountry: United Kingdom IT STARTS HERE Santander (www.santander.com) is evolving from a global, high-impact brand into a technology-driven organisation , and our people are at the heart of this journey. Together , we are driving a customer-centric transformation … robust risk culture and all our professionals at all levels are expected to take a proactive and responsible approach toward risk management. The Data & AI Domain at Santander is responsible for setting the strategic direction for data, analytics, and artificial intelligence across the organisation. It ensures ...

Senior AWS Cloud Engineer | S4 | Data & AI Domain | Multiple LocationsCountry: United Kingdom IT STARTS HERE Santander (www.santander.com) is evolving from a global, high-impact brand into a technology-driven organisation , and our people are at the heart of this journey. Together , we are driving a customer-centric transformation … robust risk culture and all our professionals at all levels are expected to take a proactive and responsible approach toward risk management. The Data & AI Domain at Santander is responsible for setting the strategic direction for data, analytics, and artificial intelligence across the organisation. It ensures ...

Data Engineer £40,000 - 55,000 GBP Bonus, Pension, Benefits Hybrid WORKING Location: Newcastle Upon Tyne, North East - United Kingdom Type: Permanent Data Engineer Data & Cloud Engineering Location: Newcastle/Hybrid Working Salary: Up to £55,000 + Benefits Package About the Role … working with a leading technology and consulting organisation seeking a Data Engineer to join a growing engineering team delivering large-scale data solutions across a variety of complex projects. This role offers the opportunity to work with modern cloud technologies, real-time data platforms ...

this role. What we do. Electric Car Leasing Why we do it. Greener. Fairer. Future. At Octopus Electric Vehicles weve built a data platform that provides data services to all areas of our business. The aim of the platform is to enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction. The data team at OEV is growing at speed. We have invested time and resources on establishing ...

that we do, with female partners comprising 45% of our partnership. The team you will join The role is based within the Data Systems Team, part of Birketts’ wider IT Business Solutions function. The team is responsible for delivering and supporting the firm’s data platforms … reporting solutions, integrations, automation capabilities and business-critical systems. Working closely with colleagues across the BI Squad and wider IT teams, the Data Automation Engineer will help design, develop and support automated data processes, integrations and data pipelines that improve operational efficiency, reduce manual ...

seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines that underpin operational and analytical services supporting Royal Navy Maritime Domain Awareness outputs. This is a hands-on engineering role, focused on building and operating containerised data and integration services within enterprise on-premise environments that collect, process, enrich and disseminate data across enterprise and geospatial platforms. You will work across the technology stack and will be expected to understand and troubleshoot the infrastructure, operating systems, networking, storage and platform services upon which ...

Senior Data Engineer - London (Hybrid) - Databricks - Up to £ 85,00 0 We're working with a fast-growing tech company that's putting serious investment into its data platform right now and they need a Senior Data Engineer to help lead the charge. … processing and data modelling. Cloud platform experience across Azure, AWS or GCP. Experience implementing data quality frameworks and pipeline monitoring. Excellent communication and stakeholder engagement skills. Why Apply? Salary up to £85,000. Hybrid working model. Modern Databricks and Azure technology stack. Exposure ...

Data Engineering Lead £70,000 - £90,000 London (1 day a week in office) This is a rare opportunity to join a high-growth consumer business as its first dedicated data hire. You'll have the chance to take ownership of an evolving data function, improve existing infrastructure, drive automation, and play a key role in shaping how the organisation uses data to support commercial decision-making. With significant scope for progression, this role offers a clear pathway into future leadership. THE COMPANY This fast-growing consumer business operates across ...

Junior Data Engineer £400-£500 per day via Umbrella | Mostly Remote Initial 6-Month Contract A leading Southwest-based business is looking to bring in a Data Engineer to join its growing Data & Analytics team. This is an exciting opportunity to work … range of strategic data initiatives while developing your skills within a modern cloud-based data environment. You'll join a collaborative, cross-functional team working alongside experienced Data Engineers, Analysts, Product Managers and business stakeholders to help deliver trusted, scalable data solutions ...

Junior Data Engineer £400-£500 per day via Umbrella | Mostly Remote Initial 6-Month Contract A leading Southwest-based business is looking to bring in a Data Engineer to join its growing Data & Analytics team. This is an exciting opportunity to work … range of strategic data initiatives while developing your skills within a modern cloud-based data environment. You'll join a collaborative, cross-functional team working alongside experienced Data Engineers, Analysts, Product Managers and business stakeholders to help deliver trusted, scalable data solutions ...