226 to 250 of 856 Data Pipeline Jobs in the UK

release management and rollback processes. Implement monitoring, logging and observability for data pipelines and dashboards (for example Application Insights, logging frameworks and pipeline metrics) and act on alerts. Work with ML/agentic automation teams to integrate or evaluate agent-based workflows where applicable (e.g. controlled … requirements through to deployed solutions and operational support. Proven experience designing and operating CI/CD for data platforms and analytics applications (pipeline automation, test automation, release orchestration).Practical familiarity with software development life-cycle practices (version control, code review, unit and integration testing, release management).Experience ...

Days Per Week in Office + 2 Days RemotePay: c.700 per day PAYEConsultant: Joe MooreThis is an exciting role for a Senior Data Engineer with strong Databricks and Delta to join a world-leading Energy Trading company. Role Description: We are looking for a highly skilled Senior Data Engineer with strong analytical capabilities and hands-on experience in building scalable data solutions. The ideal candidate will have expertise in Databricks, streaming architectures, data ingestion frameworks, and dashboarding, along with experience working with SAP data sources. You will be responsible ...

leading consultancy partner is seeking two experienced Data Engineers to join a major data transformation and cloud modernisation programme within a large banking organisation. This is an excellent opportunity for hands-on Data Engineers who enjoy building scalable data solutions, solving complex … data challenges, and contributing to enterprise-wide cloud transformation initiatives. Key Responsibilities Design, build, and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python, SQL, and Oracle. Support the migration of data assets from legacy platforms ...

leading consultancy partner is seeking two experienced Data Engineers to join a major data transformation and cloud modernisation programme within a large banking organisation. This is an excellent opportunity for hands-on Data Engineers who enjoy building scalable data solutions, solving complex … data challenges, and contributing to enterprise-wide cloud transformation initiatives. Key Responsibilities Design, build, and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python, SQL, and Oracle. Support the migration of data assets from legacy platforms ...

Senior Data Engineer/Tech Lead Defence & National Security Location: London Hybrid (23 days on-site) Salary: £60,000£72,000 + 10% bonus Eligibility: Sole British nationals only Company Overview An opportunity to join a leading digital, cyber and intelligence organisation delivering complex technology solutions across … defence and national security. Working on mission-critical programmes, you'll help transform complex data into actionable insights, supporting government and defence customers operating in some of the most demanding environments. Role Overview We're looking for a Senior Data Engineer/Tech Lead to take ...

DATA ENGINEER £50,000 Leeds This is a unique opportunity to become the first dedicated Data Engineer within a growing data function. You'll play a key role in shaping the company's data engineering capabilities, building modern data solutions … influencing the future direction of the platform whilst working across a variety of analytics, data science and AI projects. THE COMPANY Our client is a global business operating across the marketing, technology and data space, partnering with a range of well-known consumer brands. With significant ...

based Employment type: Permanent The Opportunity We're working with an established and growing UK business that is looking to appoint a senior data analytics engineer to take ownership of its modern data platform and help shape the next stage of its data journey. … business has made significant investment in its technology and data infrastructure, creating an opportunity for someone to build on those foundations, improve existing capabilities and have a genuine influence on how data is used across the organisation. This is a hands-on position, ideally suited ...

production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection engineering, vulnerability and exposure management … production knowledge graph or graph analytics solution, preferably in cybersecurity. Strong portfolio of hands-on Python and graph-query development, data pipeline engineering, testing, and production deployment. Ability to translate complex security problems into data models, algorithms, measurable experiments, scalable services, and clear technical documentation. ...

financial insights for stakeholders across Trayport. As a core member of the BI team, you will be instrumental in transforming complex, often unstructured data into clear, actionable insights that drive strategic business decisions. You are a self-starter who thrives in ambiguity and isn't afraid of "messy … data. More than just a technical expert, you act as a bridge between our data infrastructure and the wider business, seamlessly adapting your communication style to collaborate with both technical engineering teams and non-technical stakeholders. Key ResponsibilitiesEnd-to-End Analytics: Design, develop, and maintain interactive, high-performance ...

Snowflake Data Engineer Up to £60,000 We're looking for a Snowflake Engineer to join a growing data team responsible for building and evolving a modern cloud-based data platform. This is an opportunity to work with large and complex datasets, helping … improve how data is consumed across the business. As part of a highly collaborative engineering team, you will be involved in designing and developing scalable data solutions within Snowflake, as well as supporting reporting, analytics and emerging AI initiatives. You will have the chance to work ...

Data Scientist/DV Clearable/5 Days Onsite Location: London We're looking for a Data Scientist with circa 2-3 years' experience to join a growing data science team. This is a hands-on role where you'll apply your skills … real-world problems, working alongside experienced practitioners and contributing to meaningful, production-focused work. What you'll be doing Designing and delivering data science solutions to solve business problems Applying statistical and analytical techniques to explore data and test hypotheses Writing and maintaining Python code ...

burden Clear handover into BAU Profile Role 1: CDI Data Engineer Must Have worked with: Strong SQL, Python/Spark and Databricks pipeline engineering background. Large-scale transaction, payment, loyalty, EPOS/WRE and identity-matching work history Historical/full/incremental loads, high-water marks … knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version control and automated deployment Worked ...

will be accountable for the delivery, quality and technical direction of the team's work across Oracle Database, Oracle APEX applications and the data pipelines that ingest, transform and validate data from multiple internal and external sources. You will make sure that data … backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception handling ...

will be accountable for the delivery, quality and technical direction of the team's work across Oracle Database, Oracle APEX applications and the data pipelines that ingest, transform and validate data from multiple internal and external sources. You will make sure that data … backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception handling ...

will be accountable for the delivery, quality and technical direction of the team's work across Oracle Database, Oracle APEX applications and the data pipelines that ingest, transform and validate data from multiple internal and external sources. You will make sure that data … backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception handling ...

Data & AI EngineerLocation: LeedsSalary: Competitive Salary + Package (dependent on experience) Career level: Specialist/ConsultantAccenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these services. With our thought … more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering — or both CI/CD tooling for data and platform delivery (Git, Azure DevOps, GitHub Actions) Practical ...

Data & AI EngineerLocation: GlasgowSalary: Competitive Salary + Package (dependent on experience) Career level: Specialist/ConsultantAccenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these services. With our thought … more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering — or both CI/CD tooling for data and platform delivery (Git, Azure DevOps, GitHub Actions) Practical ...

Data Engineering Lead West London - Onsite 5x day per week Up to £78k + Benefits We're partnering with a well-known consumer-facing organisation that is investing heavily in its data capabilities. With a growing technology team and strong backing from senior leadership, this … opportunity to take ownership of the data function and help shape its future direction . The organisation is at an early stage of its data maturity journey. Data is currently spread across multiple systems, with a third-party managed data warehouse already ...

Senior Data Engineer – SQL/Python/AWS Adria Solutions is recruiting a Senior Data Engineer for a growing business developing a new digital services platform. With established backing, the business is building its data capability from the ground up. As its first dedicated … data engineer, you’ll have significant input into the architecture, technology choices and standards that underpin reporting, analytics and future AI capabilities. The role Reporting to the CTO, you’ll turn platform, transaction and third-party data into trusted datasets for operational insight, financial reporting ...

Databricks Data & AI Engineer Manchester or London (Hybrid Working) | Up to £50,000 + Bonus + Benefits Are you passionate about building modern data platforms and working with the latest Data & AI technologies? Do you want to play a key role in delivering large … scale data transformation projects for some of the UK's most recognised organisations? An exciting opportunity has arisen for a Databricks Data & AI Engineer to join a leading technology and consulting organisation with a strong reputation for delivering cutting-edge cloud, data, analytics ...

Data and Analytics Manager, Microsoft Fabric, SQL, AI & Automation A Data and Analytics Manager opportunity has arisen with a well-established UK business that is already making strong progress on its data journey. Could this be the right next step for someone who wants … roll up their sleeves and make a genuine impact rather than starting from scratch? The Role The Data and Analytics Manager will take ownership of an already-defined data and analytics direction, driving delivery and execution across a broad remit. Day-to-day, this means overseeing ...

hybrid (UK based candidates only) | Initial 6-Month Contract | £500 pd Outside IR35 | Possibility for extension We're looking for an experienced AWS Data Architect to design and deliver modern cloud-native data platforms. This is a hands-on role focused on building scalable, secure … high-performing solutions that support analytics, AI, and enterprise reporting. Key Skills Required AWS (S3, Glue, Redshift, Athena, Kinesis, Lambda) Data Lake & Lakehouse architectures ETL/ELT & data pipelines Python, SQL & PySpark Data modelling (Kimball, Data Vault) Data governance & security ...

Location: London; UKWork type: HybridSeniority: MiddlePrimary skill: Microsoft AzurePosted: 2026-10-09Enterprise organizations face mounting pressure to unify, govern and activate data across complex platforms and business units. This is the Microsoft Fabric Data Engineer role at EPAM in Germany, the Netherlands … working hybrid. You help clients build, deploy and run enterprise-grade data and analytics solutions using Microsoft Fabric and Power BI, collaborating both remotely and on-site. The role connects target architectures and design documents to production-ready solutions, automating deployments and ensuring every delivery meets engineering standards. ...

pass up this chance, apply quickly if your experience and skills match what is in the following description. Palantir Foundry Consultant/Data Engineer | Defence & Security SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth of a leading Palantir capability … within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development ...

pass up this chance, apply quickly if your experience and skills match what is in the following description. Palantir Foundry Consultant/Data Engineer | Defence & Security SC Cleared/DV Eligible London/Bristol/Manchester Salaries DOE We're supporting the growth of a leading Palantir capability … within a high performing Technology & Transformation practice, delivering complex data and digital solutions across the Defence & Security sector. This is an opportunity to work on some of the UK's most challenging and impactful programmes, helping clients unlock value from their data through the design, development ...