151 to 175 of 254 Data Pipeline Jobs in England

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments. This is a key technical leadership role, responsible for ensuring the right tooling, controls … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

complex environments. Support and develop capability in Elastic Stack/Elastic Security, with training and upskilling provided as needed. Design, implement and maintain data pipelines, including log ingestion, enrichment and schema standardisation. Develop and tune security detection content, translating threat intelligence and TTPs aligned to MITRE … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

Description: Drive the Decisions Behind a Multi-Million-Pound Business Trade Mastermind & Valente Consulting are looking for an exceptional Senior Data Analyst/Data & Insights Manager to take ownership of the entire data and insights function across a rapidly scaling £25M+ education and business … times. Your key responsibilities will include: Building and managing executive-level dashboards using Power BI and Looker Studio Creating forecasting models for revenue, sales pipeline, cashflow, and performance Managing and optimising large-scale datasets and data pipelines Delivering actionable commercial insights that drive growth and efficiency Analysing ...

Division: Group Technology Location: Glasgow, Liverpool or London Contract: Permanent Working pattern: Hybrid About the Role Be part of how Rathbones brings client data to life. As a Client Reporting Engineer, youll convert complex financial and valuation information into polished, visually engaging, client-ready reports that reflect … quality of our brand. This is a hands-on role blending technical expertise with attention to detail, where youll build robust data solutions, optimise performance, and deliver high-impact reporting to tight deadlines within a leading wealth management firm. What youll be responsible for Build and modify reporting ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) - Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

SeniorML Systems Engineers - Vision ML/Visual Data Processing A privately backed AI technology company operating at the intersection of machine learning in the media industry. You will own core ML infrastructure end to end, from data ingestion and curation through to distributed training and production … Solid understanding of data pipeline performance trade-offs: I/O, compute, batching, memory layout Hands-on PyTorch experience: training pipelines, data loading, preprocessing Practical distributed systems experience (Ray, DDP, or similar) Experience handling TB-scale or high-throughput data pipelines Familiarity with ...

Senior/Principal Palantir Engineer UK (Hybrid) | Permanent | Data & AI Platform About the Role: Highly reputable organisation currently building a high-impact Data & AI capability and are looking for a Senior/Principal Palantir Engineer to help shape and scale their platform from the ground up. … Exciting opportunity to work at the intersection of data engineering, AI, and operational systems, designing solutions that directly drive business decisions and real-world outcomes. You will play a key role in delivering enterprise platforms using Palantir Foundry and AIP, working closely with stakeholders across engineering, operations ...

Digital Data Analyst London, Hybrid working 2 days in office Salary up to £48,000 This is a high impact Digital Data Analyst role for a business investing heavily in its data capability. As they move from legacy reporting into a modern analytics … data lake environment, this position plays a crucial role in shaping how digital performance is understood and improved across ecommerce. The Company They are a well established UK retail brand with a strong omnichannel presence across online and physical locations. The organisation is values led, with a clear ...

ensuring the organisation can forecast with accuracy, speed, and control. The modeller will work closely with FP&A, Finance Business Partners, and our data team to develop scalable, best practice Anaplan solutions that support strategic decision making. Key Role Accountabilities: · Design and build Anaplan models to support automated … budgeting, scenario modelling, and multi dimensional analysis· Lead the development of connected planning across Finance, integrating underwriting, claims, operational and other insurance specific data sources· Translate complex business requirements from Finance and FP&A teams into robust technical Anaplan solutions· Partner with data ...

Data Engineer (AWS) Location: (Hybrid 2-3 days onsite) Salary: £60,000 - £70,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget Security Clearance: Must be eligible for SC Clearance (5+ years UK residency) Sector: Public Sector & Government Client Build the Data Infrastructure That Powers … Public Sector We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn't just about moving data; it's about modernizing essential services and delivering secure, reliable data products at scale. You will play ...

Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance ...

solutions to enable advanced analytics, automation, and decision-making across complex government systems. This is a hands-on engineering role, working closely with data scientists, analysts, architects, and product teams to productionise models, build data pipelines, and embed ML capabilities into live services. Key Requirements Active … beneficial Experience with MLOps practices and tools (CI/CD pipelines, model monitoring, versioning) Strong understanding of data engineering concepts (ETL pipelines, data lakes, feature engineering) Experience working with large-scale structured and unstructured datasets Knowledge of AI ethics, bias mitigation, and model governance Comfortable working ...

Finance Data Engineering Lead - Insurance Programme Contract | Outside IR35 | London (Hybrid) We are working with a leading insurance organisation seeking a Finance Data Engineering Lead to join a major programme at a critical stage of delivery. This is a hands-on role focused on building … delivering data solutions within an established cloud data environment. The Role You will play a key role in developing and deploying finance and actuarial data pipelines, supporting reporting, analytics and reconciliation capabilities. Key responsibilities include: Developing Python/PySpark data pipelines within ...

rich environment. With thousands of colleagues nationwide, they combine deep domain expertise with a strong focus on people, quality and long term outcomes. Data and AI are now a strategic priority, with senior backing to build robust, production grade ML capability. The Role Lead the engineering and productionisation … machine learning and generative AI solutions. Build and operate end to end ML pipelines, including data preparation, model deployment, monitoring and governance. Work closely with data scientists and data engineers to turn experiments and POCs into scalable, reliable services. Develop solutions for large scale ...

Support and coordinate other delivery managers contributing to the AI strategy, aligning plans and sharing good practice Translate technical concepts - such as architectures, data pipelines, and AI engineering approaches - into clear, accessible language for stakeholders Plan and prioritise work packages, balancing short-term delivery needs with longer-term ...

teams in a delivery or assurance capacity. You may not have been necessarily a builder, but someone who has been close enough to data pipelines, model deployment, and API layers to understand what "done" looks like. A background in technology risk, ML engineering, or technical consulting with … single nginx config that nobody has reviewed. Specific things you would be able to do Read and interpret a data pipeline well enough to identify where lineage tracking, PII scanning, or quality checks are missing. Review model evaluation results and know whether HELM benchmarks have been ...

Java script Back-end: Expertise in C# .NET Core, REST APIs, and microservices-based development is essential Python (pyspark): Experience with data pipelines and analytics is a plus. Power BI: Familiarity with developing dashboards and data models. Architecture: Knowledge of microservices, API design, and event-driven ...

Application/Big Data Engineer 6-Month contract - Inside IR35 - market rate London based - hybrid working - up to 3 days a week onsite Finance sector - must have previous experience Role Overview Senior AI/Data Engineer responsible for designing, building, and optimizing AI-driven data pipelines and integrations to enable a QAS-powered response suggestion capability embedded in Salesforce Service Cloud. The role focuses on scalable data processing, LLM integration, and continuous model improvement using production telemetry. Responsibilities Design and implement Salesforce QAS integration architecture Build and optimize data ...

Analytics Engineer Farringdon, London/HYBRID UP TO £60,000 Overview This is a standout opportunity to join a growing data function at an organisation where data is becoming central to how the business operates. You will step into a highly visible role with real influence … owning end to end delivery across data pipelines, modelling, and reporting while helping to shape standards and ways of working from an early stage. The Company They are a globally operating design and professional services organisation delivering complex projects across a wide range of sectors. Headquartered in London ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) - Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access GCS is acting as an Employment Business in relation to this vacancy. ...

Senior Data Engineer - Contract (Hybrid) Seeking an experienced Senior Data Engineer with (strong communcation & stakeholder management experience) expertise in SQL , Infor LN , and Microsoft Fabric to optimise production analytics, purchase orders, cash flow forecasts, and profit margins. Immediate availability required for this hyrbid contract role. Semior … Data Engineer, key Responsibilities Strong communcation & stakeholder management experience Design scalable data pipelines for operational finance functions. Develop dashboards and reports using Microsoft Fabric . Extract, transform, and load data from systems like Infor LN using advanced SQL . Ensure data integrity ...

This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing ...

Senior Data Engineer | £650 - £700 Inside IR35 | Hybrid | London We are looking for an experienced Senior Data Engineer to join a high-profile project delivering modern data solutions within a secure environment. This is a hybrid role which will require … London. Active SC Clearance is mandatory for this role – candidates without current SC clearance cannot be considered Key Responsibilities Design and build scalable data pipelines Work across large-scale data platforms and cloud environments Collaborate with engineering and architecture teams to deliver high-quality solutions ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...