176 to 200 of 254 Data Pipeline Jobs in England

Finance Data Design Lead - Insurance Transformation Contract | Outside IR35 | London (Hybrid) We are supporting a large-scale insurance transformation programme entering a critical delivery phase and are looking to engage an experienced Finance Data Design Lead. This role sits at the centre of delivery, bridging architecture … engineering, and will play a key part in shaping and implementing complex finance and actuarial data solutions. The Role You will be responsible for translating high-level architecture into detailed, implementable designs across finance, actuarial and regulatory reporting data domains. Key responsibilities include: Designing finance data ...

Denodo Data Engineer - SC Cleared Day Rate: £470 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically 1-2 days per month) in Telford or Hove Security Clearance: Active SC clearance required Role Overview … seeking an SC-cleared Denodo Data Engineer to join a central government data platform programme . This is a client-facing role requiring strong communication skills, commercial awareness, and a proactive approach. You will work within a delivery team to build and deliver base and integration ...

reliability, scalability, and operational integrity of our machine-learning systems in research & production. This role sits at the intersection of data engineering and ML infrastructure: youll design and operate data pipelines that feed models, and youll build the tooling that trains, deploys, monitors, and retrains them. … lifecycle infrastructure Productionizing models: packaging, deployment, versioning, and rollback Designing CI/CD pipelines for ML (training validation deployment) Implementing model monitoring (data drift, prediction drift, performance decay) Managing experiment tracking and reproducibility Data engineering foundations Building and maintaining batch and nearreal-time data ...

agile environment Able to balance innovation with robustness and user impact Nice to Have Experience working on customer-facing products Exposure to data pipelines, prompt engineering, or AI optimisation Interest in shaping how AI is adopted across a wider product suite Why Join? Work on a well-established ...

service reliability standards (SLOs), leading initiatives around capacity planning, performance testing, and fault tolerance Identify and resolve performance bottlenecks across applications, APIs, and data pipelines to improve speed and efficiency Enhance observability and operational stability through better monitoring, logging, and proactive issue detection Establish and promote strong engineering ...

environment where every employee feels included, developed and empowered to fulfil their aspirations. Join Gilead and help create possible, together. Job Description Data/AI Delivery Lead, Commercial Based at Stockley Park, UK - 3 days a week in office We are pleased to share that Gilead's Stockley … three days working onsite As part of our enterprise AI strategy to speed life-changing therapies to patients, we are seeking a Data/AI Delivery Lead to lead the technical development and delivery of AI/ML solutions across commercial operations. In this role, you will bridge ...

Role : Data Architect Location: Bournemouth Salary: £90,000 + Bonus WFH policy: One Day a month My client who is a leading insurance company is looking for a Data Architect to join their team, this is an exciting opportunity as you will be working on transformational … project this is not a BAU role. Role and Responsibilities Lead solution-level data architecture across a complex data estate, acting as the key link between business stakeholders, analysts, and engineering teams to ensure practical, delivery-focused outcomes Own end-to-end design authority, shaping both ...

leadership teams on future platform improvements. What you will do Build and improve backend services running in Azure Develop APIs, integrations, and data pipelines Work across 60 percent greenfield development and 40 percent core system improvement Contribute to architecture and technical discussions Support code reviews, testing, and engineering ...

Splunk (Enterprise and ES), including tuning and optimisation Expertise in detection engineering, including MITRE ATT and risk-based alerting Experience building and maintaining data pipelines, log ingestion and schema standardisation Advanced knowledge of SPL, KQL or EQL Experience with SIEM operations, including scalability, high availability and performance Automation ...

leading Professional Services firm is looking to hire a Finance Data Engineering & Analytics Lead to join their team. You will develop Python/PySpark-based data pipelines, build data models and datasets for finance, actuarial and risk reporting. You will also develop analytics, dashboards … data validation tooling. You will also support data quality monitoring and apply AI in delivery. KEY REQUIREMENTS: Strong Python capabilities Experience with Cloud Data Platforms is vital Exposure to Finance/Actuarial is essential Understanding of AI-enabled tooling is a necessity London Market ...

Responsibilities Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. Schema … Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats for analytics. Monitoring & Cost Governance: Implement unified observability for the entire stack. Specifically, monitor Snowflake credit usage and ClickHouse resource utilization to ensure peak ROI. Automation: Use Python, Bash and/ ...

Data Engineer (Denodo) - SC Cleared Sanderson Government & Defence Sanderson Government & Defence is supporting a major UK public sector programme and is seeking an experienced Data Engineer with strong Denodo expertise to join a high-performing delivery team. This is a client-facing role within a dynamic … data services environment, requiring excellent communication skills, a proactive mindset, and strong commercial awareness. You will play a key role in delivering data integration solutions across multiple connected systems, supporting large-scale migration and transformation initiatives. Key Responsibilities Work within a client-facing team to deliver ...

Data Engineer - Contract Rate: £500 per day (inside IR35) Location: Remote with 1 day per month in Leeds Duration: Until March 2027 with the possibility of extension Availability: 2 weeks' notice or less required Clearance: BPSS check required The Role We are working with a leading healthtech consultancy … joined-up system, underpinning services including the Electronic Prescription Service, GP Connect, and the national roll-out of Electronic Patient Records. As the Data Engineer, you will play a hands-on role in designing, building, and maintaining the data pipelines and platform infrastructure that underpin these ...

Data Engineer (Streaming) – Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems … with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring ...

relevant analytical approaches and customized solutions, tailored to different client contexts Driving the development, maintenance, and scaling of knowledge assets, including products, tools, data, analytics, and topic or sector materials Framing, structuring, and developing intellectual property, with the ability to write clearly and concisely for senior audiences Communicating … advanced degree preferred) Expertise in business, people, and organizational analytics, with experience using SQL and Python Hands-on experience with ETL tools and data pipelines to extract, transform, and integrate data from multiple internal and external sources Strong ability to manipulate, structure, and analyze complex datasets ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

role, 1-3 days per week in Farnborough is needed. Key skills required Backed development experience (Mid-senior level) Python Data Pipeline Creation and Management API Creation and Integration Database Creation and Integration Working with JSON If you have worked in a security cleared environment, have ...

Robert Half Technology are assisting a telecommunications business to recruit a Senior Data Platform Engineer on a 9-month contract basis. Hybrid working - Hampshire/London based. ASAP start. Role * The Senior Data Platform Engineer will take full ownership of the production data platform … including ingestion, orchestration, infrastructure, and observability. * Design, build, and deliver scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover, including hypercare support. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/Sage X3 (ERP), and Billing ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

work on cutting-edge AI technologies and contribute to transformative projects across multiple domains. In this role, youll help design and build modern data pipelines that bring together information from a variety of systemsmaking data accessible, trustworthy, and ready for intelligent analytics and AI solutions. … Applyreinforcement learningtechniques includingQ-learning,policy gradients, andRLlib. Collaborate with cross-functional teams to integrate AI solutions into scalable products. Ensure best practices in data engineering and contribute to architectural decisions. Contribute to the mentoring and development of junior team members. Support senior team members in identifying and addressing ...

academic research position; the focus is entirely on shipping robust models that solve concrete operational challenges. You will bridge the gap between data architecture, cloud infrastructure, and predictive modelling. Core Responsibilities Architect, train, and launch production-grade artificial intelligence and machine learning applications. … Hands-on engineering experience within major cloud platforms (AWS, Azure, or GCP). Deep understanding of core data engineering methodologies and automated pipeline design. Practical experience leveraging Generative AI technologies, including Retrieval-Augmented Generation (RAG), prompt optimization, and model fine-tuning. Thrives in high-velocity, output-oriented ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

least 5 years in technical leadership roles. Strong experience in Azure cloud architecture and enterprise application delivery. Experience working with Dataiku for analytics, data pipelines, or AI/ML-driven applications. Strong knowledge of .NET/ASP.NET Core architecture and enterprise integrations. Experience with financial services, treasury, derivatives … risk management platforms. Understanding of derivative valuation concepts, yield curves, curve validation, or market data processing. Experience with APIs, microservices, DevOps, and CI/CD pipelines. Strong stakeholder management and client-facing communication skills. Experience managing distributed/global teams. Preferred Skills Exposure to market risk or quantitative ...

Contract Duration: 6 Months Pay Rate: 250 to 270 GBP/Day via Umbrella(Inside IR 35) The Opportunity Are you a Senior Data Analyst who is tired of just "maintaining" dashboards? Our client is looking for a forward-thinking analyst to join a Global Customer Success Data … into core workflows to automate insights and enhance the customer journey across multiple global markets. If you are passionate about moving beyond manual data prep and into the world of AI-native analytics , this is the role for you. What You'll Do Build AI-Native Foundations: Work ...

Contract Duration: 6 Months Pay Rate: 250 to 270 GBP/Day via Umbrella(Inside IR 35) The Opportunity Are you a Senior Data Analyst who is tired of just "maintaining" dashboards? Our client is looking for a forward-thinking analyst to join a Global Customer Success Data … into core workflows to automate insights and enhance the customer journey across multiple global markets. If you are passionate about moving beyond manual data prep and into the world of AI-native analytics , this is the role for you. What You'll Do Build AI-Native Foundations: Work ...