651 to 675 of 1,061 Data Pipeline Jobs in England

if you love bringing order to chaos, inventively solving problems, and carving your own path within ambiguity, then you're likely to love it here. As a Marketing Data Engineering Lead (Staff Engineer) reporting to the Head of Data Engineering in our Data Engineering team , your purpose will be to design and own the … technical foundation that proves and improves marketing ROI at Booksy. You'll transform complex data from ad platforms, CRM, and automation tools into a trusted marketing data mart - the single source of truth for measuring performance, enabling attribution, and powering personalized campaigns that fuel our growth. Proven expertise in building and maintaining data pipelines … marketing and advertising platform APIs (Google Ads, Meta Ads, TikTok, AppsFlyer, Iterable, etc.). Strong SQL skills and mastery of Dataform , with experience designing clean, performant, and modular data models supporting attribution and funnel analysis. Deep experience with Google Cloud Platform (GCP) , particularly BigQuery , including cost- and performance-optimized schema design. Advanced knowledge of Customer Data More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to 90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Job Title: Retention Data Analyst Client Location: London - Hybrid (3 days per week onsite) Starting: ASAP Pay: £199.36 per day, PAYE (37.5hrs/week) Hours: Full-time Duration: 12 months Job Description: Join a leading financial software company revolutionizing how businesses manage their finances as a Data Analyst specializing in customer retention. You will play a … within 72 hours of submitting your application, please assume that you have not been selected to progress to the next stage of the hiring process. As a Retention Data Analyst, you will: Develop automated and scalable reporting solutions focused on customer retention, empowering the business with critical data-driven insights. Create comprehensive dashboards by integrating data from various sources, providing senior leaders with a holistic view of customer retention trends. Collaborate with teams to identify and address gaps in data capture related to customer behavior, ensuring a robust understanding of customer interactions. Deliver actionable insights and recommendations based on key customer retention metrics, influencing strategies to improve customer loyalty. Build and maintain More ❯

Senior Analytics Engineer Whitefield, Manchester- Hybrid Up to £60,000 (DOE) + benefits As the Senior Analytics Engineer, you'll work closely with the Head of Data and business stakeholders to design, build, and optimise data pipelines and analytics solutions that power strategic decision-making. You'll be hands-on with SQL Server, Alteryx, Power BI … ensuring the platform is robust, scalable, and future-ready. Senior Analytics Engineer responsibilities: Partner with business teams to understand requirements and deliver meaningful, actionable insights. Design and implement data pipelines from APIs and relational sources. Model data effectively using Kimball/Star Schema methodologies. Develop dashboards, reports, and automated integrations in Power BI. Support the onboarding … of data from newly acquired businesses. Contribute to data strategy, process improvement, and best practice development. Stay ahead of emerging tools, technologies, and AI trends to continually enhance the analytics function. Essential skills and experience: Advanced SQL proficiency (joins, CTEs, window functions). Strong Power BI skills, including semantic modelling, DAX, and report design. Experience building More ❯

Senior Databricks Data Engineer (DPP) London Based (Hybrid) 6 months initial contract + ext Outside IR35 We're looking for a Senior Databricks Data Engineer who has DPP Status (Databricks Partner Program). You'll design and build scalable data platforms, develop pipelines, and help deliver high-performance analytics solutions across cloud environments. Key … Responsibilities Develop and optimise data pipelines and lakehouse solutions using Databricks. Work across AWS, Azure, or GCP environments. Implement best practices in data engineering, CI/CD, and testing. Collaborate with partner and client teams on solution design and delivery. Mentor junior engineers and contribute to reusable frameworks and accelerators. Skills & Experience Strong hands-on experience More ❯

Senior Data Engineer – Hybrid London £75K - £95K Salary: £65,000 – £85,000 Location: London (Hybrid – 2 days per week in office) ECOM Recruitment are working with a growing digital consultancy that delivers data and technology solutions for some of the UK’s best-known brands. We’re looking for a Senior Data Engineer to … join their growing data team. You’ll be working with a talented group of engineers to design and build modern, cloud-based data platforms and pipelines that make a real impact. This is a great opportunity to get hands-on with the latest tools and technologies within a business that truly values collaboration, innovation, and quality. … The Role As a senior member of the team, you’ll be responsible for building and maintaining scalable data pipelines that drive insights and decision-making for clients in fast-moving industries including the gambling sector, so it’s important you’re comfortable working in that space. You’ll work closely with other engineers, analysts, and client stakeholders More ❯

Senior Software Engineer (Data-Centric) Manchester or South London (Hybrid - 2 x a week in office) £70,000 - £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We're Looking For 5+ years' experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable "rolling your sleeves up" to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

are scalable, secure, ethically governed, and fully aligned to business transformation goals. You will define the future of agentic AI within the enterprise , working across architecture, AI engineering, data, security, and business domains to introduce next-generation AI capabilities that deliver measurable impact. Key Responsibilities: AI Strategy & Roadmap Own the enterprise architecture vision for Generative AI and Agentic … multi-agent AI systems. Define AI governance, design principles, lifecycle management, observability and interoperability standards. Ensure seamless integration of AI systems with core enterprise platforms (e.g., ERP, CRM, Data & Analytics). Technology Leadership & Delivery Oversight Evaluate and select AI engineering frameworks (e.g., LangChain, AutoGen) and platform components within Azure (Azure OpenAI, Azure AI Studio/Foundry, Databricks). … Lead architecture across the full delivery lifecycle, supporting engineering teams through build, deployment, testing and productionisation using AIOps and LLMOps best practices. Data, Integration & Readiness Partner with Data Engineering teams to ensure robust data pipelines and contextual data foundations for AI agents. Oversee the design of enterprise-grade data, integration More ❯

apply as soon as you can. If you have any questions, please do contact the team at Job Description Your AI era starts now At Lloyds Banking Group, data isn't just something we store in the cloud. It's the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office … has one mission: weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. As a Data Science & AI Graduate, you won't be on the sidelines watching the algorithms run the show. You'll be training models, crafting algorithms, deploying scalable solutions, and showing exactly what AI … can do in the real world. Whether you're optimising performance, unlocking insight or making predictions, everything you do will be rooted in data literacy, ethics and genuine business impact. Two years. Three game-changing rotations This two-year programme blends office and home working. Across three eight-month placements, you'll see how we use data More ❯

Lead Data Operations BI Analyst Salary: up to £83,000 + 10% bonus Location: North West London (2 days a week in-office) ABOUT THE COMPANY/ROLE An international entertainment and technology business undergoing a large-scale digital transformation is hiring a Lead Data Operations BI Analyst to join its Business Intelligence function. This is … growing BI Operations team, ideal for someone with strong AWS BI experience and an eye for process improvement and automation. ROLE AND RESPONSIBILITIES Oversee daily BI operations including data pipelines, ETL/ELT workflows, and reporting environments Ensure system stability, uptime, and SLA compliance through proactive monitoring Lead incident management, root cause analysis, and production deployments Implement automation … and observability to improve performance and reduce manual effort Manage L2 support issues and coordinate fixes with Engineering and DevOps teams Drive improvements in data quality, governance, and workflow efficiency Collaborate with stakeholders across BI, Data Engineering, and AI teams SKILLS AND EXPERIENCE Required: 5+ years’ experience in BI Operations or Production Support (AWS environment) Strong More ❯

Key Responsibilities: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data. Collaborate directly with traders, quantitative analysts, and portfolio managers to understand data needs and deliver actionable insights. Integrate and manage real-time market data feeds (e.g., Bloomberg, ICE, CME) and internal trading systems. Build and … optimize data models for pricing, risk, and PnL analytics. Ensure high availability and performance of data infrastructure in a low-latency trading environment . Implement data quality checks , monitoring, and alerting systems. Work closely with DevOps and infrastructure teams to deploy solutions in cloud and on-prem environments. Required Skills & Experience Strong proficiency in … Python , including libraries such as Pandas, NumPy, and PySpark. Experience with data engineering tools (e.g., Airflow, Kafka, SQL, Parquet). Solid understanding of commodities markets , trading workflows, and financial instruments. Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes). Proven ability to work in fast-paced, high-pressure environments with direct exposure to the More ❯

Key Responsibilities: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data. Collaborate directly with traders, quantitative analysts, and portfolio managers to understand data needs and deliver actionable insights. Integrate and manage real-time market data feeds (e.g., Bloomberg, ICE, CME) and internal trading systems. Build and … optimize data models for pricing, risk, and PnL analytics. Ensure high availability and performance of data infrastructure in a low-latency trading environment . Implement data quality checks , monitoring, and alerting systems. Work closely with DevOps and infrastructure teams to deploy solutions in cloud and on-prem environments. Required Skills & Experience Strong proficiency in … Python , including libraries such as Pandas, NumPy, and PySpark. Experience with data engineering tools (e.g., Airflow, Kafka, SQL, Parquet). Solid understanding of commodities markets , trading workflows, and financial instruments. Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes). Proven ability to work in fast-paced, high-pressure environments with direct exposure to the More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high … and DevOps ✅ What You Bring Must-Haves: 5+ years in data engineering Deep hands-on experience with Databricks Strong grasp of medallion architecture & DLT Proven experience in pipeline migration & optimization Excellent communication skills—technical and non-technical audiences Comfortable in fast-paced, client-facing environments Nice-to-Haves: Unity Catalog experience Certifications (Databricks, Azure, AWS) Industry experience More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high … and DevOps ✅ What You Bring Must-Haves: 5+ years in data engineering Deep hands-on experience with Databricks Strong grasp of medallion architecture & DLT Proven experience in pipeline migration & optimization Excellent communication skills—technical and non-technical audiences Comfortable in fast-paced, client-facing environments Nice-to-Haves: Unity Catalog experience Certifications (Databricks, Azure, AWS) Industry experience More ❯

Data Engineer, Customer Decisioning & AI, London, hybrid Salary: up to £45,000, depending on experience Location: London, hybrid, in office Monday to Wednesday Job ref: J13027 We are working with a fast growing tech company helping some of the best known UK brands turn first party customer data into real competitive advantage. This is not “keep … the lights on” engineering, this is building. You will ship data products, learn fast, and help scale a platform where clean, modern engineering is front and centre in every decision. You will sit alongside talented AI engineers and analysts, see how models are productionised at scale, and watch your pipelines power real outcomes for real customers. What you … will do Build robust, well structured data pipelines in Python and SQL, Work across modern cloud platforms, Azure, AWS, or GCP, Integrate machine learning outputs into data products, Automate and monitor flows so data moves securely and reliably, Contribute to DevOps practices, CI and CD, testing and observability. What you will bring 1 plus More ❯

Data Engineer, Customer Decisioning & AI, London, hybrid Salary: up to £45,000, depending on experience Location: London, hybrid, in office Monday to Wednesday Job ref: J13027 We are working with a fast growing tech company helping some of the best known UK brands turn first party customer data into real competitive advantage. This is not “keep … the lights on” engineering, this is building. You will ship data products, learn fast, and help scale a platform where clean, modern engineering is front and centre in every decision. You will sit alongside talented AI engineers and analysts, see how models are productionised at scale, and watch your pipelines power real outcomes for real customers. What you … will do Build robust, well structured data pipelines in Python and SQL, Work across modern cloud platforms, Azure, AWS, or GCP, Integrate machine learning outputs into data products, Automate and monitor flows so data moves securely and reliably, Contribute to DevOps practices, CI and CD, testing and observability. What you will bring 1 plus More ❯

Senior Data Scientist – Biomedical AI 📍 London (Hybrid, 4 days onsite) I’m working with a fast-growing company at the cutting edge of AI-driven biomedical research. They’re hiring a Senior Data Scientist with strong biological or biomedical expertise to design and deliver next-generation machine learning solutions for life sciences. You’ll apply advanced … ML to complex datasets - genomics, proteomics, imaging, clinical data, accelerating work in drug discovery, biomarker development, and health data analysis. What You’ll Do Build and deploy ML models across diverse biomedical datasets Collaborate with biologists, clinicians, and engineers to turn scientific questions into AI solutions Develop robust data pipelines and reproducible research workflows … Support strategic data science initiatives and mentor junior colleagues Communicate findings across teams and represent the company externally What They’re Looking For Strong academic background in Bioinformatics, Computational Biology, Data Science, or related field (advanced degree preferred) Hands-on experience applying ML to biological or biomedical data Proficient in Python and modern ML More ❯