551 to 575 of 1,061 Data Pipeline Jobs in England

is expanding its BI capability and looking for a Senior BI Developer to join their Leeds team. This is an opportunity to work on large-scale, business-critical data projects using modern Microsoft technologies, helping to shape how the business leverages … data across multiple functions. What You’ll Be Doing Design, build, and deliver BI solutions that power decision-making across the organisation. Develop and maintain ETL pipelines, data models, and dashboards using: Azure Data Factory SQL Server/Data Warehousing SSIS/SSRS Power BI (Cognos a plus) Collaborate closely with stakeholders … in Finance, Operations, and Marketing to translate requirements into data-driven insights. Work within an Agile environment, focusing on clean, maintainable, testable code. Champion best practices in BI, testing, version control, and release processes. About You You’re an experienced BI Developer who loves turning complex data into meaningful business insights. You understand how to design More ❯

Palantir Foundry Engineer/Palantir/Data/Foundry/London/Permanent/DV Clearance Vivo Talent is engaged exclusively to recruit a Palantir Foundry Engineer for a client of ours based in London. You will be engaged in designing and delivering scalable data solutions that power key insights across the organisation. It is an … ideal opportunity for a Data Engineer who has extensive experience working with Big Data technologies and Palantir Foundry. What You’ll Do: Build and deploy large-scale data processing systems, leveraging Big Data frameworks and cloud platforms. Champion code quality and maintainability through best practices and mentoring team members. Estimate technical effort … and provide guidance on data architecture decisions. Utilise Palantir Foundry to model, integrate, and optimize data pipelines, helping turn raw data into actionable insights. What We’re Looking For: Proficiency in Java, Scala, or Python. Hands-on experience with cloud platforms (AWS, Azure, GCP) and data tools like Databricks. Strong knowledge of More ❯

Palantir Foundry Engineer/Palantir/Data/Foundry/London/Permanent/DV Clearance Vivo Talent is engaged exclusively to recruit a Palantir Foundry Engineer for a client of ours based in London. You will be engaged in designing and delivering scalable data solutions that power key insights across the organisation. It is an … ideal opportunity for a Data Engineer who has extensive experience working with Big Data technologies and Palantir Foundry. What You’ll Do: Build and deploy large-scale data processing systems, leveraging Big Data frameworks and cloud platforms. Champion code quality and maintainability through best practices and mentoring team members. Estimate technical effort … and provide guidance on data architecture decisions. Utilise Palantir Foundry to model, integrate, and optimize data pipelines, helping turn raw data into actionable insights. What We’re Looking For: Proficiency in Java, Scala, or Python. Hands-on experience with cloud platforms (AWS, Azure, GCP) and data tools like Databricks. Strong knowledge of More ❯

innovate in a space that’s crying out for smarter technology Develop the infrastructure to ensure we are building and releasing continuously and safely Develop the data pipeline so we can make data driven decisions You’ll have freedom to try new ideas, use modern tools, and contribute to shaping what “great” looks like for More ❯

London 💼 Full Time | Hybrid (2-3 days in office) 💰Up to £75,000 + 20% Bonus Omnis Partners is proud to represent a leading data and AI consultancy that is driving transformation across industries. Our client empowers organisations to harness the full potential of their data, reducing costs, mitigating risk, and uncovering new revenue opportunities through … cutting-edge solutions and world-class talent. Working with major technology partners including Databricks, Snowflake, and Collibra, they deliver projects that revolutionise how data is used across sectors such as financial services, pharmaceuticals, energy, retail, healthcare, and manufacturing. The Role: Data Engineer (Databricks) We are seeking an experienced Data Engineer with strong expertise in … Databricks , Apache Spark, Delta Lake, Python, and SQL to take a lead role in delivering innovative data projects. You will design and build scalable, cloud-based data pipelines on platforms such as AWS, Azure, or GCP, and provide technical leadership within delivery squads. Working closely with both clients and internal teams, you’ll translate business requirements More ❯

London 💼 Full Time | Hybrid (2-3 days in office) 💰Up to £75,000 + 20% Bonus Omnis Partners is proud to represent a leading data and AI consultancy that is driving transformation across industries. Our client empowers organisations to harness the full potential of their data, reducing costs, mitigating risk, and uncovering new revenue opportunities through … cutting-edge solutions and world-class talent. Working with major technology partners including Databricks, Snowflake, and Collibra, they deliver projects that revolutionise how data is used across sectors such as financial services, pharmaceuticals, energy, retail, healthcare, and manufacturing. The Role: Data Engineer (Databricks) We are seeking an experienced Data Engineer with strong expertise in … Databricks , Apache Spark, Delta Lake, Python, and SQL to take a lead role in delivering innovative data projects. You will design and build scalable, cloud-based data pipelines on platforms such as AWS, Azure, or GCP, and provide technical leadership within delivery squads. Working closely with both clients and internal teams, you’ll translate business requirements More ❯

Data Visualisation & Analytics Experience Specialist Overview We are seeking a highly skilled Data Visualisation & Analytics Experience Specialist to bridge the gap between data, design, and user experience. This role combines analytical capability with front-end development and UX skills to create intuitive, impactful interfaces for data-driven decision making. You will work … closely with Business Analysts, Product Teams, Engineers, and Data Practitioners to turn complex outputs into accessible, engaging visual products. Key Responsibilities Data Analysis & Insight Delivery Collaborate with Business Analysts and Product Teams to identify high-impact business problems that can be solved through data analysis and visualisation, utilising tools such as Microsoft Fabric and … pipelines and feature engineering activities in partnership with Data Engineers. Design and develop a unified, user-friendly front-end interface that integrates dashboards, reports, models, and pipeline outputs into a single cohesive experience. Optimise front-end application performance, ensuring fast load times, responsive layouts, and smooth, intuitive interactions. User Experience & Accessibility Ensure all interfaces and visual More ❯

Engineer to bring cutting-edge AI into ZEFR's internal operations and go-to-market teams. In this role, you'll combine full-stack engineering, cloud expertise, and data engineering with the latest in agentic AI to create internal solutions that drive revenue growth, operational efficiency, and smarter decision-making. This is a builder's role. You'll … impact. Design and build full-stack AI solutions (front-end, back-end, and integrations) to support GTM and internal teams. Develop agentic AI systems that automate complex workflows (e.g., pipeline forecasting, knowledge retrieval, reporting, customer engagement). Engineer data pipelines and integrations with enterprise SaaS platforms (Salesforce, Snowflake, Looker, Jira, Slack, etc.). Leverage GCP or AWS … infrastructure to deploy scalable, secure, and cost-efficient solutions. Partner with GTM stakeholders to identify and prioritize high-value problems, then rapidly prototype and iterate on solutions. Apply data engineering best practices to ensure high-quality, accessible, and actionable data across business functions. Collaborate cross-functionally with product, data science, and operations to evangelize More ❯

a global gaming platform that integrates with multiple third-party services. The engineer will work across REST APIs, secure authentication flows, event feeds, and a scalable data pipeline to support users worldwide with high reliability and performance. Technical requirements: Strong experience with Node.js or TypeScript Building and consuming REST APIs Implementing OAuth2 and OIDC for secure authentication … Handling webhooks and event feeds (eg, Twitch EventSub, FACEIT callbacks) PostgreSQL for data storage and data-model design Redis for caching, reliability, and retry logic Simple queueing for background tasks and failure retries Rate-limit handling and backoff strategies Cloud deployment experience with strong security hygiene, configuration management, and secrets handling Exposure to monitoring, logging, and More ❯

Lead Data Operations BI Analyst Up to £83,000 + 10% bonus Watford Junction - Hybrid (ideally 3 days per week, 2 in Watford and 1 in London) Sponsorship available The Company This global technology-driven organisation is on a major data transformation journey, building the infrastructure and intelligence behind one of the UK's most high … profile platforms. They've created a collaborative, fast-paced environment where data, analytics and engineering teams play a critical role in ensuring operational excellence and continuous improvement across business systems. The Role Sitting within the wider Business Intelligence function, this role reports into the BI Data Operations Manager and acts as the technical lead across data monitoring, automation, and issue resolution. You'll work closely with the offshore team of engineers and analysts, ensuring data pipelines and workflows run seamlessly within an AWS environment. Day to day, you'll: Oversee end-to-end data operations, ensuring all loads complete successfully and identifying and resolving workflow issues within Airflow Manage and More ❯

Data Engineering Lead 📍 Hybrid – 1–2 days per week in Old Street, London | 💰 £60,000–£70,000 per annum | 📅 18-month FTC (potential to go permanent) We’re working with Better Society Capital , the UK’s leading impact investor, to help them find their first-ever Data Engineering Lead . This is a rare opportunity to … build something from the ground up, shaping how data is managed, integrated, and used to drive meaningful social change. In this hands-on, strategic role, you’ll design and develop modern data pipelines using SQL , Python , and Azure/Fabric , while also guiding the wider organisation through their data transformation journey. You’ll be … the link between technology and the business, understanding needs, building solutions, and championing data-driven decision-making across teams. They’re looking for a self-starter who can bring both technical expertise and strong stakeholder skills, someone who’s confident leading conversations, defining standards, and making data accessible to everyone. You’ll play a central role More ❯

Data Engineering Lead 📍 Hybrid – 1–2 days per week in Old Street, London | 💰 £60,000–£70,000 per annum | 📅 18-month FTC (potential to go permanent) We’re working with Better Society Capital , the UK’s leading impact investor, to help them find their first-ever Data Engineering Lead . This is a rare opportunity to … build something from the ground up, shaping how data is managed, integrated, and used to drive meaningful social change. In this hands-on, strategic role, you’ll design and develop modern data pipelines using SQL , Python , and Azure/Fabric , while also guiding the wider organisation through their data transformation journey. You’ll be … the link between technology and the business, understanding needs, building solutions, and championing data-driven decision-making across teams. They’re looking for a self-starter who can bring both technical expertise and strong stakeholder skills, someone who’s confident leading conversations, defining standards, and making data accessible to everyone. You’ll play a central role More ❯

Senior Data Engineer - AWS - London - £70,000 - £85,000 To be considered for this role, you must be SC cleared or eligible to obtain SC clearance. My client are seeking a Senior AWS Data Engineer to join an agile engineering team with the focus of delivering cloud-based data solutions for clients in the … days in London office) 25 days annual leave plus bank holidays Performance-related bonus Private medical care And many more Role and Responsibilities Develop and maintain AWS-based data pipelines using Python, PySpark, Spark SQL, AWS Glue, Step Functions, Lambda, EMR, and Redshift. Design, implement, and optimise data architecture for scalability, performance, and security. Work closely … stakeholders to understand requirements and translate them into robust solutions. Apply best practices for cloud security, governance, and cost management. Implement and maintain CI/CD pipelines for data engineering workflows within AWS. Document and maintain architecture, pipelines, and best practices for long-term maintainability. Contribute to planning, progress reporting, and delivery of project milestones. Engage in client More ❯

Senior Data Engineer - AWS - London - £70,000 - £85,000 To be considered for this role, you must be SC cleared or eligible to obtain SC clearance. My client are seeking a Senior AWS Data Engineer to join an agile engineering team with the focus of delivering cloud-based data solutions for clients in the … days in London office) 25 days annual leave plus bank holidays Performance-related bonus Private medical care And many more Role and Responsibilities Develop and maintain AWS-based data pipelines using Python, PySpark, Spark SQL, AWS Glue, Step Functions, Lambda, EMR, and Redshift. Design, implement, and optimise data architecture for scalability, performance, and security. Work closely … stakeholders to understand requirements and translate them into robust solutions. Apply best practices for cloud security, governance, and cost management. Implement and maintain CI/CD pipelines for data engineering workflows within AWS. Document and maintain architecture, pipelines, and best practices for long-term maintainability. Contribute to planning, progress reporting, and delivery of project milestones. Engage in client More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

Senior Data Engineers with a background are required by this major client, as they continue to expand their engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

to hear from motivated people who can help us deliver our commitments to our business, our customers, and our people. Within AXA Retail we're looking for a Data Exploration and Innovation Manager. You'll lead initiatives that leverage internal data assets and innovative techniques to develop features and insights that enhance pricing models and strategic … decision-making. You'll explore, experimenting with, and optimise internal data to generate high-value features that improve model performance and business outcomes. At AXA we work smart, empowering our people to balance their time between home and the office in a way that works best for them, their team and our customers. You'll work at least … also happy to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Identify and develop innovative features and insights from internal data sources to enhance business value. Lead the end-to-end design, testing, and deployment of new data-driven features. Collaborate with data engineering teams to More ❯

Experience interacting with databases, both SQL (e.g., PostgreSQL, SQL Server) and NoSQL (e.g., MongoDB, DynamoDB) varieties Familiarity with event streaming (e.g., Apache Kafka) for building scalable, real-time data pipelines Preferred Qualifications: Healthcare Experience: Familiarity with healthcare industry standards (e.g., HIPAA, FHIR) and building secure, compliant applications Advanced GraphQL: Experience with Apollo Server, Federation, or optimizing GraphQL performance More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

Data Engineer Join a fast-growing e-commerce technology company as a Data Engineer dealing with real-time data. The team is small, highly technical, and product-driven, building the entire platform in-house for maximum flexibility and efficiency. You’ll be joining a company where engineers are trusted to make decisions, own their work, and … directly influence the product roadmap. The Role My client is looking for a Data Engineer who enjoys working close to both data and backend systems. You’ll design and build pipelines that process real-time browser events, support backend product features, and play a key role in how the company scales its prediction capabilities. This is … a hands-on role with significant autonomy and impact, ideal for someone who thrives in a lean, collaborative, and fast-moving environment. Key Responsibilities Build and maintain data pipelines from event capture through to storage and analytics layers. Support backend feature development that depends on data flows and insights. Work closely with engineers across data More ❯

Data Engineer Join a fast-growing e-commerce technology company as a Data Engineer dealing with real-time data. The team is small, highly technical, and product-driven, building the entire platform in-house for maximum flexibility and efficiency. You'll be joining a company where engineers are trusted to make decisions, own their work, and … directly influence the product roadmap. The Role My client is looking for a Data Engineer who enjoys working close to both data and backend systems. You'll design and build pipelines that process real-time browser events, support backend product features, and play a key role in how the company scales its prediction capabilities. This is … a hands-on role with significant autonomy and impact, ideal for someone who thrives in a lean, collaborative, and fast-moving environment. Key Responsibilities Build and maintain data pipelines from event capture through to storage and analytics layers. Support backend feature development that depends on data flows and insights. Work closely with engineers across data More ❯

and cloud-native platforms (specifically Microsoft Azure, leveraging services like Azure AI Studio/Foundry, Azure OpenAI, Databricks). Collaborate with C-suite executives, Directors, Business & technology stakeholders, data scientists, and engineering teams to ensure that AI initiatives are scalable, secure, ethically sound, and aligned with Ecolab's core business of water, hygiene, and infection prevention solutions. Key … multi-agent systems, integrating them with core enterprise systems like SAP, Salesforce, and the ECOLAB3D™ platform. Define and enforce architectural standards and governance frameworks for the agent lifecycle, data lineage, observability, and interoperability. Technology Evaluation and Selection: Evaluate and select AI platforms, tools, and protocols, such as LangChain, AutoGen, or similar frameworks, ensuring they meet scalability, security, and … and operations teams through the deployment, integration, and testing of AI solutions. Champion best practices in AIOps, LLMOps, and agile methodologies to ensure smooth delivery and production deployment. Data and Integration: Ensure data readiness for AI initiatives, collaborating with data engineers to design robust data pipelines (leveraging tools like Databricks) that provide More ❯

Connections Policy Data Scientist/Analyst (Contractor) Location: Warwick (Hybrid - 1 day/week onsite) Contract: 6 Months (with potential for extension) Rate: £500/day via umbrella company We're looking for a skilled Data Scientist/Analyst to support policy and reform initiatives within the Connections directorate. You'll be at the heart of … modelling, forecasting, and analytics that shape strategic decisions and regulatory engagement. Working closely with the Data & Systems Lead and Reporting & Insights Lead, you'll build reproducible pipelines, run simulations, and deliver insights that influence real-world outcomes. This is a hands-on role ideal for a contractor who can onboard quickly and deliver value from week one. Key … lead times, capacity release). Run scenario and sensitivity modelling to support strategic decision-making. Design experiments to estimate the impact of policy/process changes. Engineer robust data pipelines using SQL/Python on Azure. Co-create dashboards and curated datasets in Power BI. Produce clear, concise decision papers for internal and external stakeholders. Improve data More ❯

Data Engineer - Ms Dynamics 365, Azure Data Factory, SQL, SSIS We have an exciting new permanent opportunity for a dynamic Data Engineer to join a fantastic & growing team at the best timing possible as the business has just embarked on a data transformation journey. This role will give you the chance to … showcase your expertise to help shape data integration methodologies, processes, and standards, driving adoption and best practices across the team. You’ll be working closely with Data Architects, Developers and business stakeholders and will be involved in some exciting projects as well as BAU activities like building and maintaining efficient data pipelines between Dynamics … CRM , Azure SQL databases, SharePoint, and analytical platforms using tools such as SSIS, Azure Data Factory , and KingswaySoft. We’re looking for someone with good experience of Microsoft Dynamics 365 CRM data structures and architecture and experience orchestrating data pipelines using Azure Data Factory. Hands-on experience with SQL Server Integration Services More ❯