351 to 375 of 1,061 Data Pipeline Jobs in England

Data Engineer (Azure & Databricks) Location: London (Hybrid - 2 days in office) Salary: £65,000 + Benefits Level: Mid-Level About the Role: We're looking for a talented Data Engineer to join a leading consultancy and work on cutting-edge data solutions for global clients. You'll design and build scalable data pipelines using Azure and Databricks, ensuring high-quality, reliable data delivery for advanced analytics and AI initiatives. Key Responsibilities: Develop and optimize data pipelines on Azure and Databricks Collaborate with data scientists and analysts to deliver actionable insights Implement best practices for data governance and security Work in a hybrid … setup (2 days per week in our London office) What We're Looking For: Strong experience with Azure Data Services (Data Factory, Synapse, etc.) Hands-on expertise with Databricks and Python Solid understanding of ETL processes and data modelling Excellent problem-solving and communication skills Benefits: Work on high-impact projects with top-tier More ❯

cutting-edge analytics solutions that make a real impact. This role combines hands-on technical expertise with strategic thinking. Enabling clients to unlock insights and value from their data using Microsoft’s latest analytics stack. As an expert in Power BI and Microsoft Fabric, you’ll architect scalable, modern data solutions that unlock real business value … and guide delivery teams through implementation. With your deep knowledge in Power BI, Microsoft Fabric, and Azure data services, and your passion for innovation, technical expertise with strategic thinking to support data-driven transformation. Here, you’ll partner with stakeholders, guide delivery teams, and help clients harness the full potential of Microsoft’s newest analytics ecosystem. … Key Responsibilities: Lead the design and architecture of end-to-end analytics solutions using Power BI and Microsoft Fabric Translate business requirements into scalable data models, lakehouse architectures, and reporting frameworks Develop and optimize Power BI reports, dashboards, and semantic models using DAX and Power Query Implement Fabric components including Data Factory, Lakehouse, Dataflows Gen2, and More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data Engineer | AI Startup | Real-Time Data & ML Pipelines I’m currently partnered with a next-generation AI startup that’s building real-time intelligence systems capable of understanding and adapting to the world as it happens. They’re at the forefront of streaming data, continuous learning, and large-scale inference - and they’re … now looking for a Data Engineer to help power that mission. This isn’t a maintenance role. It’s a build-it-from-the-ground-up opportunity in a company that’s solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure . ⚙️ The Opportunity The team is looking for a Data Engineer who can design and scale real-time data architectures and machine learning pipelines that drive continuous model training and experimentation. You’ll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect More ❯

Data Engineer | AI Startup | Real-Time Data & ML Pipelines I’m currently partnered with a next-generation AI startup that’s building real-time intelligence systems capable of understanding and adapting to the world as it happens. They’re at the forefront of streaming data, continuous learning, and large-scale inference - and they’re … now looking for a Data Engineer to help power that mission. This isn’t a maintenance role. It’s a build-it-from-the-ground-up opportunity in a company that’s solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure . ⚙️ The Opportunity The team is looking for a Data Engineer who can design and scale real-time data architectures and machine learning pipelines that drive continuous model training and experimentation. You’ll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect More ❯

Lead Data Engineer – Manchester – £70,000–£75,000 + Bonus Hybrid – 2–3 days per week in the office We’re representing an award-winning, tech-driven organisation in the travel industry that’s scaling its data capability to support rapid growth and digital transformation. They’re seeking a Lead Data Engineer to guide … a small, dynamic team and help shape the future of their cloud-based data platform. This is a fantastic opportunity for a technically strong engineer with a collaborative mindset, someone who can translate complex data challenges into clear business outcomes. You’ll be joining a company where data sits at the heart of decision … making and innovation, working alongside passionate professionals in an ambitious, people-focused culture. The Role Lead, mentor, and develop a small team of two Data Engineers. Design, build, and optimise data pipelines and integrations (using dbt, Airbyte , OpenFlow , APIs , and Python ) to deliver reliable and scalable data. Support the development of a new cloud-based data More ❯

At Synthesis we push the boundaries of what’s possible with Open Data. It’s a fast-paced, rapidly-changing environment at the intersection of data science, cultural analysis & brand consultancy. As a Senior Data Scientist at Synthesis, you will play a key role in shaping our data science practice and driving innovation across … both client projects and internal products. You will lead end-to-end data projects, from shaping datasets and building models to designing scalable data workflows that power the insights and decision frameworks we deliver. You will work with diverse open data sources, ranging from search, social and e-commerce, to academic papers and patents … to understand audience behaviour and anticipate how needs will evolve over time. In this role, you will not only contribute hands-on but also guide junior data scientists, act as a thought partner to cultural strategists, and help define the roadmap for our data products and infrastructure. We are a small, collaborative team with diverse backgrounds More ❯

At Synthesis we push the boundaries of what’s possible with Open Data. It’s a fast-paced, rapidly-changing environment at the intersection of data science, cultural analysis & brand consultancy. As a Senior Data Scientist at Synthesis, you will play a key role in shaping our data science practice and driving innovation across … both client projects and internal products. You will lead end-to-end data projects, from shaping datasets and building models to designing scalable data workflows that power the insights and decision frameworks we deliver. You will work with diverse open data sources, ranging from search, social and e-commerce, to academic papers and patents … to understand audience behaviour and anticipate how needs will evolve over time. In this role, you will not only contribute hands-on but also guide junior data scientists, act as a thought partner to cultural strategists, and help define the roadmap for our data products and infrastructure. We are a small, collaborative team with diverse backgrounds More ❯

Data Engineer - 12 Month FTC Up to £75,000 * London or Birmingham * Hybrid A leading UK-wide property business is seeking a Data Engineer to join their growing analytics and digital function on a 12-month fixed-term contract. The Role In this role you'll take ownership of the organisation's data warehouse … ensuring reliable data flows, resolving issues, and recommending improvements across the wider data ecosystem. You'll work closely with digital, product, and analytics teams to support ongoing business operations while contributing ideas to shape the future-state data platform. This is a great opportunity for a hands-on Data Engineer who enjoys … both maintenance and innovation, and who thrives in customer-focussed, commercially minded environments. Key Responsibilities Manage and maintain the central data warehouse and associated pipelines. Ensure data quality and availability across customer, sales, and operational datasets. Support the onboarding and ingestion of third-party vendor data (e.g. Google Analytics). Troubleshoot and resolve data More ❯

This role represents an exciting opportunity for a high-performing Data Engineer to help shape and strengthen the organisation’s data engineering and analytics capability within its AWS-based environment. We’re ideally looking for someone with strong hands-on experience across AWS services, Airflow, Python, and SQL. You’ll play a key role in designing … building, and maintaining modern data infrastructure that powers insight-led decision-making across the business. Working within a small, supportive team, you’ll collaborate with analysts, data scientists, and key stakeholders to deliver practical, scalable solutions that make a real impact. Key Responsibilities Design, build, and maintain robust, scalable ETL/ELT pipelines using tools such … as Airflow and AWS services (S3, Redshift, Glue, Lambda, Athena). Integrate new data sources and continuously optimise performance and cost efficiency. Ensure data quality, integrity, and security across all systems. Maintain clear documentation for data processes and pipelines. Partner with analysts, data scientists, and product teams to translate requirements into reliable More ❯

for use within PowerBI or reporting. Maintenance of Power BI, SQL and related reporting systems, helping to ensure a useful and reliable reporting function for the business. Developing data pipelines from Microsoft Fabric and integration products to exploit and maximise a range of data systems. Understanding and interpreting user specifications and requirements gathering, user interviews, running … workshops, prototyping etc. and then document requirements in a format that is intelligible to both business partners and IT colleagues Carefully testing and accuracy checking data lists and aggregations Engaging with existing and prospective users to understand and document their information needs predicated on an understanding of both business processes and the business decisions that users need to … make Provide support to BI projects to enable them to meet their deadlines Working with DDaT colleagues to understand and document available data sources and their interrelation Collaborating with other team members to design solutions and to develop strong governance and control processes Working with quality assurance to ensure that business requirements are met Responsible for partnering with More ❯

to continuing to develop a positive, open and honest working environment for all. We an exciting new opportunity available for a skilled Security Tester with strong experience in data security, privacy, and integrity testing. This role involves identifying vulnerabilities in systems, applications, and data pipelines, and ensuring that sensitive data is protected against unauthorised … access, leakage, and corruption. The successful candidate will have a solid understanding of both offensive and defensive security techniques, as well as hands-on experience with data governance and compliance frameworks. If you have strong experience in automation testing and tools used to mature the wider QA framework, then we would be keen to hear from you What … health & beauty purchases 25% Discount on Pharmacy2U Private Online Doctor Services What you'll be doing? Conduct penetration testing, vulnerability assessments, and security audits across applications, networks, and data environments. Test and validate data encryption, access controls, and data masking mechanisms. Collaborate with data engineering and analytics teams to ensure secure data More ❯

Asset Management business areas to help integrate AI into their processes. This role requires you to be a strategic thinker with a strong understanding of product management and data science, who can work collaboratively with cross-functional teams, manage multiple stakeholders, and effectively prioritize a backlog with competing priorities to support the achievement of multi-year AI objectives. … Job responsibilities: Work collaboratively with cross-functional teams (e.g. technologists/engineers, product owners, data scientists/quants, business stakeholders) to ensure the successful development and implementation of an Asset Management AI capabilities Manage multiple stakeholders, ensuring their needs are addressed, expectations are managed, and inputs are incorporated into the development of AI capabilities Create and maintain a … stories and acceptance criteria for Agile development teams) Experience in systems design for data-centric applications (e.g., prioritized and defined requirements for a scalable data pipeline for real-time analytics) Knowledge of data architectures and cloud technologies (e.g., set product vision for implementing a data lake on AWS for centralized data More ❯

Role Overview: BW: Workplace Experts, a leading fit-out construction company based in Central London, is seeking a Data & Analytics Engineer to continue our journey towards leading the construction industry with data driven intelligent decisions. You will own the architecture, governance, and optimisation of BW’s Microsoft Fabric environment, design and deliver enterprise grade Power BI … dashboards, and play a pivotal role in developing the future of data across the business. This is a hands on, high impact position suited to someone ready to lead technical direction, mentor others, and help shape a modern, data driven culture. Key Responsibilities: Architect, maintain, and optimise BW’s Microsoft Fabric ecosystem, ensuring scalable, efficient data workflows across the business. Design and deliver insightful, interactive Power BI dashboards and analytical models to drive decision-making. Translate complex business requirements into reliable, well-documented data structures and reporting frameworks. Implement data governance and quality controls, ensuring accuracy, consistency, and compliance across all systems. Partner with IT, operations, and commercial teams to drive More ❯

Role Overview: BW: Workplace Experts, a leading fit-out construction company based in Central London, is seeking a Data & Analytics Engineer to continue our journey towards leading the construction industry with data driven intelligent decisions. You will own the architecture, governance, and optimisation of BW’s Microsoft Fabric environment, design and deliver enterprise grade Power BI … dashboards, and play a pivotal role in developing the future of data across the business. This is a hands on, high impact position suited to someone ready to lead technical direction, mentor others, and help shape a modern, data driven culture. Key Responsibilities: Architect, maintain, and optimise BW’s Microsoft Fabric ecosystem, ensuring scalable, efficient data workflows across the business. Design and deliver insightful, interactive Power BI dashboards and analytical models to drive decision-making. Translate complex business requirements into reliable, well-documented data structures and reporting frameworks. Implement data governance and quality controls, ensuring accuracy, consistency, and compliance across all systems. Partner with IT, operations, and commercial teams to drive More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy … leveraging Azure and Databricks to deliver scalable, high-performance solutions that empower analytics and decision-making across the business. What You’ll Do Own the data strategy : Shape and evolve a modern hybrid data platform to meet current and future business needs. Architect and optimize : Design robust data pipelines for large-scale ingestion, transformation … and delivery across diverse sources. Champion best practices : Ensure orchestration, monitoring, and governance standards for reliable, secure data flows. Drive innovation : Implement smart storage, compute allocation, and caching techniques for performance and cost efficiency. Lead and inspire : Manage and mentor a team of data engineers and BI developers, fostering collaboration and technical excellence. Deliver insights : Oversee More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy … leveraging Azure and Databricks to deliver scalable, high-performance solutions that empower analytics and decision-making across the business. What You’ll Do Own the data strategy : Shape and evolve a modern hybrid data platform to meet current and future business needs. Architect and optimize : Design robust data pipelines for large-scale ingestion, transformation … and delivery across diverse sources. Champion best practices : Ensure orchestration, monitoring, and governance standards for reliable, secure data flows. Drive innovation : Implement smart storage, compute allocation, and caching techniques for performance and cost efficiency. Lead and inspire : Manage and mentor a team of data engineers and BI developers, fostering collaboration and technical excellence. Deliver insights : Oversee More ❯

We are looking for a Data Systems Lead with strong experience in Starburst and Snowflake to drive the architecture, implementation, and optimization of our enterprise data platforms. This role will lead data engineering initiatives, ensure scalable data solutions, and collaborate with business and technical teams to support analytics and decision-making. Full … time role with Ascendion 3 days onsite - Bromley Key Responsibilities Design and implement modern data architectures using Starburst and Snowflake . Build and optimize data pipelines, models, and ingestion frameworks. Lead and mentor data engineering team members. Ensure data governance, security, lineage, and performance best practices. Collaborate with cross-functional teams to … deliver reliable data solutions. Optimize cloud resources and maintain platform reliability. Qualifications 5+ years in data engineering or data platform roles. Hands-on experience with Starburst (Presto/Trino) and Snowflake . Strong SQL, data modeling, and Python skills. More ❯

Data Engineer (Microsoft Fabric) Please note this role is Fully remote based. We're partnering with a leading organisation that’s driving innovation through modern data engineering practices, and they’re looking for a Fabric Data Engineer to join their growing team. In this role, you'll work at the forefront of Microsoft Fabric … helping to build robust, scalable data solutions. Responsibilities Delivering high-quality data engineering solutions within the Microsoft Fabric ecosystem. Writing advanced SQL and optimising complex queries. Building and orchestrating data pipelines across modern cloud platforms. Applying expert knowledge of data integration tools and methods. Designing ELT/ETL workflows using medallion architecture … and lakehouse principles. Developing and maintaining data warehouses and data marts. Skills Needed 2+ years’ experience in data engineering, with at least 1 year on Microsoft cloud technologies. Strong hands-on experience with Microsoft Fabric, especially around data engineering and warehousing workflows. Familiarity with Azure DevOps for CI/CD and deployment. More ❯

Title: SQL Data Engineer Salary: Up to £60,000 + 15% Bonus Location: Hybrid – Rugby (3 days per month onsite) We’re working with a market-leading organisation in the construction and infrastructure sector seeking a skilled SQL Data Engineer to take ownership of their data systems and drive performance across SQL Server and … Azure SQL environments. You’ll play a key role in designing, tuning, and optimising SQL databases, ensuring that data flows efficiently across the business. This is a hands-on role for someone who loves solving performance challenges and making data work smarter. What You’ll Do Design, maintain, and optimise SQL Server and Azure SQL databases … Create and tune indexes, improve data flow and performance Build and manage efficient data pipelines and integrations Collaborate with analysts and architects to deliver reliable data solutions Ensure data governance, security, and compliance What You’ll Bring Deep technical knowledge of SQL Server & Azure SQL Strong experience with indexing, performance tuning, and More ❯

Data Engineer Opportunity for a Data Engineer to join a market leading entertainment brand in Greater Manchester Salary up to £60,000 + fantastic benefits including our Inclusive working culture, Generous holiday allowance, Hybrid working and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? In this role, you’ll … be building and maintaining the data systems that power our reporting and analytics across the business. You’ll develop reliable data pipelines in Databricks, bringing together real-time and batch data from multiple sources on AWS. Working closely with teams across Finance, Marketing, and Compliance, you’ll make sure our data is … accurate, accessible, and ready for decision-making. You’ll also play a key part in improving performance, automation, and governance across our modern cloud-based data platform. OUR BENEFITS: Hybrid Working Generous holiday allowance Pension Annual Bonus Life Insurance Training & Development Opportunities Enhanced Maternity & Paternity Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER More ❯

respected, technology-centric investment business operating across a broad range of asset classes. Their success is built on a mix of quantitative research, cutting-edge engineering and scalable data infrastructure. Engineers here play a central role: they design, build and maintain the platforms that underpin research, trading and large-scale data analysis. It’s a collaborative … cloud-native tooling, containerisation, large-scale data lake technologies. Partner closely with exceptional quantitative researchers, data engineers and traders. Influence architectural decisions and continuously refine pipeline performance. Join a culture that values rigour, curiosity and continual improvement. Benefit from strong compensation and long-term career growth within a high-performing engineering organisation. Role Overview Design … trading and quant teams to translate data requirements into robust, production-grade pipelines. Implement monitoring, validation, and automated error-handling to ensure data integrity and pipeline reliability. Continuously profile and optimise pipeline throughput, latency, and resource utilisation, particularly in latency-sensitive or HFT-like environments. Maintain clear, precise documentation of data pipelines More ❯

respected, technology-centric investment business operating across a broad range of asset classes. Their success is built on a mix of quantitative research, cutting-edge engineering and scalable data infrastructure. Engineers here play a central role: they design, build and maintain the platforms that underpin research, trading and large-scale data analysis. It’s a collaborative … cloud-native tooling, containerisation, large-scale data lake technologies. Partner closely with exceptional quantitative researchers, data engineers and traders. Influence architectural decisions and continuously refine pipeline performance. Join a culture that values rigour, curiosity and continual improvement. Benefit from strong compensation and long-term career growth within a high-performing engineering organisation. Role Overview Design … trading and quant teams to translate data requirements into robust, production-grade pipelines. Implement monitoring, validation, and automated error-handling to ensure data integrity and pipeline reliability. Continuously profile and optimise pipeline throughput, latency, and resource utilisation, particularly in latency-sensitive or HFT-like environments. Maintain clear, precise documentation of data pipelines More ❯

Data Engineer We are looking for a Senior Data Engineer to design, build, and scale the data infrastructure that powers products and decision-making. This role is central to how data flows across the organization—from ingestion and processing to analytics and insights. You’ll work closely with developers, analysts, and trading … teams to ensure data is reliable, accessible, and built for the future. This role combines hands-on engineering with strategic thinking . You’ll contribute to architecture discussions, improve data pipelines, and help shape technical direction. We’re seeking someone who takes ownership, enjoys tackling complex problems, and can deliver impactful solutions across multiple systems and … teams. Responsibilities Design, build, and maintain robust data pipelines for analytics, reporting, and product use cases. Contribute to long-term technical roadmap and participate in architecture discussions. Build and optimize ETL/ELT processes for small- to large-scale data processing. Develop clear, well-structured data models and maintain documentation to support analytics and More ❯