26 to 50 of 987 Data Pipeline Jobs in England

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

COSTAR GROUP - SENIOR DATA ENGINEER ONTHEMARKET TECHNOLOGY - LONDON OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the worlds real estate, empowering all people to discover properties … content, imagery, design and functionality. The OnTheMarket product will support home buyers, sellers, and agents better than ever! Learn more about OnTheMarket . ROLE DESCRIPTION The role ofSenior Data Engineerwill be a key role within the OTM Data team, reporting to the Head of Data and working closely with the CTO. The Data team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data support for OnTheMarket. This role will provide focus on delivering value to our customers, by leveraging data to improve the OTM users and agents experience. This role would More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. We enable #HumanFirstDigital Job Title: Data Solution Architect (Azure) Location: London, UK The Role We are looking for an experienced Data Solution Architect with deep expertise in Microsoft Azure data services … techniques and Azure monitoring tools (e.g., Log Analytics, Azure Monitor). Understanding of DevOps and CI/CD practices using Azure DevOps or GitHub Actions for data pipeline deployment. Excellent communication and stakeholder management skills, capable of articulating technical concepts to non-technical audiences. Strong analytical mindset with proven problem-solving ability. Experience working in agile delivery More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. We enable #HumanFirstDigital Job Title: Data Solution Architect (Azure) Location: London, UK The Role We are looking for an experienced Data Solution Architect with deep expertise in Microsoft Azure data services … techniques and Azure monitoring tools (e.g., Log Analytics, Azure Monitor). Understanding of DevOps and CI/CD practices using Azure DevOps or GitHub Actions for data pipeline deployment. Excellent communication and stakeholder management skills, capable of articulating technical concepts to non-technical audiences. Strong analytical mindset with proven problem-solving ability. Experience working in agile delivery More ❯

Data Analyst - Higher Education - 6 Month Contract - £700 Per Day A leading organisation within the education sector is seeking an experienced Data Analyst to support a significant data architecture and migration programme. The role sits within a dedicated Data Architecture and Migration workstream and will play an important part in transitioning from … legacy student record systems to a modern SaaS platform. The successful candidate will analyse, validate, and reconcile data across multiple environments to ensure integrity, consistency, and continuity of reporting throughout the migration process. This is an excellent opportunity to contribute to a transformative project that will shape future data capabilities within the institution. Key Responsibilities Data … technical stakeholders. Understanding of data quality principles and data governance frameworks within an education setting. Desirable Skills & Experience Familiarity with ETL or data pipeline tools (e.g., Pentaho, MuleSoft, dbt Labs). Knowledge of data warehousing and reporting best practices. Understanding of data modelling and metadata management. Awareness of GDPR More ❯

Data Analyst - Higher Education - 6 Month Contract - £700 Per Day A leading organisation within the education sector is seeking an experienced Data Analyst to support a significant data architecture and migration programme. The role sits within a dedicated Data Architecture and Migration workstream and will play an important part in transitioning from … legacy student record systems to a modern SaaS platform. The successful candidate will analyse, validate, and reconcile data across multiple environments to ensure integrity, consistency, and continuity of reporting throughout the migration process. This is an excellent opportunity to contribute to a transformative project that will shape future data capabilities within the institution. Key Responsibilities Data … technical stakeholders. Understanding of data quality principles and data governance frameworks within an education setting. Desirable Skills & Experience Familiarity with ETL or data pipeline tools (e.g., Pentaho, MuleSoft, dbt Labs). Knowledge of data warehousing and reporting best practices. Understanding of data modelling and metadata management. Awareness of GDPR More ❯

your role and own the results Be relevant - Relevant to our people, our partners and the planet Job Description To support the design, development, and maintenance of our data infrastructure. The role involves ensuring the efficient, reliable, and secure collection, storage, and processing of data, which is critical for enabling data-driven decision-making … solutions, optimise data pipelines, and contribute to the overall data strategy, ensuring data integrity, security, and accessibility across FGFS. Data Pipeline Development: Engage in the design, build, and maintenance of scalable and efficient data pipelines for extracting, transforming, and loading data from multiple sources. Troubleshooting and … Support: Diagnose and resolve data-related issues within the platform, providing support and maintenance to data systems and wider teams. Collaboration: Work closely with the data team, spoke analysts, and other key stakeholders to understand data requirements and deliver strategic and operational solutions that meet business needs. Compliance and Security: Ensure compliance More ❯

your role and own the results Be relevant - Relevant to our people, our partners and the planet Job Description To support the design, development, and maintenance of our data infrastructure. The role involves ensuring the efficient, reliable, and secure collection, storage, and processing of data, which is critical for enabling data-driven decision-making … solutions, optimise data pipelines, and contribute to the overall data strategy, ensuring data integrity, security, and accessibility across FGFS. Data Pipeline Development: Engage in the design, build, and maintenance of scalable and efficient data pipelines for extracting, transforming, and loading data from multiple sources. Troubleshooting and … Support: Diagnose and resolve data-related issues within the platform, providing support and maintenance to data systems and wider teams. Collaboration: Work closely with the data team, spoke analysts, and other key stakeholders to understand data requirements and deliver strategic and operational solutions that meet business needs. Compliance and Security: Ensure compliance More ❯

your role and own the results Be relevant - Relevant to our people, our partners and the planet Job Description To support the design, development, and maintenance of our data infrastructure. The role involves ensuring the efficient, reliable, and secure collection, storage, and processing of data, which is critical for enabling data-driven decision-making … solutions, optimise data pipelines, and contribute to the overall data strategy, ensuring data integrity, security, and accessibility across FGFS. Data Pipeline Development: Engage in the design, build, and maintenance of scalable and efficient data pipelines for extracting, transforming, and loading data from multiple sources. Troubleshooting and … Support: Diagnose and resolve data-related issues within the platform, providing support and maintenance to data systems and wider teams. Collaboration: Work closely with the data team, spoke analysts, and other key stakeholders to understand data requirements and deliver strategic and operational solutions that meet business needs. Compliance and Security: Ensure compliance More ❯

and Artifical Intelligence - UK We are seeking a highly capable and strategic VP Digital Insights and Artificial Intelligence to lead on own the strategy, implementation, and governance of data, analytics and AI platform architecture across the organization. This newly created role is responsible for shaping the company's approach to information management, enterprise data management, which … includes data governance, data quality and data management; analytics, predictive analytics, and AI - while also ensuring the design, delivery, and continuous improvement of the underlying technology platforms that enable these capabilities. This leader will partner with business stakeholders, IT, and data science teams to identify high-value opportunities, deliver innovative and responsible … following tasks: Leadership Define and lead the enterprise-wide Digital Insights & AI Platform Strategy, ensuring alignment with business priorities and long-term technology roadmaps Establish governance frameworks for data, analytics, and AI to ensure quality, security, and ethical use Drive adoption of AI, automation, and analytics solutions across business functions to maximize ROI and efficiency Information and Data More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Engineer, Data Engineer, Data Platform Engineer, Data Architect, Data Infrastructure Engineer, Cloud Data Engineer, DataOps Engineer, Data Pipeline Engineer, Devops Engineer or in a similar role. Proven experience with Azure cloud platforms and related architecture. Highly skilled in Python for data engineering, scripting, and automation. More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Engineer, Data Engineer, Data Platform Engineer, Data Architect, Data Infrastructure Engineer, Cloud Data Engineer, DataOps Engineer, Data Pipeline Engineer, Devops Engineer or in a similar role. Proven experience with Azure cloud platforms and related architecture. Highly skilled in Python for data engineering, scripting, and automation. More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Engineer, Data Engineer, Data Platform Engineer, Data Architect, Data Infrastructure Engineer, Cloud Data Engineer, DataOps Engineer, Data Pipeline Engineer, Devops Engineer or in a similar role. Proven experience with Azure cloud platforms and related architecture. Highly skilled in Python for data engineering, scripting, and automation. More ❯

We’re looking for an innovative Data Architect to lead the creation and rollout of a comprehensive Data Governance Strategy, alongside the implementation of a data platform. This role will be instrumental in ensuring organizational data is accurate, secure, compliant, and strategically utilized to unlock business value. This is a new role … created due to growth, offering an exciting opportunity to shape and lead our data governance and platform strategy from the ground up. Key responsibilities Design and implement a comprehensive data governance framework. Define and maintain data governance policies, standards, and procedures. Establish and lead a cross-functional Data Governance Council. Collaborate with … data owners, stewards, and custodians across departments to ensure alignment and accountability. Develop and enforce data quality standards, metrics, and monitoring processes. Ensure compliance with data protection regulations such as GDPR, CCPA, and other relevant standards. Evaluate, select, and implement data governance tools (e.g. data catalogues, data quality More ❯

plans at any time. The Opportunity This position will play a critical role in supporting the Production Finance team and key cross-functional partners across a range of data-related projects. The ideal candidate thrives in a fast-paced, collaborative environment, has strong data skills, and is passionate about innovation. Responsibilities include delivering rapid, high-profile … analyses using show-level data to support Public Relations & Government Relations teams in EMEA and globally, as well as providing guidance and support to non-technical stakeholders. The position involves quick-turnaround analysis, occasional longer-term strategic projects, and will dual-report to the Production Finance team in the UK and the Production Finance Operations & Innovation team in … Los Angeles. Responsibilities Data Extraction & Transformation: Extract, clean, and transform data from core systems such as the Global Spend Report (GSR) data model, Payroll Accounting Systems (PAS), and the Netflix Production Finance HUB. Aggregate and correlate data to accurately report on job counts, vendor spend, and location spend across multiple EMEA markets. More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and … establishing scalable, efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical … at least one of the programming languages like Python, C++[2] , Java ● Experience with version control and code review tools such as Git ● Knowledge of latest data pipeline orchestration tools such as Airflow ● Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools (e.g., Docker, Terraform, CloudFormation). ● Familiarity with data quality More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and … establishing scalable, efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical … at least one of the programming languages like Python, C++[2] , Java ● Experience with version control and code review tools such as Git ● Knowledge of latest data pipeline orchestration tools such as Airflow ● Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools (e.g., Docker, Terraform, CloudFormation). ● Familiarity with data quality More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so we can provide the More ❯

The Data Analyst will play a key role within the Data Architecture and Migration workstream, supporting the migration from legacy systems (predominantly SITS) to Banner SaaS. The postholder will explore, analyse, and validate data across multiple environments, helping to ensure accuracy and consistency during and after migration. They will also support ongoing analytical needs … and contribute to ensuring continuity of reporting in the new system landscape. Key Responsibilities Data Analysis and Validation Query, explore, and reconcile data in the data migration environment and production systems using SQL and other tools (e.g. Power BI, Python, Excel, Banner Insights). Investigate and visualise data quality issues to present … with experience liaising between technical and business teams. Understanding of data quality principles and governance frameworks. Desirable Skills and Experience Familiarity with ETL or data pipeline concepts and tools (e.g. Pentaho, MuleSoft, dbt Labs). Knowledge of data warehousing and reporting best practices. Understanding of data modelling and metadata management. Awareness More ❯

The Data Analyst will play a key role within the Data Architecture and Migration workstream, supporting the migration from legacy systems (predominantly SITS) to Banner SaaS. The postholder will explore, analyse, and validate data across multiple environments, helping to ensure accuracy and consistency during and after migration. They will also support ongoing analytical needs … and contribute to ensuring continuity of reporting in the new system landscape. Key Responsibilities Data Analysis and Validation Query, explore, and reconcile data in the data migration environment and production systems using SQL and other tools (e.g. Power BI, Python, Excel, Banner Insights). Investigate and visualise data quality issues to present … with experience liaising between technical and business teams. Understanding of data quality principles and governance frameworks. Desirable Skills and Experience Familiarity with ETL or data pipeline concepts and tools (e.g. Pentaho, MuleSoft, dbt Labs). Knowledge of data warehousing and reporting best practices. Understanding of data modelling and metadata management. Awareness More ❯

Data Engineer Salary: Competitive plus excellent benefits Location: Remote Start: ASAP Skills required: Ideally 3 years experience as a Data Engineer, AWS, a keen interest in AI & ML Who we are: Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to … working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service What are we looking for? We are an ambitious, customer-centric Data & Insights … team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale More ❯

Data Engineer – SC Cleared - AWS Our client is establishing a new Data Team and requires a Data Engineer to design and implement the foundational data infrastructure. Current data is dispersed across multiple systems with inconsistent structures and limited automation. You will play a key role in creating scalable, secure data … that enable reliable ingestion, transformation, and delivery across the organisation.Due to the nature of the work, active SC clearance is required. Key Responsibilities Design, build, and maintain scalable data pipelines across AWS and Azure environments to ingest, transform, and store data from multiple sources. Develop and manage data models, schemas, and metadata to support … monitoring, alerting, and automated checks. Optimise data workflows for performance, cost-efficiency, and maintainability , using platforms such as Azure Data Factory, AWS Data Pipeline, Glue, Lambda, Databricks, and Apache Spark. Support the integration of transformed data into visualisation and analytical platforms , including Power BI, ServiceNow, and Amazon QuickSight. Ensure compliance with More ❯

algorithms. Lead the selection, validation, and optimization of models to discover meaningful patterns and insights, ensuring models remain relevant, reliable, and scalable. Drive continuous integration and deployment of data science solutions, optimizing performance through advanced machine learning techniques, code reviews, and best practices. 'Develop and deliver sophisticated visualizations, dashboards, and reports translate complex data into clear … actionable insights for business stakeholders. Present technical solutions to business stakeholders, using creative methods to explain complex concepts, increase understanding, and encourage solution adoption. Mentor and develop junior data scientists, fostering a culture of continuous learning, knowledge sharing, and skills development within the organization. Write clean, high-quality code, ensuring all outputs pass quality assurance checks, and contribute … Experience with MLOps practices including model drift detection, decay, A/B testing, integration testing, differential testing, Python package building, and code version control. Skilled in data pipeline creation and working with both structured and unstructured data. Familiar with cloud platforms (AWS, Azure, GCP) and containerization technologies like Docker and Kubernetes. Excellent problem-solving skills, combined with More ❯