351 to 375 of 1,802 Data Pipeline Jobs in England

combine strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams to bring ideas to life through innovative software solutions. … technical training), plus gain certifications We believe in using the right technology for the problem rather than prescribing a single stack. As a Data Platform Tech Lead, you can expect to design and deliver scalable,secureand high-performing data platforms that support analytics, operational workloads,AIand ...

Working Environment Data engineering work is grounded in real operational needs, often involving imperfect data, technical constraints and organisational complexity. Engineers work closely with delivery teams and stakeholders to understand problems end to end and deliver robust, production-grade solutions. Collaboration, pragmatism and persistence are valued … alongside strong engineering craft. What You'll Be Doing - Design, build and improve enterprise-scale data pipelines, platforms and services - Lead complex data engineering work end to end, from problem definition through build and operational use - Work directly with technical and non-technical stakeholders to translate ...

Overview Location: Sheffield (2 days per week/Hybrid) Reporting to: VP of Engineering The Team: 2 Data Scientists, 1 Data Engineer IntelliAM is an intelligent asset management company specialising in industrial IoT data. We ingest high-frequency factory and sensor data, apply machine … learning techniques, and present high value actionable insights to analysts and customers. We are building a cutting-edge UNS aligned Industrial IoT data platform with a highly scalable architecture to handle our next phase of growth. We require a delivery-focused technical lead to own the data ...

latest industry news, or just browsing what’s on the market. Location: London (Hybrid, 2 days per week in the office) Reporting to: Data Engineering Manager Help shape the future of data at Rightmove At Rightmove, our vision is to give everyone the belief they … make their move. Millions of people use our platform every month, generating data that powers better experiences for consumers and customers across the property market. We’re looking for a Senior Data Engineer II to play a leading role in shaping the data platform ...

Senior Engineering Manager (Data Platform) Location London Employment Type Full time Location Type Hybrid Department Engineering We power people’s progress. At Preply, we’re all about creating life-changing learning experiences. We help people discover the magic of the perfect tutor, craft a personalised learning journey … unstructured assets, forming a durable data moat for AI-driven products. The team owns end-to-end batch and streaming ingestion pipelines, data contracts and quality checks, enrichment and modeling across domains, and the self-service tooling that lets other teams onboard new data ...

Cloud Computing, Digital Media, and the Internet of Things.Reply’sservices include Consulting, System Integration, and Digital Services. Role Overview: As a Data Engineer, you will design, develop, and implement data solutions using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance data accessibility and analytics. You will also have the opportunity to mentor ...

technical leadership and direction of the Principal Engineer, this role is responsible for enabling secure, reliable and scalable movement of data between customer management platforms, enterprise systems and analytical platforms. The role supports the technical delivery, operation and continuous improvement of integration capabilities across the Customer Management Platforms … estate, ensuring consistent engineering standards, architectural alignment and operational excellence. What You Will Be Doing Integration Engineering & Data Management Design, build and support integrations across Customer Management Platforms and enterprise applications. Develop API, event-driven and batch integration solutions using Informatica CDI/CAI and approved architectural patterns. ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Skills and Competencies 6+ years of experience in Data Engineering, Analytics Engineering, Solution Engineering, or related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks … Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics and artificial intelligence use cases Proven knowledge of data modeling, data ...

Data Test Analyst - SC Cleared Location: Telford - Hybrid ( 2 days per week onsite ) Contract: 6 months Rate: £45-£51 per hour, Inside IR35 Clearance: Active SC Clearance Engagement: PAYE via Umbrella The Opportunity We are looking for a Data Test Analyst to support a major data migration programme within HMRC. You will play a key role in validating data integrity, accuracy and functionality as HMRC's SAS estate, including SAS 9.4 and Viya 3.5 , is migrated to SAS Viya 4 on DPS AWS . This is an excellent opportunity to join ...

cases) It is important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly … speed on the pipeline, advise on efficiency improvements & best practise. SQL expertise. Snowflake experience alongside PySpark, so that they can advise if a better Snowflake-native solution exists - we are not tied to PySpark and are happy if there is a better solution for the pipeline. If you like ...

release management and rollback processes. Implement monitoring, logging and observability for data pipelines and dashboards (for example Application Insights, logging frameworks and pipeline metrics) and act on alerts. Work with ML/agentic automation teams to integrate or evaluate agent-based workflows where applicable (e.g. controlled … requirements through to deployed solutions and operational support. Proven experience designing and operating CI/CD for data platforms and analytics applications (pipeline automation, test automation, release orchestration). Practical familiarity with software development life-cycle practices (version control, code review, unit and integration testing, release management ...

go. If you love making a difference, you’ll love making it sparkle for millions of Very customers. About the team Our Data function plays a critical role in helping The Very Group make smarter decisions, improve customer experiences and drive business performance. Working at the heart … business, our teams deliver the platforms, products and insights that enable colleagues across Technology, Commercial, Finance and Operations to make data-driven decisions. This opportunity sits within our Logistics & Fulfilment (L&F) portfolio, supporting the technology and data initiatives that underpin how we move products efficiently ...

seeking a Senior Data Analyst to join our client’s team in Central London. You’ll play a pivotal role in driving data-informed decision-making through advanced A/B testing, statistical analysis, and enterprise-level business intelligence solutions This is a client-facing position … performance Apply statistical methods to ensure test validity and generate actionable insights Present findings and recommendations to stakeholders Design, build, and optimize semantic data models in Power BI for self-service analytics and enterprise reporting Develop and maintain high-performance Power BI dashboards, reports, and datasets Partner with ...

Data Engineer On going contract programme Hybrid Competitive Salary + Benefits Are you a skilled Data Engineer looking to make a real impact? We're seeking a proactive and technically strong individual to help shape and develop a data platform using Microsoft Fabric . … This role will provide dedicated data engineering capability with a primary focus on developing and optimising the use of Microsoft Fabric. The team has already begun establishing capability in Fabric alongside ongoing delivery. This role will build on that foundation that support both current delivery and future growth. ...

leading consultancy partner is seeking two experienced Data Engineers to join a major data transformation and cloud modernisation programme within a large banking organisation. This is an excellent opportunity for hands-on Data Engineers who enjoy building scalable data solutions, solving complex … data challenges, and contributing to enterprise-wide cloud transformation initiatives. Key Responsibilities Design, build, and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python, SQL, and Oracle. Support the migration of data assets from legacy platforms ...

leading consultancy partner is seeking two experienced Data Engineers to join a major data transformation and cloud modernisation programme within a large banking organisation. This is an excellent opportunity for hands-on Data Engineers who enjoy building scalable data solutions, solving complex … data challenges, and contributing to enterprise-wide cloud transformation initiatives. Key Responsibilities Design, build, and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python, SQL, and Oracle. Support the migration of data assets from legacy platforms ...

production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection engineering, vulnerability and exposure management … production knowledge graph or graph analytics solution, preferably in cybersecurity. Strong portfolio of hands-on Python and graph-query development, data pipeline engineering, testing, and production deployment. Ability to translate complex security problems into data models, algorithms, measurable experiments, scalable services, and clear technical documentation. ...

/Senior Data Engineer Databricks, Python & Azure Location: Leatherhead/Waterloo (Hybrid) Salary: Circa £70,000 + Benefits Working Pattern: Hybrid, with flexible working arrangements The organisation delivers innovative software, enterprise platforms and data-driven solutions, helping businesses leverage technology to improve performance, enhance decision-making … drive innovation. This is an opportunity to work closely with senior technology leadership, contribute to the evolution of data architecture and help shape the organisations data engineering capabilities. Key Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark and Python. Develop ...

based Employment type: Permanent The Opportunity We're working with an established and growing UK business that is looking to appoint a senior data analytics engineer to take ownership of its modern data platform and help shape the next stage of its data journey. … business has made significant investment in its technology and data infrastructure, creating an opportunity for someone to build on those foundations, improve existing capabilities and have a genuine influence on how data is used across the organisation. This is a hands-on position, ideally suited ...

based Employment type: Permanent The Opportunity We're working with an established and growing UK business that is looking to appoint a senior data analytics engineer to take ownership of its modern data platform and help shape the next stage of its data journey. … business has made significant investment in its technology and data infrastructure, creating an opportunity for someone to build on those foundations, improve existing capabilities and have a genuine influence on how data is used across the organisation. This is a hands-on position, ideally suited ...

seeking a Data Strategy Consultant to build and lead the data ecosystem for a newly created department. You will design, implement, and govern a robust data strategy from the ground up, ensuring seamless integration with the wider organization. Key Responsibilities Strategy Development : Architect … governance frameworks and enforce rigorous security standards. Tech Innovation : Incorporate emerging technologies like AI and machine learning into data workflows. Pipeline Engineering : Design scalable data pathways for smooth ingestion, processing, and reporting. Required Experience Proven track record of building data strategies ...

financial insights for stakeholders across Trayport. As a core member of the BI team, you will be instrumental in transforming complex, often unstructured data into clear, actionable insights that drive strategic business decisions. You are a self-starter who thrives in ambiguity and isn't afraid of "messy … data. More than just a technical expert, you act as a bridge between our data infrastructure and the wider business, seamlessly adapting your communication style to collaborate with both technical engineering teams and non-technical stakeholders. Key Responsibilities End-to-End Analytics: Design, develop, and maintain interactive, high ...

financial insights for stakeholders across Trayport. As a core member of the BI team, you will be instrumental in transforming complex, often unstructured data into clear, actionable insights that drive strategic business decisions. You are a self-starter who thrives in ambiguity and isn't afraid of \"messy … data. More than just a technical expert, you act as a bridge between our data infrastructure and the wider business, seamlessly adapting your communication style to collaborate with both technical engineering teams and non-technical stakeholders.# **Key Responsibilities** * **End-to-End Analytics:** Design, develop, and maintain interactive, high ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … Work with the team understand requirements and to manage and organise priorities effectively. Continually review and measure the performance of the data pipeline and evaluate improvements in design, architecture and tooling. Design and develop ETL, infrastructure as code and automation scripts that follow industry best practices ...

Senior Data Scientist - SC cleared Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £49,500 - £75,000/year Description Data Scientists at Made Tech help public sector organisations decide where data … evaluate solutions that work in practice. Our work can include statistical analysis, machine learning, natural language processing, generative AI and agentic systems. Senior Data Scientists combine hands‐on technical delivery with the judgement needed to work through ambiguity, communicate uncertainty and help clients make informed decisions. Your role ...