251 to 275 of 829 Data Pipeline Jobs in England

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

Team: The Academic Information Systems ( AI S) DataOps team is a shared technology group responsible for building, administering, governing, and setting standards for a growing number of strategic data platforms and services. Our capabilities enable data to be extracted, centralized, transformed, transmitted, and analyzed across a range of products in the AIS space. Due to our … footprint across the enterprise, we are relied upon to ensure our systems are trusted, reliable and available.The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Astronomer/Airflow, Kubernetes , DBT, Tableau, Sisense , Collibra, and Kafka/Debezium . Our mission is to enable frictionless experiences for our AIS colleagues and customers so … that they can openly and securely consume trustworthy data, enhancing everyday interactions and decisions. About the Role: As a S enior Data Engineer I , you will be responsible for helping to creat e a data infrastructure that is secure, scalable, well-connected, thoughtfully architected while also building a deep domain knowledge of our business More ❯

Senior Data Engineer - AWS Location: London (Hybrid) | Practice Area : Technology & Engineering Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We're looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You'll … play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry. What You'll Do Design and build end-to-end data pipelines leveraging … AWS-native tools and modern data architectures. Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems. Apply AWS Well-Architected Principles to ensure scalability, security, and resilience. Lead in the development of robust, tested, and fault-tolerant data engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. More ❯

Software Engineer (Data & Infrastructure) London, United Kingdom At Modo Energy, we're on a mission to build the information architecture for the energy transition - we want to be the only place to come to for information on the global journey to net zero. Take a look at our platform , where we provide open access to an array of … will collaborate with us in shaping the culture of a rapidly growing team. The role We're looking for software engineers at various experience levels to join our data and infrastructure team. You will be responsible for developing new features and ensuring they are scalable, reliable, and efficient to meet future demands. This position requires a proactive approach … to adapt to a flexible, evolving environment. Some experience or desire to learn: AWS cloud services. Infrastructure as Code (Terraform) Python web frameworks (Django, FastAPI, Flask) Data pipeline development (Batch and Stream Processing) Data modeling and Data Lakehouse concepts. CI/CD pipelines. Microservices architecture. Hybrid Work Environment : This role is hybrid, with More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯

DATABRICKS ENGINEER 6-MONTH CONTRACT £450-£550 PER DAY (OUTSIDE IR35) This role is a great opportunity for a skilled Databricks Engineer to join a data-driven financial services firm undergoing a major transformation of their data infrastructure. You'll be a key player in modernising their data platform with Databricks and Azure, while … supporting scalable data pipelines and machine learning workflows. THE COMPANY This business is investing heavily in data as it digitises operations across its risk, product, and customer intelligence teams. They're building a modern Lakehouse architecture using Databricks, Delta Lake, and Azure Data Lake. You'll be part of a collaborative, forward-thinking team … with a focus on best practices, automation, and end-to-end data enablement. THE ROLE You'll work closely with Data Engineers, Scientists, and Architects to design, build, and optimise core data pipelines on Databricks. Your focus will be on enabling analytics and machine learning at scale, using best-in-class tools across the More ❯

Data Manager - Government & Social Impact 12 month contract with potential to extend Salary: £73,000 -£80,000 per year PAYE Location: London onsite Are you passionate about using data to drive social impact? A leading technology company is seeking a Data Manager to join their Government & Social Impact (GSI) team. This team works on … cutting-edge data projects that support government and nonprofit stakeholders globally. Key Responsibilities: Manage and maintain civic data sets, ensuring compliance and equitable support. Collaborate with internal partner managers and engineers to optimize data processes. Conduct QA, analyze complex datasets, and support election-time data updates. Test engineering pipelines and assist in … We're Looking For: 5-10 years of experience in data operations, analytics, or a related field. Strong skills in SQL, Excel, Python, and data pipeline monitoring. Ability to translate complex data into actionable insights. Clear communication and experience working cross-functionally with internal teams. Background in government or political data More ❯

across NYC, LDN, TLV, and other locations, where 2 of every 3 managers were promoted from within. Growing your career with Optimove is basically guaranteed. As a Customer Data Engineer, you will be a part of a strong energetic and fast-growing global team. You will be an integral part of clients' ongoing data requests and … projects. You will be working closely with internal CSM teams as well as interacting directly with clients' data teams across different business verticals. Your core responsibilities will involve playing an active role in collaborating with internal teams to construct tailored data transformations and manipulations while working with top-notch technology (Cloud tech etc.) The ideal candidate … capabilities, and highly effective time management skills. We are looking for a master multi-tasker who thrives in challenging, fast-paced environments, with agility and ease. The Customer Data Engineer is a position that brings with it an excellent opportunity to learn and grow within a rapidly expanding company on the cutting edge of Martech. Responsibilities: Develop and More ❯

Director for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Groups technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztecs ecosystem. Oversee the development of data pipelines, master data management (MDM), and More ❯

you would like to help us prevent crime and protect the world's biggest online businesses. The Team You will be joining the Detection team, a team of data scientists and machine learning engineers. The Detection team is responsible for keeping fraud rates low - and clients happy - by continuously training and deploying machine learning models. We aim to … free as code deployments. Google's Best Practices for ML Engineering is our bible. Our models are trained to spot multiple types of fraud, using a variety of data sources and techniques in real time. The prediction pipelines are under strict SLAs; every prediction must be returned in under 300ms. When models are not performing as expected, it … Rust). Experience with deep learning frameworks like PyTorch or TensorFlow. Experience with large-scale data processing engines like Spark and Dataproc. Familiarity with data pipeline tools like dbt. Benefits Flexible Working Hours & Remote-First Environment - Work when and where you're most productive, with flexibility and support. Comprehensive BUPA Health Insurance - Stay covered with More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You’ll be a trusted technical advisor, collaborating More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You'll be a trusted technical advisor, collaborating More ❯

US$121 billion on behalf of major pension funds, endowments, foundations, governments and other investors based in the U.S. and abroad. Position Overview: We're looking for a Data Implementation Engineer to help drive our data transformation efforts. This role is crucial in reimagining and rebuilding our data platform to ensure we stay ahead … in a rapidly evolving landscape. You'll be hands-on, using the latest tools like Apache Arrow, Polars, and Dagster to craft a data architecture that aligns with our innovative investment strategies. In this position, you'll be deeply involved in building and optimizing data pipelines that are reliable, scalable, and fast. Your work will directly … the Boston office 3 days a week. What You'll Do: System Deep Dive: Quickly understand our current data systems, identifying strengths, weaknesses, and opportunities for improvement. Pipeline Development: Use the latest tools and foundations from our Data Platform Engineering group to develop new data pipelines that integrate with existing systems. System Transition More ❯

/12/2025 with intent to extend. Rate: from £26.44 per hour Hours: Normal working hours (Hybrid, 3 days per week office based) Overview: Looking for a data engineer/software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data … The goal is to proactively mitigate potential risks associated with these datasets. Role Duties: Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines.Filtering: Data cleaning, improvement and running filtering using client pipelines.Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion.Technical skills: Experience building and … maintaining data pipelines, knowledge of data storage solutions;Data Management: Data preprocessing and cleaning, transformation and formatting, data quality control and validationCommunication - effective communication skills to collaborate with stakeholders and team membersSoftware engineering skills: Python, data pipelines. Skills & Experience: Top 3 Must – have hard skills: Data More ❯

exciting journey as we build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have created an energetic and target … at the forefront of designing, developing, and deploying ML models that power personalised advertising, customer journey analytics, audience segmentation, and real-time bidding strategies. Working closely with BI, data engineers, and product teams, you'll build scalable solutions that drive measurable business outcomes for some of the world's most recognised brands. Our infrastructure is powered by Google … Business Acumen: Ability to understand marketing and advertising concepts like customer lifetime value (CLV), attribution modeling, real-time bidding (RTB), and audience targeting. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills More ❯

exciting journey as we build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have created an energetic and target … at the forefront of designing, developing, and deploying ML models that power personalised advertising, customer journey analytics, audience segmentation, and real-time bidding strategies. Working closely with BI, data engineers, and product teams, you'll build scalable solutions that drive measurable business outcomes for some of the world's most recognised brands. Our infrastructure is powered by Google … Business Acumen: Ability to understand marketing and advertising concepts like customer lifetime value (CLV), attribution modeling, real-time bidding (RTB), and audience targeting. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills More ❯

days in office Leeds £60K We are looking for a BI Developer to join our clients team in Leeds. The ideal candidate will have experience in PowerBI, Data Engineering, and have a strong understanding of data warehousing and business intelligence. The role will involve working with a team of data engineers to design, develop … and maintain data pipelines. You will also be responsible for creating and managing data models, and developing reports and dashboards using PowerBI. The successful candidate will be a highly motivated and self-directed individual with excellent communication and teamwork skills. They will also have a strong understanding of data analysis and visualization techniques. Responsibilities … Create and manage data models Designing, developing, testing, and implementing robust data applications powered by cutting-edge technologies like Azure DataFactory, PowerBI, Qlikview, and SSRS. Develop reports and dashboards using PowerBI Work with a team of data engineers to improve data quality and performance Provide technical support to users of PowerBI Qualifications More ❯