226 to 250 of 402 Data Pipeline Jobs in England

MI Developer has become available within Saga's finance department. Supporting both the Finance team and the wider Insurance business, this role sits within a team of 4 Data and Analytics professionals and provides the opportunity to work across multiple data sources, platforms and analytics tools. The role is all about providing technical data … Academy, our bespoke learning platform Main Responsibilities Following our Business Code of Conduct and always acting with integrity and due diligence Supporting our Ops MI team with their data pipelines, troubleshooting issues as they occur and amending processes as business requirements develop Specifying, designing and automating of business processes using BI tools Creating and maintaining technical documentation and … best practices for all aspect of data extraction and transformation Assisting the team with identifying gaps in data sets and ensuring we have optimal data quality for accurate and timely reporting and MI Working with the business and technical stakeholders, identify and develop data sets to assist in efficient reporting and MI More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

expose AI capabilities via RESTful APIs or cloud-native platforms (e.g., Azure, AWS). Ensure high availability and fault tolerance of AI services in production environments. Build robust data pipelines for preprocessing, feature engineering, and real-time inference. Set up monitoring tools to track model performance, drift, and system health. Iterate quickly based on feedback, usage metrics, and More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … planning, resource allocation, and optimization of Airflow workers. Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure … using AWS and SQL technologies. Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about … data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:**- Develop and maintain AWS data pipelines and infrastructure.- Collaborate with cross-functional teams to design data solutions.- Optimise existing data processes for efficiency and performance.- Ensure data quality and security standards are met.- Stay up … to-date with AWS developments and best practices.**Key Requirements:**- Proven experience with AWS services and tools.- Strong knowledge of data modeling and ETL processes.- Proficiency in programming languages such as Python or SQL.- Excellent problem-solving skills with a proactive approach.- Ability to communicate effectively within a team.If you are a skilled and driven AWS Data More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about … data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:** - Develop and maintain AWS data pipelines and infrastructure. - Collaborate with cross-functional teams to design data solutions. - Optimise existing data processes for efficiency and performance. - Ensure data quality and security standards are met. - Stay up … to-date with AWS developments and best practices. **Key Requirements:** - Proven experience with AWS services and tools. - Strong knowledge of data modeling and ETL processes. - Proficiency in programming languages such as Python or SQL. - Excellent problem-solving skills with a proactive approach. - Ability to communicate effectively within a team. If you are a skilled and driven AWS Data More ❯

JoinusasaDataPlatformEngineerforourclient. AtPeregrine,werealwaysseekingSpecialistTalentthathavetheidealmixofskills,experience,and attitude,toplacewithourvastarrayofclients.FromBusinessAnalystsinlargegovernment organisationstoSoftwareDevelopersintheprivatesectorwearealwaysinsearchofthebest talenttoplace,now. HowSpecialistTalentWorks AtPeregrine,wefindthebesttalentforourclients.AsapermanentemployeeofPeregrine,with accesstoallourstandardbenefits,youwillbedeployedacrossourportfolioofclientsasaspecialistconsultant,workingonawidearrayofcomplexprojectsacrossmultipleindustries. TheRole: AsaDataPlatformEngineerinahighlyregulatedenvironment,youwillberesponsiblefordesigning,building,andmaintainingsecureandscalabledatainfrastructurethatsupportsbothcloudandonpremisesplatforms.Youwillplayakeyroleinensuringthatalldatasystemscomplywithindustryregulationsandsecuritystandardswhileenablingefficientaccessforanalyticsandoperationalteams. AstrongcommandofApacheNiFiisessentialforthisrole.Youwillbeexpectedtodesign, implement,andmaintaindataflowsusingNiFi,ensuringaccurate,efficient,andsecuredata ingestion,transformation,anddelivery.Youshouldbeadeptatidentifyingandresolvingissues withinNiFiflows,managingperformancebottlenecks,andimplementingrobusterrorhandling strategies. Youllworkcloselywithcross-functionalteamsincludingdataarchitects,complianceofficers,and cybersecurityspecialiststointegratedatafromvarioussystemssuchasdatabases More ❯

JoinusasaDataPlatformEngineerforourclient. AtPeregrine,werealwaysseekingSpecialistTalentthathavetheidealmixofskills,experience,and attitude,toplacewithourvastarrayofclients.FromBusinessAnalystsinlargegovernment organisationstoSoftwareDevelopersintheprivatesectorwearealwaysinsearchofthebest talenttoplace,now. HowSpecialistTalentWorks AtPeregrine,wefindthebesttalentforourclients.AsapermanentemployeeofPeregrine,with accesstoallourstandardbenefits,youwillbedeployedacrossourportfolioofclientsasaspecialistconsultant,workingonawidearrayofcomplexprojectsacrossmultipleindustries. TheRole: AsaDataPlatformEngineerinahighlyregulatedenvironment,youwillberesponsiblefordesigning,building,andmaintainingsecureandscalabledatainfrastructurethatsupportsbothcloudandonpremisesplatforms.Youwillplayakeyroleinensuringthatalldatasystemscomplywithindustryregulationsandsecuritystandardswhileenablingefficientaccessforanalyticsandoperationalteams. AstrongcommandofApacheNiFiisessentialforthisrole.Youwillbeexpectedtodesign, implement,andmaintaindataflowsusingNiFi,ensuringaccurate,efficient,andsecuredata ingestion,transformation,anddelivery.Youshouldbeadeptatidentifyingandresolvingissues withinNiFiflows,managingperformancebottlenecks,andimplementingrobusterrorhandling strategies. Youllworkcloselywithcross-functionalteamsincludingdataarchitects,complianceofficers,and cybersecurityspecialiststointegratedatafromvarioussystemssuchasdatabases More ❯

/ML model development and deployment Strong skills with Python, TensorFlow/PyTorch, and cloud platforms (AWS/Azure/GCP) MLOps assurance and risk experinece Knowledge of data pipelines, model optimisation, and real-world deployments Details: Contract: 6 months (with view to extend) Location: London (Hybrid) Start: ASAP If you’re interested, please apply or reach out More ❯

/ML model development and deployment Strong skills with Python, TensorFlow/PyTorch, and cloud platforms (AWS/Azure/GCP) MLOps assurance and risk experinece Knowledge of data pipelines, model optimisation, and real-world deployments Details: Contract: 6 months (with view to extend) Location: London (Hybrid) Start: ASAP If you’re interested, please apply or reach out More ❯

DATA ENGINEER PRIVATE HEALTHCARE SQL, SNOWFLAKE, POWER BI, SSRS Progressive, forward thinking, innovative international private healthcare organisation urgently require a talented Data Engineer to help then shape the future state of the organisation You will: Help create and develop data as they move forward into their new Snowflake environment to ensure they deliver critical … data in an accurate and timely information to the rest of the organisation. Develop and implement data pipelines that extract, transform and load data using into our Snowflake environment for use with reporting tools such as Power BI and SSRS. You are: An Experienced Data Engineer With in depth experience of: Snowflake More ❯

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll … be doing: -Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate … and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

team on an initial 6-month contract. Key skills/knowledge required: Strong proficiency in Python-based testing frameworks (e.g., Behave, PyTest, unittest) Experience in automated testing of data pipelines and ETL processes Experience with data validation frameworks and testing data transformations across Snowflake and AWS environments Knowledge of API testing tools and frameworks … Postman, REST Assured, or similar) Hands-on experience testing OMS platform integrations (Aladdin, Murex, Charles River) and validating trade lifecycle data flows Experience integrating automated tests into CI/CD pipelines for continuous delivery Hands-on experience validating data accuracy and integrity across multiple systems Experience working embedded within cross-functional agile teams rather than separate … QA departments Strong problem-solving skills with ability to design effective test strategies for complex data workflows Ability to work collaboratively with engineers, delivery roles, and business stakeholders Knowledge of testing methodologies for data pipelines, APIs, and integrations Knowledge of data quality testing patterns and anomaly detection in capital markets data Understanding More ❯

Data Integration Engineer Outside IR35 6 months Fully remote £400 - £500 per day Start asap Chroma is currently working with a prominent high street retailer who is looking for an Integration Engineer to join their team, this is an excellent opportunity for someone to get involved in the middle of an exciting tech transformation! As an Integration Engineer … youll play a key part in helping the team work faster and smarter. In this role, youll design modern APIs, build smooth integrations, and create reliable data pipelines. Additionally, you will lead efforts to extract, transform, and load data into platforms like Snowflake and other enterprise data solutions, supporting data-driven decision … making across the business. Required Skills/Experience: 5+ years of experience in similar role Experience with Mulesoft Highly skilled with Microsoft Power Platform tools Experience with data systems eg. Snowflake, SQL, NoSQL Experience with building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Any extra experience may include: Experience with Azure Logic More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

Machine Learning Engineer Salary: £55,00 - £60,000 Location: London - Hybrid - 2 days We are currently looking for a Machine Learning Engineer to join our client's data team. This is a hands-on role where you'll design and build robust data pipelines, transform ML prototypes into production-ready systems, and champion MLOps best practices … across the business. As a Machine Learning Engineer, you'll play a crucial role in ensuring our clients' data and AI strategy scales effectively, directly influencing the way millions of people engage with their products every day. The Opportunity This is a unique chance to combine data engineering with machine learning in a high-impact environment. … You'll work closely with analysts, data engineers and stakeholders, ensuring models are reliable, scalable, and production-ready. Unlike many roles in the tech sector, this Machine Learning Engineer role gives you the visibility of seeing your work applied at scale, powering decision-making and user experiences for a vast audience. Your day-to-day will include: Building More ❯

We are searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore need to live within a commutable distance of … that underpin various digital products and services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data Analyst/GIS … with the ability to plan, allocate and manage workloads for yourself and other team members. You will also have the following: - A qualification in either a GIS or Data related discipline or equivalent professional experience. Practical experience of working in a data analysis role, a data curation role or a data focused More ❯

Data Engineer - AI/ML | Leading Pharma | London (Hybrid) My client a leading pharmaceutical company is looking for a Data Engineer who thrives on solving complex challenges and building scalable data solutions that power scientific innovation. Key Responsibilities Build and maintain data pipelines using Python, Spark, SQL, BigQuery , and Google Cloud Collaborate … with scientists to meet research data needs Ensure high-quality, well-documented, and tested code Improve performance metrics and integrate data across teams Requirements Essential: Experience in data engineering Strong Python & SQL skills Experience with Google Cloud or similar Familiarity with unit testing , Git , and Agile Desirable: Experience with bioinformatics or scientific datasets Knowledge More ❯

Data Engineer - AI/ML | Leading Pharma | London (Hybrid) My client a leading pharmaceutical company is looking for a Data Engineer who thrives on solving complex challenges and building scalable data solutions that power scientific innovation. Key Responsibilities Build and maintain data pipelines using Python, Spark, SQL, BigQuery , and Google Cloud Collaborate … with scientists to meet research data needs Ensure high-quality, well-documented, and tested code Improve performance metrics and integrate data across teams Requirements Essential: Experience in data engineering Strong Python & SQL skills Experience with Google Cloud or similar Familiarity with unit testing , Git , and Agile Desirable: Experience with bioinformatics or scientific datasets Knowledge More ❯

projects for government and defence clients, using the latest tools and techniques to solve real-world problems. What You'll Do: Design, build, and test powerful backend systems, data pipelines, and web apps. Work in small, agile teams using DevOps best practices. Deploy to cloud environments like AWS and Azure. Own the full software lifecycle-from concept to More ❯

Proven success scaling security operations across geographies Exceptional analytical and decision-making abilities during BAU and incidents. Strong technical ability to understand and manage security tooling, integrations, and data pipelines. Core Values Love what you do: We show up each day ready to take on the world. Our passion and intensity set us apart and makes the difference More ❯