426 to 450 of 1,210 Data Pipeline Jobs in the UK

About BMLL We are the leading independent provider of harmonised Level 3 historical data and analytics to the world's most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 … order book data and advanced analytics, enabling them to accelerate research, optimise trading strategies and generate alpha at unparalleled speed and scale. Our culture is inclusive and highly collaborative, with a flat management structure that empowers our employees to get involved in decision making as we continue to … whilst upgrading and improving existing ones. Parsing occurs in well defined data pipelines built using a distributed architecture. The engineering of the pipeline is as important as the data transformation process, and we are constantly working to improve its performance and reliability. We curate the More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … a dynamic, fast-growing category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting … decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust More ❯

10951SJR £80k - 85k per year + benefits Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company is based in Hampshire and the role is remote with occasional trips to the office … when required. As a Principal Data Engineer, this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. You will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategy alignment with business goals. Main Responsibilities include: Develop, design, and test data deliveries throughout the development lifecycle. Train and coach developers. Manage day-to-day data delivery tasks. Collaborate with stakeholders to align data solutions with organizational objectives. Design More ❯

Information Office team here at RSA on a hybrid basis. Role Requirements As the DataOps Lead you will design, implement, and maintain automated data pipelines in the Azure cloud environment (Databricks, Data factory, Synapse, SQL). You will develop and manage CI/CD pipelines for … data workflows, ensuring seamless deployment and version control. You will design … and develop Infrastructure as Code (IaC) using tools like Terraform, ARM templates to provision and manage Azure resources. You will monitor data pipeline performance and troubleshoot issues to ensure high availability and reliability. You will collaborate with data engineers, analysts, and stakeholders to align data More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

Permanent Job Alert: Title : Senior Data Analyst Location : London, Hybrid Salary : £75,000 Industry : Insurance Contact : tommy.harris@forsythbarnes.com Brief Overview: Our client, a fast-growing company in the financial services sector, is seeking a Senior Data Analyst to support its continued expansion. The ideal candidate will … bring a strong understanding of the insurance industry, along with hands-on experience in delivering end-to-end data solutions—such as building data lakes, developing ETL processes, and deploying data visualization tools. Working closely with global teams and reporting to the Group Data Lead , the Senior Data Analyst will play a key role in shaping and executing the company’s data strategy, enabling more efficient and effective client service. JOB Responsibilities: Perform statistical analysis and data modeling Clean, analyze, and interpret data from More ❯

department, tasked with managing the Group's ERP and BI systems, developing, and promoting analytical capabilities and insights, and establishing an effective Master Data strategy. The Senior Data Engineer, as a member of the unit's Development and Engineering team, builds and maintains optimized and highly … available data pipelines and data models that facilitate data analysis and reporting. He/she demonstrates leadership in all aspects of their work, continuously striving to develop new and improved data engineering and modelling capabilities. The Senior Data Engineer understands … Shift Timings: 11am - 8pm (Indian Standard Time) What will I be delivering? Take ownership of, maintain, and further develop ETL pipelines and tabular data models. Ensure reliability and accuracy of data pipelines and data models and provide effective diagnostics tools for troubleshooting production issues. More ❯

The Skills You'll Need: IT skills, technical engineering, big data processing, cloud architecture focused on Microsoft Azure Your New Salary: £19 p/h - £34 p/h Location: West London, Weybridge Duration: 4-month assignment from 01/06/2025 until 01/10/… technical team. To be successful in this role our client has said it is essential that candidates: Have technical engineering skills focused on data engineering, big data processing, cloud architecture, and analytical delivery within Microsoft Azure. Have a valid visa and are eligible to work in … our other vacancies for one that may be a better fit. people-first.co.uk IT Manager - Microsoft Azure- Main responsibilities: Design, Develop, and Maintain Data Solutions: Create scalable data pipelines and analytical solutions using Microsoft Azure. Evolve approved architectural designs into technical implementations that enable efficient data More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … delivery. Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … Familiarity with one or more of the following would also be beneficial: Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus. A team player - we highly More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast to our customers. As an Big … Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. You should be skilled in the architecture of DW solutions for the Enterprise using multiple platforms (RDBMS, Columnar, Cloud). You should have experience in the design … creation, management, and business use of extremely large data-sets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all, you should More ❯

Reports to: Senior Data Analyst Location: London - Heathrow Contract Type: Permanent Introduction to role Vanderlande is the global market leader in baggage handling systems for airports, and sorting systems for parcel and postal services. Working for the business based at Heathrow, we are seeking a proactive and detail … oriented Junior Data Engineer to join our dynamic Data & Analytics team. Role Responsibilities In this role, you will support the development and optimization of data pipelines, ensuring the smooth and reliable flow of information across our systems. The ideal candidate is passionate about data, eager to learn, and committed to maintaining the highest standards of data quality and integrity. Your responsibilities and activities will include: Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders More ❯

Data Scientist with Databricks Experience Salary-up to £90K base + bonus + benefits Location- Work from Home but accessible to travel to London when needed Our client is an international company that requires a senior Data Scientist with experience in Azure Databricks, Knowledge Graph, Neo4J … Graph Database, and RAG pipelines for LLM to join the team. Job Description: Responsibilities: Develop and implement data models and algorithms to solve complex business problems. Utilize Databricks to manage and analyse large datasets efficiently. Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights. Design and build scalable data pipelines and ETL processes. Perform data exploration, preprocessing, and feature engineering. Conduct statistical analysis and machine learning model development. Communicate findings and insights to stakeholders through data visualization and reports. Stay current with industry trends More ❯

Data Scientist with Databricks Experience Salary-up to £90K base + bonus + benefits Location- Work from Home but accessible to travel to London when needed Our client is an international company that requires a senior Data Scientist with experience in Azure Databricks, Knowledge Graph, Neo4J … Graph Database, and RAG pipelines for LLM to join the team. Job Description: Responsibilities: Develop and implement data models and algorithms to solve complex business problems. Utilize Databricks to manage and analyse large datasets efficiently. Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights. Design and build scalable data pipelines and ETL processes. Perform data exploration, preprocessing, and feature engineering. Conduct statistical analysis and machine learning model development. Communicate findings and insights to stakeholders through data visualization and reports. Stay current with industry trends More ❯

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles … You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work … as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where … machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to More ❯