376 to 400 of 1,120 Data Pipeline Jobs in the UK

Information Office team here at RSA on a hybrid basis. Role Requirements As the DataOps Lead you will design, implement, and maintain automated data pipelines in the Azure cloud environment (Databricks, Data factory, Synapse, SQL). You will develop and manage CI/CD pipelines for … data workflows, ensuring seamless deployment and version control. You will design … and develop Infrastructure as Code (IaC) using tools like Terraform, ARM templates to provision and manage Azure resources. You will monitor data pipeline performance and troubleshoot issues to ensure high availability and reliability. You will collaborate with data engineers, analysts, and stakeholders to align data More ❯

Senior Data Engineer - MS Fabric - Remote - £70k - £75k My client are a leading Data Partner and consultancy looking for an experienced senior data engineer with skills in Microsoft Fabric being the absolute essential here, the Azure Data Platform and Python to join … programme - guaranteed learning and development investment Life insurance Private medical health insurance Contributory pension scheme Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Azure Develop good working relationships with clients on a project including interpersonal skills with … both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

department, tasked with managing the Group's ERP and BI systems, developing, and promoting analytical capabilities and insights, and establishing an effective Master Data strategy. The Senior Data Engineer, as a member of the unit's Development and Engineering team, builds and maintains optimized and highly … available data pipelines and data models that facilitate data analysis and reporting. He/she demonstrates leadership in all aspects of their work, continuously striving to develop new and improved data engineering and modelling capabilities. The Senior Data Engineer understands … Shift Timings: 11am - 8pm (Indian Standard Time) What will I be delivering? Take ownership of, maintain, and further develop ETL pipelines and tabular data models. Ensure reliability and accuracy of data pipelines and data models and provide effective diagnostics tools for troubleshooting production issues. More ❯

The Skills You'll Need: IT skills, technical engineering, big data processing, cloud architecture focused on Microsoft Azure Your New Salary: £19 p/h - £34 p/h Location: West London, Weybridge Duration: 4-month assignment from 01/06/2025 until 01/10/… technical team. To be successful in this role our client has said it is essential that candidates: Have technical engineering skills focused on data engineering, big data processing, cloud architecture, and analytical delivery within Microsoft Azure. Have a valid visa and are eligible to work in … our other vacancies for one that may be a better fit. people-first.co.uk IT Manager - Microsoft Azure- Main responsibilities: Design, Develop, and Maintain Data Solutions: Create scalable data pipelines and analytical solutions using Microsoft Azure. Evolve approved architectural designs into technical implementations that enable efficient data More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … delivery. Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … Familiarity with one or more of the following would also be beneficial: Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus. A team player - we highly More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast to our customers. As an Big … Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. You should be skilled in the architecture of DW solutions for the Enterprise using multiple platforms (RDBMS, Columnar, Cloud). You should have experience in the design … creation, management, and business use of extremely large data-sets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all, you should More ❯

Reports to: Senior Data Analyst Location: London - Heathrow Contract Type: Permanent Introduction to role Vanderlande is the global market leader in baggage handling systems for airports, and sorting systems for parcel and postal services. Working for the business based at Heathrow, we are seeking a proactive and detail … oriented Junior Data Engineer to join our dynamic Data & Analytics team. Role Responsibilities In this role, you will support the development and optimization of data pipelines, ensuring the smooth and reliable flow of information across our systems. The ideal candidate is passionate about data, eager to learn, and committed to maintaining the highest standards of data quality and integrity. Your responsibilities and activities will include: Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders More ❯

Data Scientist with Databricks Experience Salary-up to £90K base + bonus + benefits Location- Work from Home but accessible to travel to London when needed Our client is an international company that requires a senior Data Scientist with experience in Azure Databricks, Knowledge Graph, Neo4J … Graph Database, and RAG pipelines for LLM to join the team. Job Description: Responsibilities: Develop and implement data models and algorithms to solve complex business problems. Utilize Databricks to manage and analyse large datasets efficiently. Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights. Design and build scalable data pipelines and ETL processes. Perform data exploration, preprocessing, and feature engineering. Conduct statistical analysis and machine learning model development. Communicate findings and insights to stakeholders through data visualization and reports. Stay current with industry trends More ❯

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles … You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work … as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where … machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to More ❯

Senior Analyst & Data Specialist Location: Sutton Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯

Senior Analyst & Data Specialist Location: Sutton Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯

Senior Analyst & Data Specialist Location: Liverpool Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯