151 to 175 of 495 Data Pipeline Jobs in London

10959HS £550 - 620 per day Data Solutions Architect Hybrid - Inside IR35 We're looking for a seasoned Data Solutions Architect with deep expertise in the Lloyd's of London Market and a strong background in Snowflake and ETL/data transformation tools . As … a Data Architect , you'll lead the design, development, and deployment of enterprise-grade data architecture using Snowflake and a modern suite of data tools. You'll work at the intersection of IT and business, collaborating closely with stakeholders to create solutions that unlock … the full value of data-driving decision-making and business growth across the organisation. Key Responsibilities Architecture Design: Design and maintain enterprise data architecture models, data flows, and integrations using Snowflake. Data Governance: Manage data collection, storage, transformation, and protection More ❯

promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims … professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science … least one of the big 3 cloud ML stacks (AWS, Azure, GCP). Hands-on experience with open-source ETL, and data pipeline orchestration tools such as Apache Airflow and Nifi. Experience with large scale/Big Data technologies, such as Hadoop, Spark, Hive, Impala More ❯

and open-minded individual with an interest in state-of-the-art machine learning engineering and research? Thomson Reuters Labs is seeking a Data Engineer with a passion for solving challenging machine learning problems in a data-rich, complex and innovative environment. What does Thomson Reuters …/Applied ML, as well as Research, to drive the company's leading internal AI model development, fueled by an unprecedented wealth of data and powered by cutting-edge technical infrastructure. You will have the opportunity to contribute to a data curation & filtering system combining the … and ability to work with limited supervision. Experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Cassandra). Experience with data pipeline orchestration tools. Experience with cloud-based data platforms such as AWS, GCP, or Azure (e.g., S3, BigQuery, Azure Data Lake More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. … They develop products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. … They develop products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities: Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and … stakeholders to gather requirements and propose solutions. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with More ❯

to solve complex business problems. He/She will also be responsible for creating robust/automated reporting frameworks to increase visibility into data and enable data-driven decision making. Another key aspect of the job is to unearth insights from data to help … in driving process excellence. This position requires excellent statistical knowledge, superior analytical abilities, good knowledge of business intelligence solutions, and exposure to efficient data engineering practices. The BIE will also be a good stakeholder manager as he/she will have to work closely with Ops stakeholders. Candidates … Python, Java, or R). Minimum Qualifications: Master's degree or advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis and correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

Fully remote - UK £70,000 (DOE) + Excellent benefits Data ignites passion, community fuels collaboration, and growth knows no bounds. Recognized for innovation and rapid growth, this esteemed consultancy has been named Databricks EMEA Emerging Business Partner of the Year and has achieved a second consecutive appearance on … the Financial Times FT1000 list. We are looking for Senior Data Engineers to join remotely in the UK. Be the first to have an influential impact on our UK hub. "As a Data Engineer, you will have the unique opportunity to push the boundaries of technology … record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog). You have extensive experience in ETL/ELT development and data pipeline orchestration (Databricks Workflows, DLT, Airflow, ADF, Glue, Step Functions). You're proficient in SQL and Python, using them to transform and optimize data. More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely … financial analytics, or similar data-driven workflows in a financial institution. Experience with database performance tuning, query optimization, and data pipeline automation. A deep understanding of financial markets, trading workflows, and risk analytics is highly beneficial. Ability to work independently and within a small, high More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely … financial analytics, or similar data-driven workflows in a financial institution. Experience with database performance tuning, query optimization, and data pipeline automation. A deep understanding of financial markets, trading workflows, and risk analytics is highly beneficial. Ability to work independently and within a small, high More ❯

as core functions. In this pivotal role, you'll be supporting these functions with business intelligence you derive from our vast array of data and will play a role in the long-term growth and success of Amazon in the APAC region. You will be working with stakeholders … team to build their strategies by using extremely large volumes of complex data. You will be exploring datasets, writing complex SQL queries, building data pipelines, and data visualization solutions with AWS Quicksight. You will also be building new Machine Learning models to predict the outcomes of … scripting language (e.g., Python, Java, or R) Master's degree or Advanced technical degree Knowledge of data modeling and data pipeline design Experience with statistical analysis, correlation analysis Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a More ❯

Are you looking for a role where you can design and implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that … values collaboration and flexibility? If you’re a hands-on Data Architect with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As the Senior Data Architect, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Are you looking for a role where you can design and implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that … values collaboration and flexibility? If you’re a hands-on Data Architect with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As the Senior Data Architect, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Business Intelligence Engineer, Finance Operations, Global Data & Analytics (GDA) team Job ID: Amazon/Slovakia/s.r.o. The Business Intelligence Engineer will be part of the high-visibility, growth-oriented, and dynamic Finance Operations, Global Data & Analytics (GDA) team. The GDA team seeks an exceptionally talented … The engineer will navigate ambiguity to rapidly acquire knowledge of Amazon's "Order to Cash" and "Procure to Pay" processes, along with their data sets, becoming a trusted analytics partner for over 2,000 business partners across Finance Operations Head Quarters and Service Centers. Key job responsibilities BI … Governance and Compliance : data segregation, access management, code governance, GDPR, HR Privacy Compliance Build and manage dashboards : Tableau and QuickSight Optimize data pipelines : organize data for visualization environments Collaborate with business users : gather requirements, objectives, and measures Utilize analytical tools : access various databases and More ❯

About BMLL We are the leading independent provider of harmonised Level 3 historical data and analytics to the world's most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 … order book data and advanced analytics, enabling them to accelerate research, optimise trading strategies and generate alpha at unparalleled speed and scale. Our culture is inclusive and highly collaborative, with a flat management structure that empowers our employees to get involved in decision making as we continue to … whilst upgrading and improving existing ones. Parsing occurs in well defined data pipelines built using a distributed architecture. The engineering of the pipeline is as important as the data transformation process, and we are constantly working to improve its performance and reliability. We curate the More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … a dynamic, fast-growing category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting … decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust More ❯

tool for Capacity Planning, building Reporting Packages, and Finance Operations Volume Forecast Models. Owning the design, operations, and improvements for the Organization's Data Warehouse infrastructure. Maintain, improve, and manage all ETL pipelines and clusters. Explore and learn the latest AWS technologies to provide new capabilities and increase … and other cross-functional stakeholders. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers. Collaborate with data scientists, BIEs, and BAs to deliver high-quality data architecture and pipelines. A Day in the Life Scripting language such as Python … experience in Anaplan model building. PREFERRED QUALIFICATIONS Master's degree or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a More ❯

Information Office team here at RSA on a hybrid basis. Role Requirements As the DataOps Lead you will design, implement, and maintain automated data pipelines in the Azure cloud environment (Databricks, Data factory, Synapse, SQL). You will develop and manage CI/CD pipelines for … data workflows, ensuring seamless deployment and version control. You will design … and develop Infrastructure as Code (IaC) using tools like Terraform, ARM templates to provision and manage Azure resources. You will monitor data pipeline performance and troubleshoot issues to ensure high availability and reliability. You will collaborate with data engineers, analysts, and stakeholders to align data More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

Requirement Several years of relevant work experience Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well … it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-off Should have experience … with Data Modelling Experience in data query languages (SQL or similar). Knowledge of ETL processes and tool Experience in data centric and API programming (for automation) using one of more programming languages Python, Java/or Scala. Knowledge of NoSQL and RDBMS databases More ❯

department, tasked with managing the Group's ERP and BI systems, developing, and promoting analytical capabilities and insights, and establishing an effective Master Data strategy. The Senior Data Engineer, as a member of the unit's Development and Engineering team, builds and maintains optimized and highly … available data pipelines and data models that facilitate data analysis and reporting. He/she demonstrates leadership in all aspects of their work, continuously striving to develop new and improved data engineering and modelling capabilities. The Senior Data Engineer understands … Shift Timings: 11am - 8pm (Indian Standard Time) What will I be delivering? Take ownership of, maintain, and further develop ETL pipelines and tabular data models. Ensure reliability and accuracy of data pipelines and data models and provide effective diagnostics tools for troubleshooting production issues. More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer - Insurance Sector Location: London (4 days per week in-office) Type: Permanent Salary: Competitive, with 20% pension contribution We're partnering with a specialist insurance business currently undergoing a significant data transformation. With a major focus on modernising its reporting and analytics infrastructure, there … s now an exciting opportunity for a Data Engineer to play a key role in shaping a modern, cloud-first data environment. About the Role: This is a hands-on engineering position within a business that is reimagining how it leverages data. The existing setup includes … is expected to centre around Azure and Microsoft Fabric . You'll work closely with teams across the business to deliver scalable, impactful data solutions that are aligned with real-world insurance and claims use cases. Key Workstreams: Establishing Data Governance and a comprehensive Data More ❯

We are working on behalf of a stealth-mode MedTech with a goal to transform how health data is collected, analysed, and applied to improve patient care, making a real impact on individuals' lives globally. As they continue to grow, they are building a team based in London … consisting of diverse, well-educated individuals who are passionate about shaping the future of healthcare through technology. They are seeking a Director of Data, to lead to head up a high-performing team of data scientists, engineers, and developers. Your role will encompass defining the roadmap … strategy, and execution of data initiatives, while also remaining hands-on. You will work closely with the CEO to secure funding and shape the company's data architecture, analytics, and machine learning strategies. Key Responsibilities: Lead, mentor, and grow a cross-functional data teams More ❯