351 to 375 of 1,120 Data Pipeline Jobs in the UK

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. … They develop products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities: Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and … stakeholders to gather requirements and propose solutions. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with More ❯

Job Title: Python Data Engineer- Azure Location: Remote (Occasional visits to London) Duration: 9Months+ Contract Inside IR35 Role Summary: We are seeking a versatile and experienced Data Engineer with a strong foundation in Python , PySpark , and modern data platforms. This role demands hands-on … with CI/CD automation , unit testing , and working within Azure environments — both through the Azure Portal and automated scripts . Exposure to data pipelines , big data file formats , and Azure-native services is crucial. Key Responsibilities: Develop and optimize data processing workflows using … using SparkSQL, handling data stored in Delta, Parquet, and other file formats. Write and maintain Pytest-based unit tests to ensure pipeline robustness and data quality. Build and maintain CI/CD pipelines using Azure DevOps (ADO) or GitLab for automated deployments. Work within More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

to solve complex business problems. He/She will also be responsible for creating robust/automated reporting frameworks to increase visibility into data and enable data-driven decision making. Another key aspect of the job is to unearth insights from data to help … in driving process excellence. This position requires excellent statistical knowledge, superior analytical abilities, good knowledge of business intelligence solutions, and exposure to efficient data engineering practices. The BIE will also be a good stakeholder manager as he/she will have to work closely with Ops stakeholders. Candidates … Python, Java, or R). Minimum Qualifications: Master's degree or advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis and correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … Build and maintain data pipelines (including those from 3rd party sources and APIs) Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service to engagement clients Providing access and identity management More ❯

Fully remote - UK £70,000 (DOE) + Excellent benefits Data ignites passion, community fuels collaboration, and growth knows no bounds. Recognized for innovation and rapid growth, this esteemed consultancy has been named Databricks EMEA Emerging Business Partner of the Year and has achieved a second consecutive appearance on … the Financial Times FT1000 list. We are looking for Senior Data Engineers to join remotely in the UK. Be the first to have an influential impact on our UK hub. "As a Data Engineer, you will have the unique opportunity to push the boundaries of technology … record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog). You have extensive experience in ETL/ELT development and data pipeline orchestration (Databricks Workflows, DLT, Airflow, ADF, Glue, Step Functions). You're proficient in SQL and Python, using them to transform and optimize data. More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely … financial analytics, or similar data-driven workflows in a financial institution. Experience with database performance tuning, query optimization, and data pipeline automation. A deep understanding of financial markets, trading workflows, and risk analytics is highly beneficial. Ability to work independently and within a small, high More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely … financial analytics, or similar data-driven workflows in a financial institution. Experience with database performance tuning, query optimization, and data pipeline automation. A deep understanding of financial markets, trading workflows, and risk analytics is highly beneficial. Ability to work independently and within a small, high More ❯

from home or in the office, so you can thrive in your ideal environment. Veeva OpenData Commercial supports the industry by providing reference data across the complete healthcare ecosystem, to support commercial sales execution, compliance, and business analytics. We drive value to our customers through constant innovation, using … cloud-based solutions and state-of-the-art technologies to deliver product excellence and customer success. The Data Platform Engineering team delivers the tools and data processing pipelines to build the global data core for life sciences in 100+ countries. Working as a data engineer in our global Data Platform Engineering team at OpenData, you will drive impactful change by harmonizing data operations globally and enhancing data quality. Your responsibilities will include creating the tools and processes necessary to efficiently store, manage, and compile data More ❯

as core functions. In this pivotal role, you'll be supporting these functions with business intelligence you derive from our vast array of data and will play a role in the long-term growth and success of Amazon in the APAC region. You will be working with stakeholders … team to build their strategies by using extremely large volumes of complex data. You will be exploring datasets, writing complex SQL queries, building data pipelines, and data visualization solutions with AWS Quicksight. You will also be building new Machine Learning models to predict the outcomes of … scripting language (e.g., Python, Java, or R) Master's degree or Advanced technical degree Knowledge of data modeling and data pipeline design Experience with statistical analysis, correlation analysis Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client is seeking a talented … Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes … of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable data migration processes across various project phases. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct More ❯

Are you looking for a role where you can design and implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that … values collaboration and flexibility? If you’re a hands-on Data Architect with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As the Senior Data Architect, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Are you looking for a role where you can design and implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that … values collaboration and flexibility? If you’re a hands-on Data Architect with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As the Senior Data Architect, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Are you looking for a role where you can design and implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that … values collaboration and flexibility? If you’re a hands-on Data Architect with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As the Senior Data Architect, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Business Intelligence Engineer, Finance Operations, Global Data & Analytics (GDA) team Job ID: Amazon/Slovakia/s.r.o. The Business Intelligence Engineer will be part of the high-visibility, growth-oriented, and dynamic Finance Operations, Global Data & Analytics (GDA) team. The GDA team seeks an exceptionally talented … The engineer will navigate ambiguity to rapidly acquire knowledge of Amazon's "Order to Cash" and "Procure to Pay" processes, along with their data sets, becoming a trusted analytics partner for over 2,000 business partners across Finance Operations Head Quarters and Service Centers. Key job responsibilities BI … Governance and Compliance : data segregation, access management, code governance, GDPR, HR Privacy Compliance Build and manage dashboards : Tableau and QuickSight Optimize data pipelines : organize data for visualization environments Collaborate with business users : gather requirements, objectives, and measures Utilize analytical tools : access various databases and More ❯

CANDIDATES MUST BE PORTUGAL, SPAIN or UK BASED) For more information visit us: www.marionete.co.uk SKILLS Must-Have Requirements Minimum of 5 years in Data Engineering. Speaks fluent English (written and verbal) for effective collaboration with stakeholders. Proven ability to communicate complex technical concepts to both technical and non … technical audiences. Capable of providing technical guidance and mentoring to junior team members. Experience working in cross-functional teams , including data scientists, analysts, and DevOps engineers. Ability to influence and establish best practices in data engineering processes. Self-motivated with a growth mindset and an eagerness … to stay updated on emerging technologies. Apache Kafka Expertise : Proven experience designing, developing, and managing Kafka-based data pipelines . Good understanding of Kafka Streams , Connect, or the Confluent Kafka platform. Data Engineering Skills : Hands-on experience with ETL tools and data ingestion processes More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a start up tech consultancy and help to lead their data engineering practice. If you are an experienced and capable data engineer … and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the … engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, Synapse, SQL) Expert use of Databricks More ❯

About BMLL We are the leading independent provider of harmonised Level 3 historical data and analytics to the world's most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 … order book data and advanced analytics, enabling them to accelerate research, optimise trading strategies and generate alpha at unparalleled speed and scale. Our culture is inclusive and highly collaborative, with a flat management structure that empowers our employees to get involved in decision making as we continue to … whilst upgrading and improving existing ones. Parsing occurs in well defined data pipelines built using a distributed architecture. The engineering of the pipeline is as important as the data transformation process, and we are constantly working to improve its performance and reliability. We curate the More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … a dynamic, fast-growing category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting … decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust More ❯

10951SJR £80k - 85k per year + benefits Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company is based in Hampshire and the role is remote with occasional trips to the office … when required. As a Principal Data Engineer, this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. You will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategy alignment with business goals. Main Responsibilities include: Develop, design, and test data deliveries throughout the development lifecycle. Train and coach developers. Manage day-to-day data delivery tasks. Collaborate with stakeholders to align data solutions with organizational objectives. Design More ❯

tool for Capacity Planning, building Reporting Packages, and Finance Operations Volume Forecast Models. Owning the design, operations, and improvements for the Organization's Data Warehouse infrastructure. Maintain, improve, and manage all ETL pipelines and clusters. Explore and learn the latest AWS technologies to provide new capabilities and increase … and other cross-functional stakeholders. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers. Collaborate with data scientists, BIEs, and BAs to deliver high-quality data architecture and pipelines. A Day in the Life Scripting language such as Python … experience in Anaplan model building. PREFERRED QUALIFICATIONS Master's degree or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a More ❯