76 to 100 of 281 Data Pipeline Jobs in the South East

Data Engineer Location: Middlesex 3 days in the office 2 days’ work from home Salary: Negotiable to £70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this client cannot offer visa sponsorship. … A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data and integrity. This … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery Monitor More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £110,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. … They develop products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise More ❯

The Skills You'll Need: IT skills, technical engineering, big data processing, cloud architecture focused on Microsoft Azure Your New Salary: £19 p/h - £34 p/h Location: West London, Weybridge Duration: 4-month assignment from 01/06/2025 until 01/10/… technical team. To be successful in this role our client has said it is essential that candidates: Have technical engineering skills focused on data engineering, big data processing, cloud architecture, and analytical delivery within Microsoft Azure. Have a valid visa and are eligible to work in … our other vacancies for one that may be a better fit. people-first.co.uk IT Manager - Microsoft Azure- Main responsibilities: Design, Develop, and Maintain Data Solutions: Create scalable data pipelines and analytical solutions using Microsoft Azure. Evolve approved architectural designs into technical implementations that enable efficient data More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design … to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of More ❯

Data Scientist with Databricks Experience Salary-up to £90K base + bonus + benefits Location- Work from Home but accessible to travel to London when needed Our client is an international company that requires a senior Data Scientist with experience in Azure Databricks, Knowledge Graph, Neo4J … Graph Database, and RAG pipelines for LLM to join the team. Job Description: Responsibilities: Develop and implement data models and algorithms to solve complex business problems. Utilize Databricks to manage and analyse large datasets efficiently. Collaborate with cross-functional teams to understand business requirements and deliver data-driven insights. Design and build scalable data pipelines and ETL processes. Perform data exploration, preprocessing, and feature engineering. Conduct statistical analysis and machine learning model development. Communicate findings and insights to stakeholders through data visualization and reports. Stay current with industry trends More ❯

Join Our Team as a Data Engineer - MS Azure! Are you ready to dive into a dynamic role where your expertise in data engineering can make a real impact? If you're passionate about transforming data into actionable insights and have a knack for … working with MS Azure, we want you on our team! We're seeking a talented Data Engineer for a temporary position in the vibrant Manufacturing & Production sector. Position Details: Contract Type: Temporary Duration: 4 Months (From June 2, 2025, to October 1, 2025) Working Pattern: Full Time Hourly … Rate: £19.33 Number of Positions: 1 Driving Required: No What You'll Do: As our Data Engineer, you will play a pivotal role in enhancing our data processes, ensuring that data flows seamlessly through our systems. Your responsibilities will include: Designing and implementing data More ❯

Data Engineer | London, Twice Weekly | £50,000-£55,000 My client is on the lookout for a Data Engineer who’s passionate about building scalable data solutions and enabling smarter business decisions. This is a hands-on role where you'll work across the … full data lifecycle – from ingestion to insight – using modern tools and best practices. You’ll be collaborating with a range of teams and have real influence over how data is structured, accessed, and used. If you enjoy solving complex data challenges and improving systems … this could be a great fit. Key Responsibilities Design and maintain data pipelines that convert raw inputs into structured, analysis-ready datasets. Embed robust validation checks to ensure accuracy, completeness, and consistency of data. Work closely with key stakeholders to deliver data outputs aligned with business More ❯

Senior Data Analyst Sports Agency £600 per day (Outside IR35) 4 Days per week in London Office Role and Responsibilities Stakeholder Management : Build strong relationships with internal and external stakeholders, ensuring clear communication and project alignment. Project Management : Work on multiple projects simultaneously, delivering results on time and … maintaining quality in fast-paced environments Data Integration : Oversee data integration into CRM systems, ensuring smooth data flow and accessibility for analysis. Data Pipelines : Develop and optimise data pipelines, ensuring efficient data flow between systems for reporting and … insights. Data Strategy : Shape and execute data strategy, providing actionable insights to drive business decisions. Collaboration & Reporting : Work cross-functionally, preparing and presenting reports to guide business strategy and project outcomes. Essential tools - Power BI Python BigQuery Google Cloud Platform Looker Google Analytics 4 (GA4) Solid More ❯

Are you looking for a role where you can implement cutting-edge data systems in a company making a real difference in healthcare? Do you want to be part of a mission-driven team revolutionising how healthcare teams communicate, while working in a hybrid setup that values collaboration … and flexibility? If you’re a Data Engineer with a passion for building scalable systems and solving complex data challenges, this could be the perfect role for you. What’s in it for you? You’ll receive a salary of up to £100K, alongside benefits including … parental leave, and even a policy that allows you to work abroad for short periods. What you’ll be doing As a Senior Data Engineer, you’ll be the first hire in this role, reporting directly to the Head of Data. This is a hands-on position where More ❯

Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Group's technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology … Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to … performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztec's ecosystem. Oversee the development of data pipelines, master More ❯

Data Engineer London £95,000 Harrington Starr is currently working with a leading payments business that is looking to hire a Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding existing data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to … must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data More ❯

About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will More ❯

ethos, we prioritize trust, transparency, and innovation in everything we do. About the Role: We are looking for a Machine Learning Engineer with Data Engineering expertise to help scale our platform. In this hybrid role, you’ll design data pipelines, develop ML models, and work across … data and AI systems to enhance our platform’s capabilities. If you thrive in a collaborative, fast-moving environment and want to make a real-world impact, we’d love to hear from you! Scope of Work: Machine Learning Engineering • Design, develop, evaluate, and deploy machine learning models … Optimize model performance based on key metrics for scalability, reliability, and real-world impact. • Build and maintain end-to-end ML pipelines, including data preprocessing, model training, deployment, and monitoring. • Work closely with cross-functional teams to integrate ML models into our SaaS platform for PAI and OSINT More ❯

Principal Data Engineer Hybrid - London – weekly office visit We’re working with a cutting-edge SaaS business that's revolutionising how organisations integrate systems, manage data, and deliver insights. This high-growth, product-led company offers a game-changing, AI-powered platform that’s driving digital … for their approach to high achieving professionalism balanced with a great work-life balance. About the Role We’re looking for a Principal Data Engineer to join a highly skilled team focused on delivering next-gen, data-driven solutions across complex enterprise environments. We’re looking … listening to and tailoring for clients. You’ll act as a platform superuser and thought leader, responsible for designing and delivering modular, reusable data architecture components that accelerate implementation and drive value for customers. This is a key opportunity to influence the development of industry-specific solutions for More ❯

Senior Data Engineer Quant Hegde Fund - London Our client, a leading quantitative hedge fund, is searching for its next Senior Data Engineer to join its London-based team. This is a fantastic opportunity to leverage a range of systems, including data libraries in Python … the most complex financial challenges and deliver high-quality returns for investors. Your day-to-day work will involve building and scaling global data lakes, optimising performance, and ensuring data completeness and quality. You will also be responsible for modelling large volumes of data for OLAP databases to support tailored data solutions for Quants and Traders. Key Responsibilities: Build global and scalable Data Lakehouse solution used by multiple trading desks Contributing to software and infrastructure design and implementation in the AWS cloud environment. Developing data pipelines More ❯

A leading UK consultancy is seeking an experienced Lead Data Engineer to join their growing team. This role is ideal for a technically strong, hands-on professional with proven experience designing and delivering modern data solutions-particularly within AWS environments-and leading technical teams. What You … ll Do: Design and build scalable data solutions using AWS services (Redshift, Glue, S3, Step Functions). Lead the development of robust ETL/ELT workflows with AWS Glue and Python. Manage and mentor Data Engineers and Analysts across multiple projects. Collaborate with DevOps to maintain … or consultancy environment. Strong hands-on experience with AWS data services and relational databases. Skilled in SQL, Python, and data pipeline development. Experience with CI/CD practices, DevOps tools, and serverless orchestration. Confident communicator with strong stakeholder engagement and consulting skills. Familiarity with Agile More ❯

Principal Data Architect Hybrid - London – weekly office visit We’re working with a cutting-edge SaaS business that's revolutionising how organisations integrate systems, manage data, and deliver insights. This high-growth, product-led company offers a game-changing, AI-powered platform that’s driving digital … for their approach to high achieving professionalism balanced with a great work-life balance. About the Role We’re looking for a Principal Data Architect to join a highly skilled team focused on delivering next-gen, data-driven solutions across complex enterprise environments. We’re looking … listening to and tailoring for clients. You’ll act as a platform superuser and thought leader, responsible for designing and delivering modular, reusable data architecture components that accelerate implementation and drive value for customers. This is a key opportunity to influence the development of industry-specific solutions for More ❯

Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to … tackle complex cloud-native engineering challenges. THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across … platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing scalable data lakehouse architectures using More ❯

Company Insight This is the opportunity for an exceptional Senior Data Engineer to join one of Europe's best performing systematic quant trading businesses. Since its inception, this firm has cemented a formidable reputation within the systematic trading space, having been recognised as one of 2024's top … performing funds. This is an organisation that prides itself on it's innovative data and tech driven investment approach implemented within their trading strategies. Such an unparalleled scientific approach has allowed the firm to build next-generation, scalable and fault-tolerant multi-asset trading and backend systems, generating … outstanding returns in the process and experiencing exponential growth. Key Responsibilities Technical Ownership and Accountability building global and scalable Data Lakehouse solution used by multiple trading desks across the entire front-office. Contributing into software and infrastructure design and implementation in AWS cloud environment. Developing data More ❯

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex … environments and collaborating with senior technical teams. This role falls inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. … Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple More ❯

A global Investment firm is embarking on a major enterprise-wide modernisation programme of work and requiring senior Data Architect to help shape the future of its data landscape. This high-priority initiative will see the organisation move from complex legacy systems to a modern, cloud … based environment , leveraging the power of Azure, Python, and Databricks . You will be central to designing the data architecture that underpins this transformation, ensuring data is scalable, secure, and built for both operational agility and strategic insight. Role Responsibilities: Design and implement robust, scalable data architecture on the Microsoft Azure cloud platform. Lead the adoption of Databricks and cloud-native tools to modernise legacy systems. Define data standards, domains, and governance frameworks to support business-critical functions like trading, risk, operations, and regulatory reporting. Build both real-time and batch data More ❯

Senior Data Engineer Location: London | Hybrid Tech Stack: Azure | Synapse | Databricks | Power BI Cloud Focus: Cloud-native + hybrid integration Salary: £80,000 - £100,000 + 20% bonus We’re hiring a Senior Data Engineer on behalf of a global financial services firm undergoing large-scale … and is critical to building scalable, secure data solutions using the Azure ecosystem. You’ll work across modern and hybrid environments, lead pipeline development, and play a hands-on role in shaping the firm’s data engineering framework — with real impact on decision-making, performance … and productivity. What You’ll Do Lead the design and build of end-to-end data pipelines on Azure Synapse and Databricks. Work with DevOps and Architecture teams to ensure seamless integration between cloud and legacy on-prem systems. Contribute to a cloud-native data engineering More ❯