26 to 50 of 274 Data Pipeline Jobs in the South East

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

Senior Data Developer - Flexible location Bibby Financial Services have an exciting opportunity available for a dynamic Senior Data Developer to join our team, working in any of our UK locations . You will join us on a full time, permanent basis and in return, you will … an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained … engineering or a related field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There’s no More ❯

Senior Data Developer - Flexible location Bibby Financial Services have an exciting opportunity available for a dynamic Senior Data Developer to join our team, working in any of our UK locations . You will join us on a full time, permanent basis and in return, you will … an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained … engineering or a related field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There's no More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity … that is redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising … data pipelines, virtualised environments, and business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data More ❯

A leading consultancy firm dedicated to delivering transformative data solutions. They empower their clients to harness the power of data through innovative engineering practices, enabling them to make data-driven decisions and achieve their strategic objectives. They are seeking a Senior Manager for Modern … Data Engineering to lead and expand their data engineering practice. This role is designed for an experienced leader who is both technically proficient in data engineering and skilled in managing high-performing teams. The ideal candidate will be responsible for driving the development of … modern data pipelines, ensuring data accessibility, quality, and security while fostering a collaborative culture within the team. Responsibilities Lead and manage the Modern Data Engineering team, providing strategic direction and mentorship. Design and implement scalable, robust data pipelines and architectures that meet More ❯

Are you passionate about shaping data strategies that drive real change and innovation? Do you excel at designing scalable data solutions, implementing best practices, and leading the adoption of cutting-edge technologies? Could you be our next Data Engineer Architect, helping to enhance our … data-driven decision-making? At the IET, making our world a better place starts by creating a better place for our people. At the IET youll have more than just a job. Our work is exciting and challenging, connecting the people who solve the problems that matter. It … also making significant investments in our people, including providing a modern, vibrant workplace and embracing hybrid working. What youll be doing As a Data Engineer Architect, youll play a pivotal role in transforming The IETs data landscape, ensuring our data strategy and technology solutions More ❯

We are a leading multi-strategy systematic hedge fund based in London, leveraging advanced technology and data to drive our trading strategies. Our team includes top quantitative researchers, data scientists, and engineers, all collaborating to develop innovative solutions. We are seeking an AI Data Engineer to join our team, focusing on building and automating data systems that support AI-driven initiatives. Role Overview: As an AI Data Engineer, you will be responsible for designing, building, and optimizing data infrastructure to support AI and machine learning initiatives … within our trading strategies. You will develop and maintain data pipelines, ensure seamless data integration for AI models, and automate processes to improve efficiency. Your role will be pivotal in enabling the successful deployment and operation of AI-driven trading models. Key Responsibilities: Design, develop, and More ❯

Job Title: Head of Data & AI Salary - £140K Basic + £20K Bonus Key Responsibilities: Strategic Leadership: Define and execute the data strategy aligned with business goals, ensuring data assets are leveraged for maximum operational and commercial impact. Technology Ownership: Stay current with the latest … developments in AI/ML, Databricks, PySpark, and Power BI; evaluate and integrate advancements to improve data pipelines, data science workflows, and reporting capabilities. Data Infrastructure: Oversee the design, implementation, and optimization of data platforms and architectures, with a focus on scalability … dashboards and business intelligence tools using Power BI to provide actionable insights to internal teams and partners. Governance & Security: Ensure high standards of data quality, governance, and compliance with cyber security and regulatory standards. Required Skills & Experience: Minimum of 10 years of experience in data management More ❯

and research across shipping, trade, offshore and energy. Respected worldwide, the Clarksons Research team of over 150 experts provides powerful analysis, insight and data through a range of online platforms, reports, valuations and consultancy work. Clarksons Research is currently offering exciting opportunities for experienced data analysts … of the Clarksons Group, the world’s leading integrated shipping services provider and a FTSE 250 company. Clarksons Research is looking for experienced data analysts that are keen to take responsibility for delivering insights to clients based on wide ranging, interesting data sets using the latest … data science and analytical techniques, and building data pipelines to facilitate analysis. The Role - Use the latest data processing/analysis techniques and visualisation tools to deliver insights and develop an in-depth understanding of a dynamic and fast-paced industry central to the More ❯

care homes, placing independence and community at the heart of what we do. The Opportunity You will be the first person in our data team, giving you complete ownership of our data function. You will lead our data strategy and infrastructure, with the freedom … to start fresh or build on our early efforts. Our data is almost entirely in cloud-based systems (e.g. HubSpot, Xero), which we have begun integrating via Fivetran into a Snowflake data warehouse. We have three data critical systems that do not integrate with … we are open to your expertise. Hybrid role (based Cobham, Surrey & London)Over seven years of operating, we have collected a wealth of data that is just waiting to be fully harnessed. Now, we need you to lead the charge in transforming this data into something More ❯

We are looking for a Senior Data Engineer, to collaborate closely with our business and engineering teams to design, implement, and maintain data engineering solutions while ensuring security and data best practices. You will work need to be able to work independently and will … engineers. Experience of working within the Insurance/Insurtech/Payments sector would be highly advantageous. Duties & Responsibilities: Design, build, and maintain scalable data pipelines for batch and real time data handling large volumes of structured and unstructured data. Develop, enhance, and optimize ELT processes to … ingest, transform, enrich and publish data. Build quality, trusted, secure data products for consumption in reporting, analytics and science. Optimise data pipelines and queries for better performance and cost-efficiency. Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before More ❯

Job Title: Data Lead 💰 Salary: up to ~£110k + very generous equity (of the same value as your salary!) 🌴 Benefits include : unlimited AL, 2 company trips/year, contribution towards your own holiday 📍 Location: Shoreditch (2 office days/week) 💵 Industry: FinTech/Payments Company overview Having raised … company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire, you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise … in quantitative analysis to understand how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on More ❯

I am recruiting for an Associate, Software Engineer – Data Focus on behalf of a pioneering real estate investment technology firm. This team is building an AI-first application that leverages external data sources, machine learning, and modern data visualization to transform commercial real estate … decision-making. You’ll work alongside a highly collaborative team of software engineers, data scientists, and designers, building and maintaining robust data pipelines, driving innovation, and bringing digital intelligence to CRE investment analysis. We are looking for a talented software engineer to join our team in … and the ability to collaborate with cross-functional teams • Experience working with financial services or asset management domains preferred Technical Stack: Data Pipeline Stack: Python 3, pandas, GeoPandas, boto3, Pydantic, Data Version Control (DVC) 2 Core API Stack: Python 3, Django 4 Infrastructure: AWS, EKS More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

A high performing, multi-billion dollar AUM hedge fund are looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team … the hire will be working very closely with Operations, Product Control, Risk, Trading and Research teams to ensure the smooth transmission of data, in … a role that has a highly technical/engineer angle. You will optimize the operation and quality management of the internal data pipeline with oversight of raw data initially being onboarded through to the delivery of datapoints to front office/investment teams. You will More ❯

our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with … others passionate about solving business problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management … data architectures, such as Corporate DataLake, Medallion Architecture, Metadata Driven Platform, Event-driven architecture. Proven experience of ETL/ELT, including Lakehouse, Pipeline Design, Batch/Stream processing. Strong working knowledge of programming languages, including Python, SQL, PowerShell, PySpark, Spark SQL. Good working knowledge of data More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in … the morning, then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale … real time and scalable batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce More ❯

also responsible for ensuring collaboration and best practice sharing across the Paid Search community on all 3 product groups on Adobe. Key Responsibilities •Data Feed Integration and Maintenance •Identify all active data sources in the quarter, work with Data Engineering team to ensure data pipelines are setup, feed is populating data, refreshed periodically to ensure data availability for weekly processing •Experienced in working with digital and offline campaign datasets as well as experience in Adobe Analytics •Hands on experience with ETL (Extract, Transform, Load) and data … a clean dataset that can be used for weekly reporting •Good understanding of Python for automated/semi-automated processing as well as data joining logic (left, inner, outer, etc.) •Implement advanced data stitching techniques to combine data from multiple sources, creating a unified More ❯

for a talented Business Intelligence Analyst. This is an excellent opportunity for an analytical professional to play a key role in shaping a data-driven culture and supporting strategic and operational decision-making through impactful data insights. The Business Intelligence Analyst will be responsible for converting … complex data into actionable insights, creating clear and intuitive reports and dashboards, and ensuring stakeholders across the organisation have access to accurate, timely information. The successful candidate will collaborate with business and technical teams to deliver tailored data solutions, enhance reporting processes, and support continuous improvement … Excellent communication skills, with the ability to present insights to diverse audiences. Experience with Microsoft Azure data services and data pipeline optimisation (desirable). Rewards & Benefits: Competitive salary and performance-related bonus Bespoke induction and ongoing training Enhanced family leave and life insurance Healthcare cash More ❯

for a talented Business Intelligence Analyst. This is an excellent opportunity for an analytical professional to play a key role in shaping a data-driven culture and supporting strategic and operational decision-making through impactful data insights. The Business Intelligence Analyst will be responsible for converting … complex data into actionable insights, creating clear and intuitive reports and dashboards, and ensuring stakeholders across the organisation have access to accurate, timely information. The successful candidate will collaborate with business and technical teams to deliver tailored data solutions, enhance reporting processes, and support continuous improvement … Excellent communication skills, with the ability to present insights to diverse audiences. Experience with Microsoft Azure data services and data pipeline optimisation (desirable). Rewards & Benefits: Competitive salary and performance-related bonus Bespoke induction and ongoing training Enhanced family leave and life insurance Healthcare cash More ❯

p/day Hybrid working: 3 days in the office (City of London) The BA will: Gather and document business requirements for the Data Analytics & Reporting platform. Identify and resolve data-related issues and concerns by working directly with business teams. Capture and define data lineage, ensuring clear understanding of data flow from ingestion to reporting. Design and optimize data pipelines to ensure efficient data processing and analysis. Collaborate with technical teams to ensure proper data remediation and data quality. Utilise tools like … Knowledge & Experience Banking experience preferred. Expert in investigating manual processes and identifying opportunities for automation Knowledge of cloud environments (GCP) Strong understanding of data management, data governance, data analytics, MIS reporting and business intelligence concepts. Knowledge of SQL for data manipulation and More ❯

Data Engineer | Scalable Data Platforms | AWS & dbt Up to £90,000 London based 3x a week Are you a problem-solving Data Engineer who thrives in a fast-paced environment? Do you enjoy working with messy, inconsistent data and transforming it into … high-quality, scalable solutions? If so, this is the role for you. We are looking for a highly autonomous Data Engineer to design, build, and maintain a scalable, cost-effective, and reliable data platform . You’ll define the data engineering roadmap , introduce best … practices , and play a key role in shaping our data infrastructure as we grow. What You’ll Be Doing: ✔️ Own and improve the data platform, defining architecture and tooling. ✔️ Design and implement scalable, reliable data pipelines for ingestion, transformation, and processing. ✔️ Set up and More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's … enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development … and operational management of the data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision More ❯

Role : Data Engineer Location : London, UK (Hybrid) Salary : £40k–£55k (DOE) Are you passionate about building robust data infrastructure and enabling powerful analytics? Join a fast-paced, collaborative environment where you’ll help shape the future of data-driven decision-making across the business. … We are looking for a Data Engineer with a solid foundation in cloud technologies, data pipelines, and modern data architecture to support large-scale data solutions that drive business intelligence and analytics across the organisation. Your Responsibilities: Build data infrastructure … Design, develop, and maintain scalable and reliable data pipelines, warehouses, and lakes. Develop ETL/ELT workflows: Extract, transform, and load data from various systems to enable unified, high-quality datasets. Collaborate across teams: Work closely with brokers, technicians, and other stakeholders to understand data More ❯