151 to 175 of 278 Data Pipeline Jobs in the South East

to maximize performance while maintaining cost efficiency Governance and Versioning Systems : Establish best practices for model versioning, reproducibility, and responsible AI deployment Integrated Data Pipelines : Utilize Databricks to construct and manage sophisticated data and ML pipelines Monitoring Ecosystems : Implement comprehensive monitoring systems to ensure reliability and … Azure) and managed AI/ML services Practical experience with Docker, Kubernetes, and container orchestration Databricks expertise, including ML workflows and data pipeline integration Familiarity with MLflow, DVC, Prometheus, and Grafana for versioning and monitoring Bachelor's or Master's degree in Computer Science, Engineering, or related … enjoy mentoring junior team members and elevating the entire technical organization What Makes This Opportunity Special You'll be working with a modern data stack designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is your chance to make a More ❯

leading mid-market funds. With this investment, the business is going through a digital transformation strategy and is now looking to drive a data-focused culture across the organisation. As the first data hire, you will work closely with the CFO and CTO to help navigate … and develop the data roadmap in both the short term and long term. You will serve as the hands-on expert responsible for optimising data structures, performing cleansing from diverse sources to enable concise reporting in Tableau, and constructing as well as maintaining pipelines. Role: As … the technical expert, you will be responsible for creating a transformation layer mapping raw data to data marts to support analysis. You will have the opportunity to work closely with the executives, including the CFO and CTO as well as the PE Fund. You will be More ❯

tool for drug discovery. Our patient data, biobank and biomarker technology have led to the creation of an in-house drug discovery pipeline for cancers with high unmet need. We are a VC-backed start-up based in London, England and Natick, Massachusetts. To grow our company … we’re looking for a Senior Data Scientist with experience in biotech to join our early-stage team. Will you be the one? Job Description This role offers an opportunity to apply your expertise in data science, machine learning, and statistical modeling to oncology-focused target … identification and drug discovery . You will work with diverse datasets, from different sources including genomics, transcriptomics, proteomics, and high-content imaging data, to support the identification of cancer targets and the development of novel therapeutics. You will be part of the Software Team and support wet-lab More ❯

projects Help shape the data roadmap from early foundations to advanced maturity. What you'll bring: Strong SQL and data pipeline understanding (you will work with data engineering teams rather than being hands on coding pipelines). Proven experience building dashboards and defining … KPIs. Comfortable with data flows, table mapping, and metric definitions. Stakeholder confidence – you’ll work with both editorial teams and global tech leads. Experience in media, publishing, or mobile product analytics preferred. Ability to manage ambiguity and thrive in a fast-changing environment. Why apply? High-impact, high More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … so, you might be the idealcandidate for the role in the Data and Analytics function forGlobal Pet Nutrition (PN) atMars. Pet Nutrition (PN) isthe most vibrant category in the FMCG sector. As we work totransform this exciting category, a new program, Digital First, hasbeen mobilized by the Mars … thought leadership, quality decisionmaking, deep technical know-how, and an ability to navigate complexbusiness challenges while building and leading a team of worldclass data and analyticsleaders. With Digital First,PN is moving to a Product based model to create business facingdigital capabilities. Develop and maintain robust data More ❯

join our consulting practice. In this role, you will act as a strategic advisor to clients, leading the design and delivery of advanced data solutions leveraging the Databricks Lakehouse Platform. You will partner with business and technical stakeholders to modernize data ecosystems, enabling data … Strategy: Serve as the primary Databricks expert in client engagements, advising on architecture, best practices, and use cases. Lead discovery sessions to assess data maturity and define tailored data modernisation strategies. Translate business requirements into scalable technical architectures and roadmaps using Databricks and cloud technologies. Solution … Leadership: Design and oversee implementation of data platforms and AI/ML solutions on Databricks. Drive end-to-end project delivery in collaboration with cross-functional teams (data engineering, cloud, analytics). Ensure solution quality, performance, and governance through robust architecture design and code reviews. Team More ❯

Lead Data Engineer ( Databricks ) London - Hybrid - Remote Permanent £100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution About the Role We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements. This is … build capacity for future growth. What You’ll Be Doing Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks. Architect robust, scalable data platforms using the medallion architecture. Translate business requirements into scalable workflows, advising on data governance, quality, and security. Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog. Guide teams in implementing best practices across engineering, DevOps, and model deployment. Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps. Provide technical leadership More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning More ❯

Role: Principal Data Engineer Type: Permanent Location: Hampshire, London (Hybrid Working) Salary: £80,000 - £90,000 + Benefits Are you an experienced Data Engineer ready to take the next step into a strategic, hands-on leadership role? This is a fantastic opportunity to join a well … in general insurance and part of a larger European group, with a UK presence that continues to grow. With significant investment in their data and technology function, theyre now looking to bring on a Principal Data Engineer to help shape and evolve their data … infrastructure and engineering capability. The Opportunity: This is a pivotal role where youll lead on the design, delivery, and optimisation of scalable, secure data systems that support the wider business strategy. Youll be part of a collaborative tech environment, working closely with cross-functional teams and mentoring fellow More ❯

Data Engineer – Leading UK Insurance Business | Up to £100k + Bonus Join a top-tier insurance company at the forefront of digital transformation. We're looking for a skilled Data Engineer to drive innovation and efficiency across our data platforms using the latest in … Azure technology. What We're Looking For: Strong experience with Azure data services (e.g. Data Factory, Synapse, Azure SQL, etc.) Ideally experienced with Databricks Experienced with Python Industry background in insurance, financial services, or a similar regulated environment Passion for building scalable, secure, and high-performance … data pipelines What’s In It For You: Competitive salary up to £100k + discretionary bonus Hybrid working model Work with cutting-edge tech in a collaborative, forward-thinking team Opportunity to shape data strategy in a leading insurance firm Interested? Apply now or get in More ❯

written and verbal communication skills. Desirable (bonus points for each of these) Experience of Industrial Automation and Control Engineering Experience with ETL/data pipelines Experience of integrating with technology similar to databricks, PowerBI, Aveva PI Database schema design Experience of creating Windows installers Experience of GUI development More ❯

Job Title : Sustainability Manager | Data Duration : Permanent Hours : Full time 36.25hrs per week Line Manager : CEO Location : London, UK (Hybrid) Salary : £42K - £50K depending on experience with 10% discretionary bonus based on total company revenue performance and new business generation. Opportunity Considerate Group is seeking a dynamic and … versatile Manager, Data Partnerships to co-lead the delivery and commercial growth of Con-Serve™, our flagship sustainability data platform built specifically for the hospitality sector, together with a related suite of technical advisory services. The successful applicant will have a technical background, layered with commercial … technical projects related to carbon reporting, energy assessments, decarbonisation strategies, and more. Together, you will be responsible for overseeing the full lifecycle of data projects—from designing reproducible data pipelines to providing high-quality client support and strategic guidance. In addition, you will manage and mentor More ❯

Job Title: Senior Data Analyst Location: London, UK/Hybrid Must have experience working within the Lloyd’s of London market My client, a global leader in financial and insurance services, is seeking a Senior Data Analyst to join their growing international data team. … This role offers the opportunity to contribute to strategic, high-impact data initiatives across multiple global locations. What You’ll Be Doing You’ll play a key role in delivering high-quality data solutions across the business. Responsibilities include: Designing and leading the development of data pipelines, ETL processes, and reporting dashboards Ensuring data integrity and consistency through effective governance practices Supporting key projects across insurance, credit risk, and financial services Collaborating with global stakeholders using Agile methodologies Mentoring junior team members and helping shape the group’s data strategy More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

PR review and architecture discussions Desirable (but not essential): Event-driven architecture (e.g., SNS, SQS, EventBridge) AI/LLM integration (Python experience welcome) Data pipelines and ETL workflow knowledge Experience scaling cloud services and optimising for performance and cost in serverless environments Location & Flexibility: This is a London More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for … an Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead … alongside individuals from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for … an Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead … alongside individuals from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

Data Engineer Term: Full-time, Permanent Location: High Wycombe with hybrid remote working available Salary: £50000 - £65000 pa depending on experience + excellent benefits Focusrite are looking for an experienced data engineer to join our business intelligence team. You'll help us build and maintain a … robust yet flexible data stack, delivering high quality information where it's needed (and keeping it secure where it's not!). We make extensive use of SQL, dbt, Snowflake and Power BI, as well as various other tools. We work closely together using pair programming, peer review … to learn new things, independently and from each other. We are looking for someone who: Is an SQL expert, able to quickly identify data issues with a pithy query. Has opinions about permissions, schemas, APIs and models, and can share them collaboratively. Knows how to structure, profile and More ❯

tier quants, engineers, and analysts, contributing to systems that power critical investment decisions globally. 🧠 What You’ll Be Doing 📊 Design and develop scalable data pipelines for trading and quantitative analysis 🔧 Automate complex workflows to enhance performance and reduce friction 🤝 Work closely with cross-functional teams to build efficient More ❯

Conduct independent research to identify opportunities and inefficiencies in financial markets. Create portfolio optimisation tools and risk management models. Maintain and improve codebases, data pipelines, and database integrations. Enhance automation of processes and integrate AI-driven solutions where applicable. Collaborate with IT and investment teams to optimise internal More ❯

Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world … and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end More ❯

Data Analyst – City of London – Leading Brokerage – (£80k-£100k)+ Bonus Our client is a leading Brokerage who are looking to enhance their Data team with the addition of a talented Data Analyst in London to join their Operations department in a newly created … financial products and the trading life cycle. The role Advanced proficiency in SQL (T-SQL, PL/SQL, Databricks SQL) Knowledge of Kimball data modelling methodology Experience using scripting languages such as Python, PowerShell etc. Experience with Microsoft Azure. Strong knowledge of ETL/ELT tools and experience … navigating data pipelines. Advanced Power BI (Modelling, Visualisation, Security, Platform Architecture and Administration) Strong trade lifecycle experience If you are looking for any further information, please reach out to james.platt@harringtonstarr.com More ❯

to drive business intelligence and cloud cost optimisation across our organisation. This role will play a key part in designing, developing, and delivering data-driven solutions that enable smarter financial and operational decision-making. Working closely with stakeholders across Operations, Finance, Delivery and Leadership teams, you will translate … deploy tailored Power BI dashboards and automated reports, covering areas such as cloud expenditure, budgeting, forecasting, and operational performance. Build and maintain robust data models, DAX measures, and transformations to support reliable and efficient reporting. Provide regular insights and recommendations to support data-driven decision-making … across the organisation. Collaborate with data engineering teams to ensure seamless data integration and high-quality data pipelines. Apply AI and machine learning models to surface predictive insights, detect anomalies, and identify optimisation opportunities within financial and operational datasets. Required Skills and Experience: Minimum More ❯

Data Engineer (Tech for Good) Hybrid – London Office & Home-Based Up to £68,000 per annum Are you a skilled data engineer looking to make a real-world impact? Join a fast-growing tech-for-good company using data to drive positive change for … people and the planet. We’re looking for a mid-level Data Engineer with 3–4 years of experience to help shape and scale our data platform, supporting socially responsible projects across the organisation. Your Role: Develop and maintain cloud-based data pipelines (real … time & batch) Design data models and ETL/ELT processes using AWS, Snowflake, etc. Collaborate across technical and non-technical teams Troubleshoot issues and support wider team adoption of the platform What You’ll Bring: Proficiency in Python, PySpark, Spark SQL or Java Experience with cloud tools (Lambda More ❯