26 to 50 of 141 Data Pipeline Jobs in the South East

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation who operate on a global scale. They are headquartered in … Oxfordshire, UK and also have offices throughout the UK, Europe and the US. The Role: We are looking for a driven and experienced Senior Data Engineer with extensive Databricks experience to join a rapidly growing in house Data team during an exciting period of change. This is a role where you can really make your mark … an Agile delivery environment, working closely with the Head of Data, Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from a wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of business units domestically More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for … security, and quality across all pipelines. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps Required More ❯

Craft: Data, Analytics & Strategy Job Description: Data Engineer – Core Data Models & Reporting King is a worldwide leader in mobile gaming, home to some of the most iconic casual games in history, including Candy Crush Saga, Farm Heroes Saga and Bubble Witch Saga. You will work alongside talented people from many crafts, in offices designed … for creativity, collaboration and fun in a team-first hybrid mode. With petabytes of data and billions of events generated every day, data sits at the heart of everything we do. The Core Data Models & Reporting team transforms this data into reliable, impactful and well-documented data products that support … a small collaborative team currently spread across Barcelona, London and Stockholm, working with engineers and analysts across Shared Tech and beyond. You will help build and maintain core data pipelines, improve existing products, and design clean, trustworthy data models that empower hundreds of users across King. Your Role Within the Kingdom Work closely with stakeholders to More ❯

the financial year (March 26) Start ASAP Active SC required Key Responsibilities Dashboard Development: Design and build interactive Tableau dashboards and reports to provide actionable insights for stakeholders. Data Engineering: Develop and maintain robust data pipelines, ensuring data integrity, scalability, and performance across multiple sources. Data Integration: Work with structured and unstructured … data from various internal and external systems, applying ETL best practices. Collaboration: Partner with analysts, data scientists, and business teams to understand requirements and deliver high-quality solutions. Performance Optimisation: Monitor and tune Tableau Server performance, ensuring efficient query execution and user experience. Governance & Security: Implement data governance standards and ensure compliance with Home … Experience Proven experience in Tableau development (Desktop and Server) with strong visualisation and storytelling skills. Solid background in data engineering, including ETL processes and data pipeline development. Proficiency in SQL and experience with relational databases (e.g., Oracle, PostgreSQL, SQL Server). Familiarity with cloud platforms (AWS, Azure, or GCP) and data warehousing solutions. More ❯

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions … of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You … ll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and … excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance … and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of More ❯

Role OverviewAs a Data Engineer, you’ll work closely with stakeholders to develop, test, and maintain data products and solutions that align with their requirements. You’ll be helping to develop a cloud-based data and analytics platform on Azure and help end-users integrate their workflows between this and other platforms, including AWS … based solutions. You’ll combine data from different sources, and you’ll build data pipelines to transform and organise raw data into formats that can be easily used for business intelligence as well as deep dive analysis and modelling. Interviews will be face to face in the London office. We are open to discussing … see the benefits we offer at Nest.For more information about our recruitment process click hereDirectorate/Department OverviewNest is at the beginning of a transformation to use its data and insight to drive decision making, and Data, Analytics and Customer Insight is leading how we do it: putting our customers at the heart of our work More ❯

Data Engineer Role Opportunity for a Data Engineer to join a scaling startup in the Education sector Salary up to £70k , depending on experience Fully remote role (Europe-based) Tech stack: Python, GCP, PostgreSQL, MongoDB, ML If you wish to keep your CV/data private, feel free to WhatsApp your details/CV … powered platform that helps university students prepare for exams and supports children in improving their reading and writing skills. As we continue to scale, we're expanding our data engineering capability to strengthen our AI-driven learning ecosystem. WHAT YOU WILL BE DOING: Design, build, and maintain ETL/ELT data pipelines and integrations to support … platform and analytics needs. Develop scalable, reliable data architectures using GCP, MongoDB, PostgreSQL, and Python. Collaborate with cross-functional teams to define and implement data models and storage strategies. DATA ENGINEER - ESSENTIAL SKILLS: Proven experience as a Data Engineer, Data Developer, or similar role. Strong experience with GCP (e.g. BigQuery More ❯

Data Software Engineer Role Opportunity for a Data Software Engineer to join a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4-5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep … your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE ARE: We're a fast-growing AI-driven technology company on a mission to transform how data and automation power smarter care and decision-making. Our intelligent platform leverages advanced AI, automation, and scalable data systems … to unlock powerful insights and efficiency across the healthcare ecosystem. Backed by strong Series A funding, we're expanding our technical team and looking for a Data Software Engineer to help shape and scale our AI infrastructure. WHAT YOU WILL BE DOING: Lead the development of an AI-driven data orchestration platform used to power large More ❯

Your New Role We're looking for an experienced Principal Data Engineer to lead the development and evolution of a modern enterprise data platform. This strategic, hands-on position involves architecting and optimising scalable data pipelines to support advanced analytics, AI/ML initiatives, and actionable insights across the organisation.You'll take full ownership … Acting as the technical authority, you'll define best practices, establish governance frameworks, and mentor engineers and analysts to maximise platform value.This is an opportunity to shape the data landscape and deliver solutions that empower decision-making and innovation. Key Responsibilities Platform Leadership: Design, implement, and manage Snowflake as the … enterprise data hub, ensuring scalability, security, and performance. Data Architecture & Strategy: Define frameworks for ingestion, replication, storage, and transformation across diverse data sources. Pipeline Development: Build efficient ELT pipelines using tools such as DBT and Python, integrating operational, financial, and network data. Performance Optimisation: Configure Snowflake warehouses and partitioning strategies for cost efficiency More ❯

accommodate the delivery of our expanding workload in support of the broader growth of the business. Linked to the steady growth of the business, we are evolving our data architecture to offer a modern data service with new data sources coming online and redeveloping our data warehouse to align with our projected … growth. The current team is small so the role will have exposure to colleagues across Ridge, representing the Data and Analytics team in conversations across the entire business' data estate. Therefore, the role has a broad scope of responsibility, requiring the individual to own projects themselves and deliver end-to-end solutions, with support and discussion … shared across the team. Responsibilities: Integrating new data sources into the data warehouse, and building in best-practice warehouse design Staging & shaping data from multiple data sources into reporting and analytical schemas Experience with data warehouse modelling, designed to accommodate future growth Creation of technical documentation, capturing development, processes & DW More ❯

Your Company: NET Recruit is assisting a distribution company in their search for an Apprentice Data Engineer based in the Kent area. Established over 40 years ago, this company has grown to become a leader in sourcing, producing, and distributing fresh produce to some of the UK’s top retailers. Known for its focus on quality, integrity, and … that its ongoing success depends on its people.As part of its ongoing investment in technology and digital innovation, the business is looking for an enthusiastic and motivated Apprentice Data Engineer to join its IT team, working five days per week. This position represents an exceptional opportunity for an individual with a passion for data, analytics, and … are actively encouraged. Your Role and Responsibilities While in this position your duties may include but are not limited to: Support the design, development, and maintenance of scalable data pipelines using tools such as Apache Airflow, dbt, or Azure Data Factory. Learn how to ingest, transform, and load data from a variety of sources More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Data Engineer, Azure London/Hybrid £competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to … be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities Work with Product Owners to establish product requirements. Design and … develop observable and secure data pipelines. Source, integrate and clean data using medallion architecture. Ensure data completeness, integrity and validity. Create Lakehouses and Warehouses. Optimise data pipelines, processing workflows and Fabric warehouses for performance. Maintain Data Catalogue and ensure data duplication does not occur. Ensure data More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

depending on experience) + benefitsSecurity: Must be able to undergo security clearanceAbout the RoleAs a Lead DataOps Engineer, you'll be at the forefront of delivering automated, scalable data solutions that power modern analytics and applications. This role combines the best of data engineering and DevOps, focusing on containerized environments, orchestration … and continuous delivery. You'll lead initiatives to streamline data workflows, optimize performance, and ensure reliability across cloud platforms-while guiding teams with strong technical leadership.Key Responsibilities* Pipeline Automation: Build and orchestrate data workflows using tools like Airflow, Prefect, or Dagster.* Containerization: Package and deploy data applications using Docker and Kubernetes (including EKS … your application with you before presenting it to any potential employer.Please note we are on the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security More ❯

Data Consultant Salary: Up to £70,000 I am working with a leading Microsoft partner that is currently recruiting for a Data Consultant to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering innovative solutions using the Microsoft Power Platform, Azure and emerging … technologies like Microsoft Fabric. Their mission is to help organisations unlock the full potential of their data through modern, cloud-first architectures. They are known for their consultative approach, working closely with clients to design tailored solutions that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they … are modernising data platforms to deliver future-ready solutions. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts and stakeholders to build platforms that drive insight and decision-making. In this role, you will be responsible for: Building and managing data pipelines using Azure More ❯

Data Engineer Remote (Occasional Travel to Birmingham) Up to £75,000 + Benefits (12 Months FTC) Are you a hands-on Data Engineer who enjoys building, maintaining, and optimising modern data systems? We're working with a well-established UK business currently going through a major transition period, and they're looking for a … Data Engineer to help ensure their data platforms, models, and pipelines continue to run smoothly during this exciting phase of change. This is a home-based role with occasional travel to Birmingham - ideal for someone who enjoys autonomy, technical variety, and the satisfaction of keeping complex data systems reliable and efficient. Why this role … Work across a modern data stack - from ingestion to visualisation - using Python, SQL, Meltano, and Power BI . Join a small, high-impact team supporting pricing, revenue, and market analytics. Play a key role in maintaining and optimising the business's data warehouse and dynamic pricing model . Gain exposure to Azure cloud , containerisation, and DevOps More ❯

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a … eek (NON Negotiable), the rest WFHDuration: 3 months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and More ❯

Your New Role We're seeking a Senior Data Engineer to help shape and maintain a modern enterprise data platform. In this role, you'll design and optimise scalable data pipelines and models that bring data from core business systems into Snowflake, enabling analytics, reporting, and data-driven insights across … pipelines and models in Snowflake to support analytics and reporting needs. Architecture Implementation: Apply defined data architecture standards to ingestion, transformation, storage, and optimisation processes. Pipeline Development: Develop robust ELT/ETL workflows using dbt and orchestration tools, ensuring reliability and maintainability. Performance & Cost Optimisation: Configure Snowflake warehouses and implement query optimisation techniques for efficiency. … What You'll Need to Succeed Proven experience delivering cloud-based data engineering solutions, ideally with Snowflake. Strong proficiency in SQL, Python, and dbt for transformations and pipeline automation. Practical experience with Snowflake features and RBAC management. Familiarity with ingestion tools (Airbyte, Fivetran, Hevo) and cloud services (AWS preferred). Solid understanding of data modelling More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior … Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data … scientists, economists, and technical teams to translate requirements into solutions. Communicate effectively with technical and non-technical audiences. Participate in code reviews and knowledge-sharing sessions. Automate pipeline deployments and implement CI/CD processes in collaboration with DevOps teams. Promote best practices for automation and environment management. Interested? Please submit your updated CV to Lewis Rushton More ❯

Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind … one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will … Design and build robust data pipelines to consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯