26 to 50 of 123 Data Pipeline Jobs in the South East

AWS Data Engineer - Contract Duration: 6 months Location: Mostly remote (occasional office visits) Rate: £500-£550 per day (Outside IR35) I'm partnering with a global consultancy that is looking for a Data Engineer to enhance its evolving data infrastructure and drive operational excellence. This is a hands-on role where you'll play … a key part in business-critical operations, tackling complex data challenges, supporting cross-functional initiatives, and improving core data systems. As a central member of the data team, you'll be responsible for building and maintaining scalable data pipelines, resolving data quality issues, and collaborating closely with analysts, engineers, and … stakeholders. If you thrive in a fast-paced environment and enjoy optimising data systems, this could be a great match. Key Responsibilities: Design, develop, and maintain scalable data pipelines for both operational and analytical needs Ensure high data integrity through best practices in validation and quality assurance Investigate and resolve data issues More ❯

We are looking for a Data Engineer to play a key role in advancing FDM’s enterprise data platform and business intelligence capabilities. This is a hands-on, technical position focused on designing, building, and maintaining robust data pipelines and developing interactive visualisations that deliver impactful, data-driven insights across the business. … This is a hybrid role based in Brighton . You’ll collaborate closely with a team of analysts to develop scalable solutions using Microsoft Fabric components such as Data Pipelines, Lakehouse, and Power BI. You will also gain deep expertise in our data ecosystem, integrating data from systems like Salesforce, SAP, and other internal … platforms to enable end-to-end data visibility. This role is ideal for someone who thrives in a fast-paced, agile environment and enjoys creating high-quality data solutions that empower decision-making across the organisation. Key Responsibilities Design, build, and maintain data pipelines and ETL processes to deliver analytics and reporting. Develop and More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

Data Integration Engineer £Up to £700 Inside IR35 GBP Onsite WORKING Location: Bristol, South West - United Kingdom Type: Permanent Software Engineer/Data Integration Engineer - National Security & Government Up to £700 Inside IR35 Location: London or Bristol Our client is a trusted digital consultancy working at the heart of national security, law enforcement, and defence. They … deliver secure, mission-critical software and data solutions that help protect the UK and its interests. With a strong focus on innovation, collaboration, and agility, they empower engineers to solve complex challenges in high-trust environments. As a Data Integration Engineer , you'll work across data pipelines, APIs, and backend services to ensure data … Strong understanding of API design and integration techniques (REST, Webhooks, GraphQL). Familiarity with authentication protocols (OAuth2, JWT). Experience with ETL/ELT frameworks and data pipeline tools. Solid understanding of relational and NoSQL databases. Hands-on experience with AWS cloud services and integration tools. Strong debugging, analytical, and communication skills. Comfortable working in agile development More ❯

to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key … e.g., star/snowflake schemas) Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support groundwork for future data … requirements clearly across business teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments and when translating complex business needs More ❯

Data Engineer (Power BI) | 6 Month Contract | Outside IR35 We're seeking a Data Engineer with experience in Power BI to help build and optimise data pipelines and deliver high-quality datasets for business intelligence. You'll ensure that large, complex data flows seamlessly into the reporting layer, enabling analysts and stakeholders … to uncover insight. Location: London Contract: 6 Months (OIR35) Rate: £325-400 p/day Key Responsibilities: Designing and maintaining scalable ETL/ELT pipelines . Integrating data from multiple sources into a centralised warehouse (SQL Server, PostgreSQL, or Snowflake). Working with Azure Data Factory and cloud-native tooling for data orchestration. Structuring … data models to support Power BI dashboards and reports. Implementing data governance, quality frameworks, and security controls . Partnering with analysts and product owners to align engineering outputs with business requirements. Key Skills: Strong SQL skills and experience with relational databases. Hands-on experience with Azure (ADF, Synapse, Data Lake) or AWS/GCP More ❯

We are seeking a highly experienced SAP Data & Analytics Lead with 10–12+ years of expertise in SAP data solutions, particularly SAP Datasphere and SAP Analytics Cloud (SAC). The ideal candidate will have strong functional and technical experience in Finance data modeling and analytics, along with hands-on development skills. A proven ability … to lead design, implementation, and end-to-end delivery of SAP Data & Analytics solutions is essential. Responsibilities: Lead the design, architecture, and implementation of enterprise-level data models and analytics solutions using SAP Datasphere and SAC. Build, optimize, and maintain data pipelines, ODS models, and data integration(In/out) in Datasphere … for various Finance and cross-functional domains. Collaborate closely with Finance stakeholders to understand requirements and translate them into scalable, efficient data models and analytical reports. Provide hands-on development in Datasphere, data fabric, and SAC, including advanced calculations, KPIs, and dashboarding. Establish best practices for data governance, lineage, and security within Datasphere and More ❯

Senior Data Engineer London | Permanent | Full-Time | Hybrid Working An excellent opportunity has arisen for a Senior Data Engineer to join a respected, international insurance and analytics organisation. In this role, you will design, develop, and maintain data solutions that enhance underwriting and claims decision-making, support operational improvements, and drive data-driven strategies across multiple specialty lines. This position is ideal for an experienced data engineering professional with strong insurance sector knowledge, looking to make a significant impact in a high-profile analytics function. About the Team The data and analytics team works across multiple international specialty lines, including cyber, energy, equine, marine, professional and … financial risks, trade credit, political risk and surety, and international casualty. Its remit covers: Data engineering and analytics Portfolio management Pricing model development The team is embedded within underwriting operations and plays a key role in achieving profitability and performance targets. What You'll Bring A collaborative, proactive, and solutions-focused mindset. Ability to influence and engage with More ❯

Lead Data Engineer - Overview: We're looking for a visionary data leader to shape the future of data for a leading bank. Join now if you want to spearhead the delivery of a next-generation data platform, built on a modern Azure-Databricks ecosystem, unlocking the full potential of advanced analytics, machine … learning and AI across the business. The Role: Are you a proven data engineer, looking to step into an exciting leadership position? Reporting directly into the head of data, this position will allow you to use your Azure experience throughout exciting transformation projects and to shape the journey of the bank. Your expertise will be used … learning & AI implementation - experience delivering machine learning and AI solutions, ideally within Databricks. Strong data governance knowledge- in-depth knowledge of data governance best practices. Pipeline engineering & monitoring expertise - skilled in building and orchestrating scalable data pipelines, with experience implementing using Azure-native tools. Exceptional stakeholder & communication skills - able to clearly articulate complex More ❯

Data Analytics Engineer Permanent Basingstoke (Hybrid - x2 PW) Up to £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working … with modern tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and More ❯

Data Engineer - Hybrid (London-Based) Full-Time A leading creative technology company is seeking a skilled Data Engineer to join its data team. This role is ideal for someone passionate about building scalable data infrastructure and enabling data-driven decision-making across the business. Role Overview As a Data Engineer, you'll be responsible for designing and maintaining robust data pipelines and models that support analytics and reporting. You'll work with diverse datasets and collaborate with cross-functional teams to ensure data is accurate, accessible, and actionable. Key Responsibilities Build and maintain scalable ETL/ELT pipelines. Design data models … and schemas to support analytics and reporting. Integrate data from APIs, internal systems, and streaming sources. Monitor and ensure data quality and availability. Collaborate with analysts, engineers, and stakeholders to deliver clean datasets. Optimise data architecture for performance and reliability. Share best practices and contribute to team knowledge. Required Skills 3+ years in a More ❯

every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity We're looking for a skilled Data Lake Reporting Assistant Manager to join our team and play a key role in developing and maintaining our data lake reporting environment. You'll work closely with … experienced data analysts and engineers to deliver impactful reports that help us understand our business better. Key responsibilities include: Collaborate closely with senior data analysts and engineers, contributing to the development and implementation of our reporting strategy. Learn and apply industry best practices for data warehousing, reporting, and visualization. Data Lake Reporting … Environment: Become proficient in navigating and understanding data lake architecture. Assist in implementing data quality checks and validation processes to ensure accurate and reliable reporting. Work alongside data engineers to understand and optimize data pipelines for reporting needs. Translate business requirements into technical specifications for reports and dashboards, working with senior team More ❯

Azure Data Engineer London - 5 Days a Week Up to £100,000 + Benefits Are you passionate about building robust, high-performance data platforms? We're seeking a Data Engineer to join a growing technology team, driving the modernization of legacy systems and the development of scalable, cloud-native solutions. This is a high … visibility role with the opportunity to make a direct impact across the business. Why this role? Work on mission-critical data projects with visibility across the organisation. Help drive the modernisation of the data platform , leveraging Azure and modern data engineering practices. Be part of a collaborative, high-performing engineering culture where data is treated as a product. Influence architectural decisions and shape the company's long-term data strategy. What you'll be doing: Designing, developing, and owning scalable data pipelines and APIs . Building infrastructure for optimal ETL/ELT processes across diverse data sources. Working with Azure, dbt, SQL, and Python to More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines … and integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows More ❯

Company Description At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and … the worlds leading job-tech platform. Job Description The role of Product Analytics Manager in our company is at the intersection of several disciplines: Product Analytics, Insights Analytics, Data Engineering and Data Science. Your teams projects will cover a broad range of topics, from working with engineers to implement event tracking on our platforms, all the … way to generating data insights and sometimes building predictive models, ultimately helping our Product organisation deliver great products, which solve meaningful user problems. You and your team are part of a larger Product Analytics group, and will be working closely with Product Directors, Heads of Product, Data Engineers, Data Scientists and many other stakeholders More ❯

Head of Data Platform Hybrid - South London Up to £110,000 + Bonus + Benefits Are you a data leader ready to shape the future of a modern cloud data platform? We're seeking a Head of Data Platform to spearhead a major migration project and lead a talented data engineering team at a fast-growing, tech-driven business. Why this role? Lead the migration of an existing Azure data warehouse to Google BigQuery , creating a scalable, modern platform to power analytics, BI, and data science. Join a collaborative, people-first culture that's been recognised as a Great Place to Work for 5+ … work from home. What you'll be doing: Own the end-to-end migration to BigQuery, working with both internal teams and implementation partners. Define and evolve the data platform strategy, governance, and roadmap. Manage and mentor a team of data engineers, fostering excellence and collaboration. Drive adoption of modern data engineering practices: CI More ❯

Data Analyst Elephant & Castle Our client is seeking a detail-oriented and analytical Data Analyst to join their team. The ideal candidate will be responsible for collecting, processing, and analyzing data to help drive strategic business decisions. You will work closely with cross-functional teams to deliver insights that improve operational efficiency, enhance customer … experience, and guide business growth. Key Responsibilities: Collect, clean, and validate data from various sources. Analyze complex datasets to identify trends, patterns, and actionable insights. Create data visualizations and dashboards using tools like Excel, Tableau, Power BI, or similar. Develop and maintain reports to support business performance monitoring. Work with stakeholders to define key performance indicators … KPIs) and reporting requirements. Use statistical tools and techniques (e.g., regression analysis, hypothesis testing) to support data-driven decision-making. Collaborate with data engineers and IT to ensure data integrity and optimize data pipelines. Present findings to stakeholders in a clear and concise manner, both visually and verbally. Maintain documentation of data More ❯

General/Usage VMWare General/Usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3 … MinIO, LakeFS CI/CD Pipeline, Integration, ideally Azure DevOps Python Scripting API Management Solutions Automation Key Skills Experience in the Design/Configuration/Usage in a number of the following - Low-code Platforms, such as Power Platform, Appian, UiPath, Blue Prism RPA and Automation solutions Experience in Business Process Analysis Software, Applications, APIs Apps Design and Integration … Key Skills Experience in the Design/Configuration/Usage in a number of the following - Software/API/Web Design and Development Database Design and Data Modelling Architectural Patterns such as OO, Cloud-native and Microservices. Automated Test tooling, ideally Selenium/Robot Framework DevSecOps Key Skills Experience in the Design/Configuration/Usage in More ❯

Senior AWS Data Engineer - London - £125,000 Please note - this role will require you to work from the London based office. You must have the unrestricted right to work in the UK to be eligible for this role. This organisation is not able to offer sponsorship. An exciting opportunity to join a greenfield initiative focused on transforming how … market data is accessed and utilised. As a Senior AWS Data Engineer, you'll play a key role in designing and building a cutting-edge data platform using technologies like Databricks, Snowflake, and AWS Glue. Key Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes. Design secure, high-performance data architectures. Develop processing and analysis algorithms for complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and More ❯

Data Engineer - Azure Specialist London - 5 Days a Week £80,000 - £100,000 + 10% Bonus Company Our client is a well-established insurance group , recognised for its commitment to innovation and technology-driven transformation. They are seeking a skilled Data Engineer (Azure Specialist) to join their high-performing technology team. This is a fantastic opportunity … to work on mission-critical projects with visibility across the entire business, while shaping the group's data strategy and infrastructure for the future. Responsibilities Design, develop, and own robust, high-performance data pipelines and APIs. Build scalable data infrastructure using Azure technologies, SQL, and dbt. Assemble and manage large, complex datasets to meet … business requirements. Define and document cloud solution architectures, technical designs, and testing processes. Take ownership of data quality and drive opportunities for continuous improvement. Partner with stakeholders across the organisation to support business intelligence and data science initiatives. Troubleshoot and resolve data management issues while contributing to architectural decision-making. Experience Needed Bachelor's More ❯

Excellent opportunity for a veteran Data Engineer ready to take the lead on large-scale, data-driven projects. This is an exciting opportunity to step into a senior role where youll design and deliver innovative solutions, mentor teams, and shape the future of data engineering within a forward-thinking environment. What youll be doing … As a Lead Data Engineer, youll play a hands-on role in designing and developing data processing and persistence software components that handle data at scale. Youll work within agile teams, leading engineers, driving best practice, and ensuring robust, high-quality solutions that meet user needs. Your responsibilities will include: Designing, coding, testing, and … troubleshooting complex data components and subsystems. Leading development practices, ensuring performance, security, and operational readiness. Mentoring and coaching team members, helping them to grow and deliver to a high standard. Working closely with architects on data pipelines (ETL/ELT) and distributed data frameworks. Driving technical proposals, advising on effort estimates, and contributing to More ❯

Senior Data Engineer - London (Hybrid 3 to 4 days) Type: Full-time Location: London, UK Help Build the Future of Data in Financial Services A leading financial services client is growing its data engineering team and is looking for experienced engineers who are passionate about building scalable, high-quality data systems. This … that values clean code, continuous learning, and strong engineering principles. What You'll Be Doing You'll be a key contributor to the development of a next-generation data platform, with responsibilities including: Designing and implementing scalable data pipelines using Python and Apache Spark Building and orchestrating workflows using AWS services such as Glue , Lambda , S3 … CI/CD , version control , automated testing , and modular design Supporting the development of a lakehouse architecture using Apache Iceberg Collaborating with product and business teams to deliver data-driven solutions Embedding observability and quality checks into data workflows Participating in code reviews, pair programming, and architectural discussions Gaining domain knowledge in financial data More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯