1 to 25 of 107 Data Pipeline Jobs in the South East

Data Architect (Contract) London, England, United Kingdom It has been determined that this role falls outside of IR35 THE ALLSAINTS TEAM At AllSaints we are in the business of feelings - making our customers feel cool and confident. If, like us, you believe in the power of a great outfit, we'd love to talk to you. We're … are a brand embarking on a very exciting plan and we are seeking new members of the team who want to contribute to this. THE ROLE As a Data Architect (contract) for Project Nova, you will be instrumental in shaping AllSaints' journey to become a truly data-driven, AI-powered organisation. You will lead the design … techniques and tools Strong hands-on experience with cloud data platforms, specifically Google Cloud Platform - BigQuery Experience with leading ETL/ELT tools and data pipeline orchestration (e.g., Dataflow, Apache Airflow, Talend, Informatica) Advanced SQL skills and deep knowledge of various database technologies (relational, columnar, NoSQL) Practical experience in establishing data governance frameworks More ❯

and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You'll Be Responsible For: The More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Role: Head of Data Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £50,000 - £60,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

We are looking to hire a additional 2 Data Engineers to join the Satalia Data Engineering Team. We are investing massively in developing next-generation AI tools for multimodal datasets and a wide range of applications. We are building large scale, enterprise grade solutions and serving these innovations to our clients and WPP agency partners. As … Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. What you’ll be doing: Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists have … access to the data they need in the format they need it. Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools. Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently. Implement monitoring, troubleshooting, and maintenance procedures for More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while … enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

AWS Data Engineering Manager (1 Braham Street, London, United Kingdom) Recruiter: BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we … are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies. The AWS Data Engineering Manager plays a mission-critical role in enabling BT’s DD Ops transformation by leading the design, implementation, and optimisation of data infrastructure that powers intelligent … ready solutions. Data Quality & Visibility: Coordinate the use of internal and external data sources to define and monitor key indicators of data quality, pipeline health, and infrastructure performance. Resource Management: Allocate engineering resources effectively to address priority issues, ensuring timely responses and measurable outcomes. Translate business objectives into scalable, end-to-end data More ❯

We do energy differently - we do it all. We make it, store it, move it, sell it, and mend it. About your team: Youll be joining Centricas Group Data function, working in close partnership with our Data Science and Data Governance teams. Together, were building a data ecosystem that powers strategic decision … making and enables the creation of reusable, high-quality data assets across the business. About your role: As Head of Data Engineering , youll lead the design, development, and optimisation of Centricas data infrastructure. Youll define and execute a forward-thinking data engineering strategy, ensuring our pipelines and platforms are scalable, secure, and … aligned with business goals. Youll mentor a high-performing team, collaborate across departments, and champion best practices in data management, governance, and technology adoption. Youll also work closely with the Head of Data Science to ensure our infrastructure supports advanced analytics and modelling, enabling the organisation to harness data-driven insights effectively. Regular travel More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? • A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. • Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. • Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. • Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a … fantastic opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business to design, build, and support … scalable data infrastructure that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using Azure services Work with stakeholders More ❯

As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop, maintain, and More ❯

Role: Senior Data Engineer Salary/Rate: £600-700 per day inside IR35 Location: hybrid multiple locations available, 2 days on siteContract Duration: 4 months, potential to extend We are currently looking for a Senior Data Engineer for our government client. This Senior Data Engineer role is hybrid, based between 2 days per week … on site and the remainder of the week working remotely. Office locations include most major towns, with London being a preference. The contract for the Senior Data Engineer position is for 4-months with potential to extend, operating inside IR35. Security Clearance: Security Check ("SC Clearance") This role is inside IR35 - Due to the service of the role … it will now be based on an Umbrella solution. Essential skills/experience required: Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices Proficiency in Python and SQL for data engineering tasks Experience with DBT and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … contract, with strong potential for extension. This role is Outside IR35 and offers £450/day, requiring 2 days onsite per week in Central London. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data More ❯

Python Data Engineer Location: Farnborough (Hybrid) Employment Type: Full-Time, Permanent Salary: c£50,000We are recruiting on behalf of a leading organisation based in Farnborough, currently seeking a highly skilled Python Data Engineer to join their growing data team. This is a fantastic opportunity to work with cutting-edge technologies and play a … key role in the design, development, and optimisation of scalable data solutions. The Role As a Python Data Engineer, you will be instrumental in building robust data pipelines and maintaining cloud-based databases to support a range of business functions. Working closely with analysts and data scientists, you'll help solve complex … data challenges and contribute to the company's data-driven strategy. Key Responsibilities Design and implement efficient, scalable data pipelines using Python and SQL Server Develop, test, and deploy ETL workflows and data processing solutions using Docker containers on Azure Collaborate with data stakeholders to resolve data-related More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Role: Snowflake Data Architect Location: Hove, UK Type: Permanent Role Work Mode: Hybrid Role & Responsibilities Define and implement the end-to-end architecture of Data warehouse on Snowflake. Create and maintain conceptual, logical, and physical data models in Snowflake. Design data pipelines and ingestion frameworks using Snowflake native tools. Collaborate with Data Governance teams to establish data lineage, data quality, and access control mechanisms. Engage with data stewards and stakeholders to build a comprehensive and scalable data warehouse. Implement RBAC, data masking, and encryption practices to ensure compliance with data security policies. Qualifications & Skills 10+ years of experience … in designing enterprise data platforms, with at least 5+ years in Snowflake. Strong expertise in SQL and data warehousing. Hands-on experience working in the insurance industry; prior experience with L&G is an advantage. 3+ years of experience with DBT for data transformation. Deep understanding of agile methodologies in data environments. More ❯

Job Title: Graduate Data Engineer Location: Brighton, UK About Us: We are a dynamic and innovative technology consultancy based in Brighton. We specialise in providing cutting-edge solutions to our clients, enabling them to leverage data for strategic decision-making and operational efficiency. Our team is composed of talented professionals who are passionate about technology and … committed to delivering exceptional results. Job Description: Position Overview: We are seeking a highly motivated and enthusiastic Graduate Data Engineer to join our team. As a Graduate Data Engineer, you will be an integral part of our data engineering team, working on a variety of projects that involve data collection, transformation, and … analysis. This is an excellent opportunity for a recent graduate to kick-start their career in data engineering within a supportive and collaborative environment. Key Responsibilities: Assist in the design, development, and maintenance of data pipelines and ETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and More ❯

Data Engineer Application Deadline: 18 August 2025 Department: Information Technology Employment Type: Permanent - Full Time Location: Southampton Reporting To: Head of Data Description Zenergi supports and empowers our customers' journey to net zero. With a unique range of services, we tailor sustainable solutions for all our customers. What sets us apart? We drive major reductions in … can during their Zenergi journey. We are committed to providing a positive environment where people can grow and develop both professionally and personally. About the role As a Data Engineer at Zenergi, you will work as part of the Data Team to help support the wider business to meet their reporting and data requirements. … Working with the latest innovative technologies, you will work to design, build and maintain data solutions, constructing process to surface data both internally for reporting purposes and externally through the customer portal. You will be responsible for developing scalable data pipelines to integrate diverse data sources whilst ensuring data quality More ❯

UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems.To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain-ensuring scalability, quality, and performance.Develop data architectures and models (especially graph-based … that support seamless integration of infrastructure, operational data, and business intelligence.Define and enforce data solution standards, ensuring technical consistency and reuse across programmes.Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies.Manage stakeholder engagement to translate complex data requirements into clear, actionable solutions-communicating both technical More ❯

Data Architect ££105,000 - £115,000 GBP Hybrid WORKING Location: London, Central London, Greater London - United Kingdom Type: Permanent Data Architect Location: London (Hybrid) Salary: Up to £115,000 About our client: Our client is a global technology consultancy delivering transformation across data, digital, and infrastructure. Known for driving cutting-edge solutions across both … systems at national scale and pride themselves on technical depth, agile delivery, and a culture of collaboration. The Opportunity: This is a deeply technical role for a skilled Data Architect to join a high-performing engineering team focused on the design and implementation of robust data models within analytical and real-time domains. You'll work … across multiple consulting engagements with cross-functional teams, building modern, scalable data architecture from the ground up. Important: To be considered, you must currently hold active Security Clearance or have previously held Security Clearance . Additionally, you must have demonstrable experience delivering consulting engagements end to end - from discovery through to implementation - across client environments. What You'll More ❯

Job Title: Oracle Data Warehouse Architect Pay Rate: £415.16 PWD via Umbrella Location: London Hybrid model: 3:2 - Office: Home Length of Contract: 6 Months About Client: Headquartered in Tokyo, this banking group is Japan's second largest and a globally recognized financial institution with around US?$2 trillion in assets. Operating in nearly 40 countries with over … drives major green and social initiatives while embracing digital innovation, including AI tools, to enhance efficiency and client experience. About the Role: We are seeking an experienced Oracle Data Warehouse Architect AVP to design, optimize, and maintain high-performance, scalable Oracle-based data warehouse solutions. This role is integral to supporting business intelligence and analytics initiatives … and optimize complex SQL and PL/SQL scripts. Provide guidance on data modelling, indexing, and partitioning strategies. Troubleshoot and resolve performance, ETL, and data pipeline issues while maintaining data quality. Support .NET development teams with day-to-day database issues and liaise with global DBA teams. Follow Change Management Control procedures for More ❯