1 to 25 of 129 Permanent Data Pipeline Jobs in the South East

Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! About the Role : We are seeking a Senior Data Engineer to join our growing data engineering team. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and infrastructure … that power analytics, machine learning, and business intelligence across the organization. You will work closely with data scientists, analysts, and platform engineers to ensure robust and efficient data delivery. This is an excellent opportunity for someone who is passionate about data, cloud technologies, and scalable systems, and wants to have a direct impact on … data-driven decision-making. Key Responsibilities: Design, build, and maintain scalable and reliable ETL/ELT data pipelines using Python, PySpark, and SQL. Develop and manage data workflows and orchestration using tools such as Airflow or similar. Optimize data processes for performance, scalability, and cost-efficiency, particularly in cloud environments. Collaborate with More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf)Salary: £115000 - 120000 A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities … Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies.* Implement robust data governance, quality, and security practices.* Collaborate with data scientists to deploy machine learning models.* Lead or contribute to strategic planning, risk management, and stakeholder engagement.* Drive innovation through advanced analytics and research-based problem solving. To be successful you … should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data More ❯

Data Engineer Location: Hammersmith - Hybrid after probation Salary: £38,000 -£45,000 Join Our Team as a Data Engineer! About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace. What … You'll Do : As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include : Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems. Data … star schema, data vault, dimensional modelling). Proficiency in Excel-based data workflows for various Agile Retail projects. Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar). Benefits: Unlimited holiday Annual Wellbeing Allowance Flexible work culture Monthly socials and events Complimentary snack bar Employer pension contribution If you More ❯

Role: Head of Data Management Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £55,000 - £70,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data Management to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Lead Data Engineer to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision … making across our insurance business. What you’ll do: Lead on data engineering projects, managing a sub- team within engineering, building out our data warehouse & pipelines Collaborate effectively across data science, analytics, product, engineering and commercial business teams Build and support esure’s data products within our industry leading platform Work with More ❯

Role: Data Team Lead Location: Milton Keynes (Hybrid 3 Days On-site Weekly) Salary: £55,000 - £65,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Data Team Lead to join a leading organisations UK IT function. This role will see you managing and developing a high-performing data team, while ensuring the delivery of effective and scalable data solutions. Youll play a key role in setting direction, building capability, and aligning data initiatives with business priorities. The role requires strong leadership, stakeholder management, and the ability to oversee data programmes from strategy through to delivery. Key Responsibilities: Lead, mentor, and … data leadership roles within complex organisations. Proven track record of leading and developing technical teams. Good understanding of data warehousing, ETL, and data pipeline solutions. Experience with data governance, compliance, and security frameworks. Strong stakeholder engagement, vendor management, and planning skills. Experience managing budgets and resources effectively. Excellent communication, leadership, and More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business to design, build, and support scalable … data infrastructure that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using Azure services Work with stakeholders to More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms More ❯

Data Engineer I am working with a growing software development company who are looking to expand the data and engineering function. In this role, you will have the opportunity to work on a greenfield data engineering project and take the lead on the development and maintenance of the organisations data infrastructure. You … will join a close-knit team with the overall goal to aid the organisation to become truly data driven. As a business, they are striving to bring new products to market and by doing so are increasing the amount of data at the disposal to the team. This is an exciting time to join the team … and help to guide the business on its data journey. As part of this role, you will be responsible for some of the following areas. Develop and maintain robust data pipelines, ingesting data from various sources to the cloud based data warehouse Design and develop a cloud based data warehouse More ❯

Company description: ClearCourse Job description: Role description: As a Data Analyst, you will play a vital role in driving data transformation, data extraction, and reporting across our product portfolio. Collaborating with Product Management and other stakeholders, you will gather data requirements, analyse structures, validate integrity, and ensure reliable data pipelines. … Your work will also support system data integration, troubleshooting, and continuous data quality assurance. By delivering accurate, timely, and well-structured insights through dashboards and reports, you will enable informed decision-making, improve operational efficiency, and elevate the customer experience—contributing directly to the success of our retail products. You are also responsible for ensuring all … work complies with relevant security and data protection standards, keeping user data safe and protecting our systems against vulnerabilities. Key Accountabilities: Contribute to the data analysis efforts to support Swan's Products modelling and decision-making processes. Develop and maintain complex SQL queries and scripts using PostgreSQL and OLAP database (i.e. Snowflake). Utilise More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

edge connectivity solutions and technologies to ensure a vast array of devices stay seamlessly connected. Overview: Wireless Logic is on the lookout for a skilled, driven, forward thinking Data Engineer to step into our world and take full ownership of all data engineering activities. You will be joining a Data Team at a high … growth technology IoT connectivity provider who are driving and shaping a data vision and strategy across the group. This role is pivotal in designing, building, and maintaining scalable data pipelines and infrastructure mainly using the Microsoft technology stack. Reporting into the Group Head of Data, you will drive the group towards a data rich and data hungry business by capitalising on the strong foundations the data team has built, continuing to build roads that will unlock data as a superpower so that our teams can gain the competitive edge and make informed decisions. Key Responsibilities: Own the full lifecycle of data engineering tasks More ❯