1 to 25 of 229 Data Pipeline Jobs in the South East

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting Ingest and transform data from multiple systems, modelling data … implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning More ❯

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

As a Tech Manager - Data Engineer with AWS experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven … initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such … as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … of skills, excellent communication, functional awareness and an extensive analytical capability in understanding the types of models and data frameworks that can support the business strategies around our data assets. If you're someone who's performed a similar role already, this is the perfect opportunity More ❯

Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/… data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … opportunity for you! Join our trailblazing team as a Data Engineer and play a pivotal role in building secure, scalable microservices that power clinical research applications. This is your chance to make a significant impact on healthcare while working with the latest advancements in data engineering. … About Us We are a pioneering health tech company committed to transforming clinical research through innovative data solutions. Our collaborative team, which includes Frontend Developers, QA Engineers, and DevOps Engineers, creates high-performance data pipelines and REST APIs that drive AI applications and external data More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have … both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and … streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data More ❯

is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our … able to work to sometimes tight timescales and adapt as source data changes without warning Have knowledge of cloud data pipeline tools (AWS preferred). Experience here is a plus Be passionate about data quality and the service we provide through data More ❯

is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our … able to work to sometimes tight timescales and adapt as source data changes without warning Have knowledge of cloud data pipeline tools (AWS preferred). Experience here is a plus Be passionate about data quality and the service we provide through data More ❯

We're currently seeking a Data Engineer to join one of the leading organisations responsible for coordinating the financing activities for one of the largest car manufacturer groups in the world! Ready to fuel your career? Drive your ambition with incredible car scheme perks, a fantastic bonus, and … data storage systems to ensure seamless data flow. Define and support the creation and maintenance of optimal data pipeline architecture, enabling faster and safer solution delivery. Consolidate and optimise large, complex data sets from diverse sources that meet both functional and … solutions. Solid understanding of data warehousing concepts , facilitating the creation of efficient and reliable warehouse solutions. Experience with data pipeline development and optimisation, ensuring streamlined data flows and enhanced performance. What’s In It For You? Location: Buckinghamshire (Hybrid) Work type: Permanent More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention … co ordinate technical delivery teams and cross-functional contributors including the ability to effectively engage with non-technical audiences. Skilled in data pipeline development and reporting implementation. Experience of data governance and data quality frameworks. Basic familiarity with cloud hosted online data More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation’s data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great customer experience. More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to 70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation's data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation's data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Senior Data Scientist – AI/LLM … Trading Platform Overview We are looking for an experienced Senior Data Scientist to design and implement a high-performance data pipeline for an AI/LLM-powered trading platform. This role involves handling large-scale, unstructured financial data—such as articles, books, and … and structuring it for machine learning and trading strategies. What You’ll Do Develop Scalable Data Pipelines – Design and maintain an efficient pipeline to process unstructured data for AI/LLM models. Process Unstructured Text Data – Extract and prepare data from More ❯

AWS Data Engineer Salary: Negotiable to £80,000 Dependent on Experience London: Hybrid working 3 days per week in the office 2 days home-based Job Ref: J12931 A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure … architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs). You’ll … skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. More ❯

Job Title: Senior Data Architect Location: Hybrid (London, UK) Salary: £75,000–£135,000 per annum, plus 20% Bonus and Benefits About the Role: Our client is a leading professional services firm with a strong UK presence and global reach, delivering expert audit, tax, advisory, and risk solutions. … As part of their ongoing investment in digital transformation, they are scaling their data capabilities to better serve clients in regulated and data-intensive sectors. This newly created Senior Data Architect role will focus on designing and implementing data architecture solutions for … architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency in SQL , Python , and modern data pipeline design (ETL/ELT). Experience with both batch and streaming data processing architectures. Strong communication and stakeholder engagement skills, particularly with More ❯