14 of 14 Data Pipeline Jobs in South London

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Ready to shape the future of data? Matillion is the intelligent data integration platform. We're changing how the world works with data – and we need driven, curious people who think big and move fast. We built the Data Productivity Cloud … supercharge data productivity, and now we're shaping the future of data engineering with Maia – our AI-powered virtual data engineers that help teams design, build, and manage data pipelines at unmatched speed. Join #TeamGreen, where the mission comes first, collaboration drives ...

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions. … Responsibilities Design and implement data pipelines on AWS using services such as Glue, Lambda, S3, and Redshift. Develop ETL processes and optimise data workflows for performance and security. Collaborate with analysts and architects to ensure compliance with government security standards. Troubleshoot and resolve issues in complex ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

will you make an impact in this role? American Express Technologies is seeking a Senior Engineer with advanced skills in Generative AI and Data Engineering to join our Production Management tooling team. Our mission is to transform how critical platforms are supported by embedding AI-first solutions into … meet evolving requirements Design and develop Generative AI applications, including RAG pipelines, agentic workflows, and Model Context Protocol (MCP) integrations. Collaborate with data owners to build data pipelines, feature engineering processes, and context enrichment strategies that optimize AI-enabled solutions. Prototype and deliver production-ready tools ...

FactSet creates flexible, open data and software solutions for over 200,000 investment professionals worldwide, providing instant access to financial data and analytics that investors use to make crucial decisions. At FactSet, our values are the foundation of everything we do. They express … automation within inhouse, and 3rd party licensed software service eco-systems. Implement agents within frameworks to automate various repetitive manual tasks and summarize data out of corporate tools in concise human readable form. Design insight generation techniques that summarize key highlights from large complex datasets and support natural ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data ...

Godalming or Milton Keynes offices. Salary up to £80,000, plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make … knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with ...

major transformation and security programmes across government and enterprise. In this role, you will architect, deploy, optimise and scale Splunk platforms and data pipelines, ensuring clients maximise the value of their data. You'll play a key role in shaping logging, observability and security-focused initiatives while acting … trusted technical authority. Key Responsibilities Lead the architecture, design and delivery of Splunk solutions across enterprise environments Define and implement scalable log ingestion, data pipelines and integration patterns Oversee platform optimisation, tuning and long-term performance improvements Integrate Splunk within cloud estates (particularly AWS-based architectures) Provide technical ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data ...