1 to 25 of 49 Data Pipeline Jobs in the Thames Valley

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Azure Data Engineer Up to £74,000 + Benefits International Law Firm – London (Hybrid) I’m working with a highly respected international law firm that’s looking for a skilled and proactive Azure Data Engineer to join their forward-thinking Data team. This role is a great fit for someone who thrives on solving … complex data challenges and wants to directly influence how a global legal business uses its data to make smarter decisions. As part of the Strategy, Transformation & Project Delivery function, you’ll be instrumental in designing, developing, and optimising the firm’s Azure-based data infrastructure, from building scalable data pipelines to ensuring … data integrity, security, and compliance. The Role Data Infrastructure Development – Build and maintain scalable Azure data pipelines (following Senior Data Architect designs) using tools such as Azure Data Factory and Tray.io. Implement and manage data lakes and warehouses (Azure Synapse, Azure Data Fabric, etc.). Integration More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

the way. So why not join us at FairPlay and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This is a critical role within … our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding and engaging our users. You will report to the Head of Core Product. You will … our CDP and SCV, aligning with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data quality, consistency, and completeness. More ❯

Role: Head of Data Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £50,000 - £60,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while … enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? • A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. • Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. • Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. • Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest … pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide excellent customer support service. Problem-solve in a More ❯

UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems.To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain-ensuring scalability, quality, and performance.Develop data architectures and models (especially graph-based … that support seamless integration of infrastructure, operational data, and business intelligence.Define and enforce data solution standards, ensuring technical consistency and reuse across programmes.Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies.Manage stakeholder engagement to translate complex data requirements into clear, actionable solutions-communicating both technical More ❯

Sahaj Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with a razor-sharp focus … to solve complex business and technology challenges, and provide customers with a competitive edge. As a Senior Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being hands on with technology. We aim to allow growth without becoming “post-technical”. Responsibilities: Collaborate with Data Scientists and More ❯

Job Title: Data Architect • Key Skills: SPARQL, Python, Clinical Knowledge Graph and GraphDB • Experience: 8+ Years • Location: London, UK •We at Coforge are seeking “Data Architect” with the following skill-set: Job Overview We are seeking a highly experienced Data Architect to support the ongoing development and continuous improvement of our Clinical Knowledge Graph … platform. This role is pivotal in enhancing technical architecture, streamlining processes, and ensuring high-quality delivery aligned with customer use cases. Key Responsibilities Design, develop, and maintain scalable data pipelines using SPARQL and Python. Create and optimize complex SPARQL queries for data retrieval and analysis. Develop graph-based applications and models to extract insights and solve … experience with SPARQL and Python. Strong understanding of graph databases (e.g., RDF, Neo4j, GraphDB). Experience in data modeling and schema design. Familiarity with data pipeline tools and frameworks (e.g., Apache Airflow, Luigi). Excellent problem-solving and analytical skills. Ability to work independently and collaboratively within cross-functional teams. Preferred Background Experience in Health More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Team: The Academic Information Systems ( AI S) DataOps team is a shared technology group responsible for building, administering, governing, and setting standards for a growing number of strategic data platforms and services. Our capabilities enable data to be extracted, centralized, transformed, transmitted, and analyzed across a range of products in the AIS space. Due to our … footprint across the enterprise, we are relied upon to ensure our systems are trusted, reliable and available.The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Astronomer/Airflow, Kubernetes , DBT, Tableau, Sisense , Collibra, and Kafka/Debezium . Our mission is to enable frictionless experiences for our AIS colleagues and customers so … that they can openly and securely consume trustworthy data, enhancing everyday interactions and decisions. About the Role: As a S enior Data Engineer I , you will be responsible for helping to creat e a data infrastructure that is secure, scalable, well-connected, thoughtfully architected while also building a deep domain knowledge of our business More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You’ll be a trusted technical advisor, collaborating More ❯

Data Product Manager Salary: Up to £100,000 plus benefits Location: Based in London - Hybrid 2 days a week A leading global sports and entertainment brand is seeking a Data Product Manager to own the end to end product roadmap of their Customer Data Platform. This is a unique opportunity to lead the data … users and evolve their internal tooling systems that are instrumental in delivering value for their customers. Requirements: 5+ years in product management with 2-3 years focusing on data products. Strong experience and knowledge of data modelling, management, warehousing and ETL pipelines. Proven experience working with technical skills in product such as SQL, GCP, BigQuery and … Power BI. Strong understanding of API Integrations and data privacy regulations. Skilled in managing and influencing stakeholders, with the ability to clearly explain technical concepts to non-technical audiences. Keen attention to problem solving, analytical, data-driven decision-making in Agile environments. A bonus if you have a background of CDP platform experience, Python, sports media More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

to drive best-in-class instrumentation, analytics enablement, and data integrity across ME+EM’s digital ecosystem. This hybrid role blends frontend engineering (Next.js) with data pipeline integration and management of GTM, ensuring our business can make fast, confident, and data-informed decisions. You are responsible for building and maintaining our digital analytics architecture … Next.js website. Build and standardise event tracking frameworks and reusable utilities within the codebase. Collaborate with Software Engineers to ensure seamless event instrumentation across the entire customer journey. Data Layer & Tag Management: Own and evolve the dataLayer schema to support consistent, scalable tracking across analytics platforms. Align data structure with stakeholder needs across product, engineering, and … marketing, while supporting business-wide measurement frameworks. Maintain and troubleshoot data flows across Google Tag Manager (GTM) and the ME+EM codebase. Identify and resolve tracking issues using browser dev tools, proxy software, and automated validation tools. Platform Integration: Integrate and configure analytics SDKs (GA4, Meta Pixel, Segment, etc.) via code and tag management systems. Contribute to the development More ❯

innovation and collaboration. We are committed to cultivating a community of excellence through trust, innovation, and resilience, valuing diverse experiences and expertise. Requirements The Role: We seek a Data Engineer to develop and deploy a data platform supporting AI initiatives at EIT. You will be responsible for building scalable data infrastructure and pipelines, collaborating … with multidisciplinary teams. Key Responsibilities: Design and implement scalable data pipelines and infrastructure Develop data processing systems using cloud technologies Optimize data storage and retrieval for AI applications Support AI/ML model development and deployment Evaluate and adopt new data technologies Collaborate with scientists, researchers, and operational teams Qualifications & Experience: Extensive … Python programming experience in enterprise environments Knowledge of data modeling, ETL, data warehousing, and SQL Cloud computing experience Strong communication skills Innovative mindset and ability to solve challenges creatively Ability to work in a fast-paced, startup-like environment Nice to have: Familiarity with AI/ML workflows Experience with Docker/Kubernetes Knowledge of Git More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Job Title: Data & Migration Workstream Lead Location: London (Hybrid 1-2 days) Job Type: Full-time, Permanent Salary: £100,000 - £115,000 + Benefits Industry: Financial Technology A leading FinTech client based in London is seeking a hands-on … Data & Migration Workstream Lead to own and deliver all data-related activities across complex projects. This role requires strong expertise in data migration, pipeline development, and stakeholder management within banking or fintech environments, experience in BaaS is highly desirable. You'll lead data migration strategy, execution, and governance, ensuring smooth, high … quality transitions aligned with business goals. Key Responsibilities: Lead end-to-end delivery of the Data & Migration workstream across multiple programmes Develop robust data pipelines and reporting solutions to meet client and business needs Act as primary liaison between clients, technical teams, and workstream leads Define migration strategy, data mapping, validation, and support dress More ❯

Senior Data Analyst £65,000 - £75,000 Liverpool Street, London (1/2 days per week) A PE-backed client of ours are looking for a Senior Data Analyst to join their growing data function. They're looking for a Power BI SME who has a real passion for driving analytics and insights. They … have a stack of Snowflake, dbt, Python & Power BI. They're looking for someone who has end-to-end analytics experience and a genuine drive for data analytics and the impact it has on business performance. In this role you'll work cross-functionally across the entire c.1500 employee organisation. Expirience working in operations would also be favourable. … analytical with a business mindset to improve business performance. Have excellent communication skills with a consultative approach and a strong interest in influencing stakeholders. Tool experience required: Strong data visualisation using Power BI and coding ability using either normalisation, SQL, or Python). Desirable: Experience working in a Data warehouse, or lake environments e.g. Snowflake, Redshift More ❯

Job Title: Data Analytics Manager Location: London (3 Days in the office) Job Type: Full Time Company Overview Operating quietly at the intersection of community and commerce, this UK-based real estate investment trust specialises in essential-led retail that remains relevant through changing market cycles. Focused on underappreciated assets in resilient locations, the company balances disciplined asset … local needs. It offers employees the chance to work behind the scenes on places that genuinely matter. Role Summary We’re looking for a proactive and technically capable Data & Reporting Analyst to join the Strategy & Investment team at a pivotal moment in the company’s data journey. This newly created role is part of a broader … move to bring data capabilities in-house, reducing reliance on external consultancies and building a centralised, scalable reporting infrastructure. You’ll work across departments to design dashboards, integrate diverse data sources, and deliver insights that drive both day-to-day decisions and long-term strategic planning. Key Responsibilities Data & Reporting Design, build, and maintain More ❯