20 of 20 Data Pipeline Jobs in the Thames Valley

Data Architecture Implementation Translate the defined data architecture and standards into implemented solutions—including ingestion, transformation, storage, and performance optimisation. Pipeline Development & Orchestration Develop robust ELT/ETL pipelines using dbt and workflow/orchestration tools (e.g., Argo Workflows), ensuring reliability, maintainability, and adherence … data engineering solutions, ideally with Snowflake. Strong hands-on proficiency with SQL, Python, and dbt for data transformations, modelling, and pipeline automation. Practical experience with Snowflake and RBAC management. Experience with data ingestion and replication tools such as Airbyte, Fivetran, Hevo, or similar. ...

Head of Enterprise Data Delivery Salary £80,000 (plus car allowance of £5,900) Location Hybrid - Milton Keynes or Boston Permanent, Full Time Data,transformationand governance - this role has it all! As Head of Enterprise Data Delivery atAmplius,youllshape how data is built,managedand delivered across the organisation.Youllset clear direction and standards, making sure data is consistent,reliableand easy to use. By bringing structure to complex, fragmented data,youllhelp improve reporting and support better, more confident decision-making. Salary: £80,000 (plus car allowance ...

Trading Data Engineer Abingdon, Oxfordshire (Hybrid - 1-2 days per week in office) Up to £55,000 DOE + Bonus + Excellent Benefits Applicants must be within a 1 hour 30 minute commute of Abingdon. Due to significant company growth, a newly created and exciting opportunity has arisen … Delta Lake tables and SQL databases, applying strong data modelling and optimisation strategies. Develop monitoring dashboards and alerting to ensure transparency around pipeline health and data freshness. Implement data validation and reconciliation checks across multiple market data sources. Optimise pipeline ...

Fabric Data Engineer Up to £70,000 I am seeking an experienced Data Engineer to support the design, development and optimisation of modern cloud-based data platform within a global manufacturing organisation specialising in the production of high-quality equipment. Sitting within a global … data and analytics function, this role is central to managing the data platform and delivering high-quality reporting capabilities that support operational, financial and strategic decision-making across multiple international regions. This role is ideal for someone with strong hands-on experience across modern data ...

Role We`re looking for a new Data Engineer to join our Technology team based in Loudwater, Buckinghamshire. In this role, you will have a passion for uncovering insights and making data-driven decisions. Your expertise lies in working with a range of tools (SQL, Python … Cloud) to extract, transform, and load data from various sources, seamlessly bridging the gap between back-end and front-end systems. You will act as the escalation point providing 2nd/3rd line technical support in addition, you will be involved in project work to enhance the reporting ...

drawn from the world’s top physical AI specialists and led by originators of the field. Your Role: We are hiring a Data Engineer to help build the systems that prepare, curate, and scale training and evaluation data for machine learning in autonomous driving. You will … work across the full data lifecycle, from raw vehicle logs and simulation outputs to curated, labelled, and model-ready datasets. This includes handling multimodal sensor data, scaling labelling through both human and ML-based workflows, and enabling intelligent selection of high-value data from ...

Senior Data Engineer Salary: £100,000 + Benefits Own the rebuild of a modern data platform from the ground up. Were working with a business in the middle of a high-impact data transformationmoving away from legacy constraints towards a scalable, cloud-first architecture. … function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with ...

Your new role As part of the Data Analytics & AI team, you'll help build and evolve a Snowflake-based data platform. You will design and maintain robust data pipelines and models that transform data from operational systems into trusted, analytics-ready … Build & Maintain Pipelines: Develop ELT/ETL pipelines using dbt, Python, and orchestration tools. * Work with Snowflake: Design and optimise data models, manage performance, and adopt advanced Snowflake features. * Ensure Data Quality: Apply governance, security, and compliance standards. * Collaborate: Support analysts and business teams with clean ...

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you. What Youll Do Design, build … maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake ...

Data Engineer (Microsoft Fabric) - Permanent Location: Hybrid - Milton Keynes (majority remote) Type: Full-time, Permanent Start: ASAP Salary: £55,000 - £60,000 per annum The Opportunity. We're working with a growing organisation investing in its data platform, now looking to hire a Data … value from data. This is not a traditional role with fixed specifications. You will work in a partially built environment, helping shape how data is structured, delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop ...

Your new role As a Data & Statistical Modelling Engineer, you'll join a highly collaborative Innovation Services team, developing statistical and machine-learning models to understand and predict variation in advanced manufacturing processes.You'll work closely with process, materials and software engineers to identify and control key variables … directly influence production reliability, quality and performance. Key responsibilities include: Developing and maintaining statistical and ML models to analyse machine and material performance data Building and refining data pipelines to post-process experimental and operational data Collecting experimental data and owning frameworks ...

Kantar is the world’s leading AI-native marketing data and analytics business and an indispensable brand partner to the world’s top companies. We combine the most meaningful attitudinal and behavioural data with deep expertise and advanced analytics to uncover how people think and act. … shape the marketing strategies that shape their future. Why this job is important This role is about applying data science where it genuinely matters — in live, production environments that support large‐scale research operations around the world. As a Senior Data Scientist on the Digital Twins ...

fault management strategies for radiation effects, SEUs, redundancy, and safe-mode protocols. Experience with GNC/AOCS systems, including sensor and actuator data pipelines, control algorithms, and estimation filters. Exposure to digital twins, simulation environments, and SIL/HIL testing for end-to-end system validation. Experience supporting ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

DevOps Engineer (Data/BioTech)Oxford (1 day per month in office).£60-80k + Benefits. This role cannot offer Visa Sponsorship. Your new company I am exclusively recruiting an AWS DevOps Engineer for a fast-growing, clinical-stage life sciences organisation developing a first … technology to tackle diseases, including cancer and autoimmune conditions.The business is privately funded, entering a critical growth phase, and investing heavily into its data and cloud capability to support scientific discovery and clinical delivery. With active clinical programmes underway, technology is a core enabler rather than a support ...

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

production environments. Monitor database health and perform routine maintenance tasks including index optimisation, table maintenance, and schema modifications. Work with Development and Data engineering teams to optimise performance & cost of data pipelines Manage database capacity planning and storage allocation to ensure adequate resources for current … availability solutions including replication, clustering, and failover configurations. Document database architectures, configurations, procedures and policies. Implement appropriate security controls to ensure databases and data are protected. Ensure database backup, validation and disaster recovery capabilities are in place and rehearsed. Provide insight and recommendation on the adoption and consolidation ...

robust mathematical models and scalable software systems. What You’ll Be Doing Designing novel algorithmic and machine learning approaches to interpret complex scientific data Developing mathematical models (including probabilistic/Bayesian methods) Building proof-of-concept tools and production-ready Python systems Managing and improving data ...

that have the potential to transform traditional drug discovery efforts. The Role Design and develop machine learning and mathematical models for analysing experimental data Implement proof-of-concept software in Python Build and manage data pipelines from laboratory instruments through to analysis Run, evaluate and iterate ...