21 of 21 Data Pipeline Jobs in the Thames Valley

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

Role: Head of Data Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £50,000 - £60,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while … enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

We do energy differently - we do it all. We make it, store it, move it, sell it, and mend it. About your team: Youll be joining Centricas Group Data function, working in close partnership with our Data Science and Data Governance teams. Together, were building a data ecosystem that powers strategic decision … making and enables the creation of reusable, high-quality data assets across the business. About your role: As Head of Data Engineering , youll lead the design, development, and optimisation of Centricas data infrastructure. Youll define and execute a forward-thinking data engineering strategy, ensuring our pipelines and platforms are scalable, secure, and … aligned with business goals. Youll mentor a high-performing team, collaborate across departments, and champion best practices in data management, governance, and technology adoption. Youll also work closely with the Head of Data Science to ensure our infrastructure supports advanced analytics and modelling, enabling the organisation to harness data-driven insights effectively. Regular travel More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? • A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. • Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. • Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. • Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems.To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain-ensuring scalability, quality, and performance.Develop data architectures and models (especially graph-based … that support seamless integration of infrastructure, operational data, and business intelligence.Define and enforce data solution standards, ensuring technical consistency and reuse across programmes.Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies.Manage stakeholder engagement to translate complex data requirements into clear, actionable solutions-communicating both technical More ❯

Data Scientist 6 Month contract initially Based: Hybrid - Maximum of 3 days p/w - Wokingham Rate: £Market rates p/d (via Umbrella company) We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a … difference. We have a great opportunity for a highly experienced Data Scientist to join the team. We are seeking a skilled and experienced Data Scientist with expertise data scientists and LLM use cases and Data Engineering with Graph DB experience and Vector DB experience. As a Data Scientist, you will … datasets, building predictive models, and extracting meaningful insights to drive informed decision-making. Key Responsibilities: * Analyse and pre-process large-scale time series datasets, identifying relevant variables and data cleansing requirements. * Develop and implement advanced statistical models and machine learning algorithms to perform predictive analysis on time series data. * Build and validate forecasting models to predict future trends More ❯

Team: The Academic Information Systems ( AI S) DataOps team is a shared technology group responsible for building, administering, governing, and setting standards for a growing number of strategic data platforms and services. Our capabilities enable data to be extracted, centralized, transformed, transmitted, and analyzed across a range of products in the AIS space. Due to our … footprint across the enterprise, we are relied upon to ensure our systems are trusted, reliable and available.The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Astronomer/Airflow, Kubernetes , DBT, Tableau, Sisense , Collibra, and Kafka/Debezium . Our mission is to enable frictionless experiences for our AIS colleagues and customers so … that they can openly and securely consume trustworthy data, enhancing everyday interactions and decisions. About the Role: As a S enior Data Engineer I , you will be responsible for helping to creat e a data infrastructure that is secure, scalable, well-connected, thoughtfully architected while also building a deep domain knowledge of our business More ❯

Job Title: Business Intelligence (BI) Analyst Location: Oxford (2 days on-site) Salary: £35,000 - £50,000 DOE + Bonus About Us We're a fast-growing data consultancy helping forward-thinking clients transform their customer engagement through intelligent use of CRM platforms and AI. We specialise in building integrated data ecosystems that drive smarter business … insights, and measurable ROI. Our clients range from scaling SaaS startups to global enterprises across sectors like retail, finance, technology, and healthcare. We work at the intersection of data, automation, and customer intelligence . As we scale, we're looking for a talented BI Analyst to join our analytics team and help our clients extract true business value … from their data. The Role As a BI Analyst , you will play a critical role in helping our clients understand and optimise their CRM and business performance through data-driven insights. You'll work closely with client stakeholders, CRM specialists, and data engineers to develop scalable dashboards, uncover trends, and turn data into action. More ❯

Job Title: Business Intelligence (BI) Analyst Location: Milton Keynes (2 days on-site) Salary: £35,000 - £50,000 DOE + Bonus About Us We're a fast-growing data consultancy helping forward-thinking clients transform their customer engagement through intelligent use of CRM platforms and AI. We specialise in building integrated data ecosystems that drive smarter … insights, and measurable ROI. Our clients range from scaling SaaS startups to global enterprises across sectors like retail, finance, technology, and healthcare. We work at the intersection of data, automation, and customer intelligence . As we scale, we're looking for a talented BI Analyst to join our analytics team and help our clients extract true business value … from their data. The Role As a BI Analyst , you will play a critical role in helping our clients understand and optimise their CRM and business performance through data-driven insights. You'll work closely with client stakeholders, CRM specialists, and data engineers to develop scalable dashboards, uncover trends, and turn data into action. More ❯

Contract Data Engineer Financial Services 6+ Months Competitive Day Rate My client, a global consultancy, is looking for an experienced Data Engineer to join on a contract basis to support major digital transformation projects with Tier 1 banks. You'll help design and build scalable, cloud-based data solutions using Databricks , Python , Spark , and … traffic financial applications. Key Skills & Experience: Strong hands-on experience with Databricks , Delta Lake , Spark Structured Streaming , and Unity Catalog Advanced Python/PySpark and big data pipeline development Familiar with event streaming tools ( Kafka , Azure Event Hubs ) Solid understanding of SQL , data modelling , and lakehouse architecture Experience deploying via CI/CD tools (e.g. … Azure DevOps, GitHub Actions) Nice to Have: Knowledge of Scala/Java Understanding of GDPR and handling sensitive data This is a contract role (UK-based) offering the chance to work on high-impact projects shaping the future of finance with some onsite presence required. More ❯

innovation and collaboration. We are committed to cultivating a community of excellence through trust, innovation, and resilience, valuing diverse experiences and expertise. Requirements The Role: We seek a Data Engineer to develop and deploy a data platform supporting AI initiatives at EIT. You will be responsible for building scalable data infrastructure and pipelines, collaborating … with multidisciplinary teams. Key Responsibilities: Design and implement scalable data pipelines and infrastructure Develop data processing systems using cloud technologies Optimize data storage and retrieval for AI applications Support AI/ML model development and deployment Evaluate and adopt new data technologies Collaborate with scientists, researchers, and operational teams Qualifications & Experience: Extensive … Python programming experience in enterprise environments Knowledge of data modeling, ETL, data warehousing, and SQL Cloud computing experience Strong communication skills Innovative mindset and ability to solve challenges creatively Ability to work in a fast-paced, startup-like environment Nice to have: Familiarity with AI/ML workflows Experience with Docker/Kubernetes Knowledge of Git More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 10-Jun-2025 19366 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Architect & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Architect & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … values lead every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity As an AI Architect & Data Scientist, you will be expected to: Design and build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such More ❯

vector database experience Previous experience in educational technology, AI/ML applications, or digital learning product development (desirable) Proven experience in database design, API development, and data pipeline management Cross-cultural competency in diverse educational contexts Deep ELT methodology knowledge and curriculum development expertise (desirable) We care about work/life balance here at OUP. With this More ❯

AWS Data Engineer – Contract Location: Reading (Hybrid – 1–2 days/month onsite) Rate: £500-550/day (Inside IR35) Start Date: ASAP Duration: 5 months (with potential for extension)A leading financial services organisation is seeking an experienced AWS Data Engineer to join their Compliance Reporting team. This backend-focused role involves designing and deploying … scalable data solutions that support the delivery of regulatory compliance reports across the business.You’ll work with a modern AWS stack and infrastructure-as-code tools to build robust data pipelines and applications that process complex datasets from multiple operational systems.Key Responsibilities: Build and maintain AWS-based ETL/ELT pipelines using S3, Glue (PySpark/… Python), Lambda, Athena, Redshift, and Step Functions Develop backend applications to automate and support compliance reporting Process and validate complex data formats including nested JSON, XML, and CSV Collaborate with stakeholders to deliver technical solutions aligned with regulatory requirements Manage CI/CD workflows using Bitbucket, Terraform, and Atlantis Support database management and improve data ingestion More ❯

AWS Data Engineer - Contract Location: Reading (Hybrid - 1-2 days/month onsite) Rate: £500-550/day (Inside IR35) Start Date: ASAP Duration: 5 months (with potential for extension) A leading financial services organisation is seeking an experienced AWS Data Engineer to join their Compliance Reporting team. This backend-focused role involves designing and deploying … scalable data solutions that support the delivery of regulatory compliance reports across the business. You'll work with a modern AWS stack and infrastructure-as-code tools to build robust data pipelines and applications that process complex datasets from multiple operational systems. Key Responsibilities: Build and maintain AWS-based ETL/ELT pipelines using S3, Glue … PySpark/Python), Lambda, Athena, Redshift, and Step Functions Develop backend applications to automate and support compliance reporting Process and validate complex data formats including nested JSON, XML, and CSV Collaborate with stakeholders to deliver technical solutions aligned with regulatory requirements Manage CI/CD workflows using Bitbucket, Terraform, and Atlantis Support database management and improve data More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

enables all full-time employees to work up to 2 days a week from home as work permits. POSITION SUMMARY Infleqtion is recruiting a passionate and detail-driven Data Scientist to join our team, focusing on time series modelling and control systems. You'll be developing predictive algorithms, identifying dynamic patterns and anomalies, and building models that help … automate decision-making in real-time systems involving quantum sensors. This is a high-impact role bridging data science, physics and engineering disciplines. JOB RESPONSIBILITIES The duties and responsibilities outlined below include essential functions of the role. Depending on business needs, this role may perform a combination of some or all of the following duties. Design and implement … to integrate predictive models into live quantum sensors. Evaluate performance of deployed models and develop tools/pipelines to continuously refine them. Analyse large-scale sensor and telemetry data from quantum sensor systems Effectively manage technical priorities, meet deadlines, and deliver on project objectives. Masters degree in a STEM field (maths, science, engineering etc.) or equivalent Strong programming More ❯

Data Insights Analyst Up to £55,000 | Hybrid - 3 Days in Oxfordshire A rapidly scaling e-commerce and logistics company is looking for a Data Insights Analyst to help shape the future of its customer experience and commercial strategy. With sustainability and tech innovation at its core, the business operates multiple online brands and is one … focused on driving smarter decision-making across marketing, product, and customer experience teams. You'll work closely with stakeholders to uncover behavioural trends, improve digital performance, and develop data-led strategies that support business growth. Key Responsibilities: Analyse customer journeys, engagement patterns, and conversion funnels to identify opportunities for UX and performance improvement Support development of personalisation and … deep-dive analysis using large datasets (customer, product, marketing, transactional) Contribute to the creation of a Single Customer View across brands Collaborate with tech teams to ensure clean data pipelines and reliable tracking Present findings to non-technical stakeholders and influence strategic decisions at senior levels Continuously test, iterate, and refine data-driven hypotheses to support More ❯

will play a key role in developing and maintaining high-impact applications that support our global scientific and commercial operations. You will contribute to systems that power our data analysis platforms and next-generation telemetry infrastructure, helping us deliver world-class sequencing technology to researchers worldwide. Key Responsibilities: Design, build and maintain data-intensive web applications … with: Strong experience in production-level Python development A background in building and maintaining web applications or APIs Experience with automated testing, deployment, and containerised environments Knowledge of data pipelines, workflow engines, and cloud-native architectures This role is ideal for someone who thrives in a dynamic, fast-paced environment, embraces change, and is motivated by meaningful work More ❯