1 to 25 of 28 Data Pipeline Jobs in the Thames Valley

Were looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. Youll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. Youll work closely with technical specialists … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Role: Data Engineer (AI and Automation) Location: Milton Keynes (Hybrid – 3 Days In-Office Weekly) Salary: £45,000 – £55,000 Network IT are partnering with a large, enterprise-scale organisation undergoing significant modernisation of their data and automation platforms. We’re seeking an experienced Data … Monitoring and troubleshooting daily data operations, resolving issues following ITIL best practices, and implementing proactive improvements, alerting, and self-healing mechanisms. Enhancing pipeline performance and observability, improving monitoring, alerting, and automated preventative rules. Supporting data governance processes such as data quality, lineage, masking ...

Data Engineering Lead Milton Keynes Hybrid Permanent Full time - 35 hours £75,000 - £85,000 Join the ICAEW At ICAEW, you'll be part of an organisation that's shaping the future of business, finance and the accountancy profession on a global scale. Our bold 2030 Strategy puts … looking for a role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. Role Profile The Data Engineering Lead is responsible for building and leading the data engineering capability at ICAEW, ensuring that data is collected, transformed ...

Data Engineer Up to £80,000 About the Role I am seeking a technically strong Data Engineer to support the development and scaling of a modern cloud-based data platform within a fast-growing B2B SaaS organisation that specialises in marketing data integrity. The company provides a platform that helps organisations automate and standardise the flow of lead and marketing data across multiple systems, improving data quality, transparency and operational efficiency. Working within a small but growing data function, this role will focus ...

analysts in developing predictive models and advanced analytics solutions.* Architect, maintain, and scale robust data infrastructures, including ETL/ELT pipelines, data lakes, and warehouses.* Establish and maintain a comprehensive data governance framework meeting regulatory and security standards.* Partner with cross-functional teams … functions. * Hands-on experience with machine learning, predictive modelling, statistical analysis, and integration strategy/implementation. * Experience implementing and managing ETL/ELT pipelines, data lakes, and data warehouses. * Proven track record of successfully leading organization-wide transformation of data strategy & supporting governance. ...

Trading Data Engineer Abingdon, Oxfordshire (Hybrid - 1-2 days per week in office) Up to £55,000 DOE + Bonus + Excellent Benefits Applicants must be within a 1 hour 30 minute commute of Abingdon. Due to significant company growth, a newly created and exciting opportunity has arisen … Delta Lake tables and SQL databases, applying strong data modelling and optimisation strategies. Develop monitoring dashboards and alerting to ensure transparency around pipeline health and data freshness. Implement data validation and reconciliation checks across multiple market data sources. Optimise pipeline ...

Data Engineer Full Time/Permanent £55,000 - £60,000 plus up to 20% bonus, private medical and other extensive benefits Hybrid - 1-2 days a week in the North Oxfordshire head office The Company: My client is an industry leading and award-winning financial services organisation … possess: Proven experience with databricks Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge ...

Architect is responsible for designing, developing, and overseeing the architecture of artificial intelligence solutions leveraging Palantir Foundry as a core enterprise data platform. This role works closely with stakeholders and technical teams to ensure scalable, secure, and effective AI implementation that aligns with business objectives and drives value … governance, and ethical considerations in all Foundry-based AI solutions. Lead review and troubleshooting of system architecture, AI performance, reliability, and data pipeline health on Foundry. Stay informed of AI, ML, data engineering, and Foundry platform advancements, championing adoption of innovative solutions. Qualifications: Bachelor ...

About the Role I am seeking an experienced Senior BI Developer to support the design, development and optimisation of modern cloud-based data platform within a global manufacturing organisation specialising in the production of high-quality equipment. Sitting within a global data and analytics function, this … role is central to managing the data platform and delivering high-quality reporting capabilities that support operational, financial and strategic decision-making across multiple international regions. This role is ideal for someone with strong hands-on experience across modern data engineering practices cloud data ...

IMSERV is one of the UKs leading data collection and energy metering experts, delivering award winning services to more customers in more places, meeting industry targets and becoming a benchmark for excellence. We offer a range of specialist metering technology for electricity, gas, and water along with highly … accurate energy data collection services. All this is wrapped up with an easy-to-view online data management analysis and reporting software. PURPOSE OF THE ROLE: The purpose of the role is to design, build, and manage scalable data solutions focusing on the ingestion ...

building and operating high-speed fibre networks, the business is committed to delivering world-class broadband services to communities and supporting a data-driven future. You'll be joining a forward-thinking environment that values innovation, collaboration, and continuous improvement. Your new role As a Senior Data Engineer, you will play a pivotal role in shaping and enhancing the organisation's enterprise data platform. Working within a specialist Data Analytics & AI team, you'll be responsible for designing, building, and maintaining scalable data pipelines and models within Snowflake ...

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you. What Youll Do Design, build … maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake ...

Title: Senior Data Engineer ( Managed Services) Location: Reading, UK (Remote) Company: Coeo Ltd Please Note : You must have a UK passport or be able to live and work in the UK without employer sponsorship. About the company: Coeo are trusted data management and analytics experts, delivering … technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimize their costs and maximize the benefits from their investments in these technologies. Coeo has been established for over 17 years and has offices ...

Your new role As a Data & Statistical Modelling Engineer, you'll join a highly collaborative Innovation Services team, developing statistical and machine-learning models to understand and predict variation in advanced manufacturing processes.You'll work closely with process, materials and software engineers to identify and control key variables … directly influence production reliability, quality and performance. Key responsibilities include: Developing and maintaining statistical and ML models to analyse machine and material performance data Building and refining data pipelines to post-process experimental and operational data Collecting experimental data and owning frameworks ...

variety of technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining … Personal Learning & Development budget Wellbeing days What's required to be successful in this role? Demonstrable programming ability in Python, preferably within a data context A STEM-related degree Some experience with the Python scientific stack (NumPy, Pandas, SciPy, etc.) is preferred Experience with Docker, GIT and Linux ...

variety of technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining … Personal Learning & Development budget Wellbeing days What's required to be successful in this role? Demonstrable programming ability in Python, preferably within a data context A STEM-related degree Some experience with the Python scientific stack (NumPy, Pandas, SciPy, etc.) is preferred Experience with Docker, GIT and Linux ...

Azure & Databricks Data Engineer | Reading/Hybrid | 3-Month Contract | Data Consultancy | £450-£500 Employer: UK-based Data Consultancy delivering modern cloud solutions for enterprise clients Contract: 3 months (with potential extension) Location: Reading/Hybrid (UK-based) Role Summary: Join client projects … help enterprise organisations modernise their data platforms. Hands-on work with Azure and Databricks to build and maintain scalable pipelines, warehouses, and transformation layers. Ideal for someone with strong Azure and Databricks skills who enjoys delivering practical, high-quality solutions. Responsibilities: Build and optimise Azure data ...

Python or C#/.NET. A proven track record of building YAML-based pipelines (Azure DevOps, GitHub Actions) specifically tailored for analytics, data science, and trading teams. Hands-on experience deploying apps, data pipelines (Azure Data Factory, Databricks), ML model training environments, event streaming ...

specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Science Engineer Location: Reading (Hybrid – 3 days per week onsite) Duration: 6 months contract initially The Opportunity: The Data Science team … seeking a dedicated Data Science Engineer. This role provides an outstanding opportunity to work with exceptionally skilled professionals and influence our sales strategy directly. You will be instrumental in driving business growth by successfully implementing data-driven models that identify and size potential opportunities. You will ...

fault management strategies for radiation effects, SEUs, redundancy, and safe-mode protocols. Experience with GNC/AOCS systems, including sensor and actuator data pipelines, control algorithms, and estimation filters. Exposure to digital twins, simulation environments, and SIL/HIL testing for end-to-end system validation. Experience supporting ...

Location: Oxford/London – Hybrid I’m currently working with a highly ambitious organisation building large-scale data platforms to power the next generation of scientific discovery. They are looking for Data Engineers with a background in genomics or bioinformatics to work directly alongside scientists … researchers, turning complex biological data into reliable, scalable datasets that can power AI and machine learning models. This role sits at the intersection of data engineering, genomics, and applied research - ideal for engineers who enjoy collaborating closely with scientists and building systems that enable real-world ...

TERM- Permanent SALARY- £60,000 to £90,000 per annum (plus benefits) My client is a technology-focused organisation developing advanced AI and data-driven solutions across a range of industries. They are looking to expand their technical team by hiring a Machine Learning Engineer to support … their offices in Reading. The Machine Learning Engineer will ideally have the following attributes: Knowledge/experience in Machine Learning, Artificial Intelligence, or Data Science A degree qualification (BSc, MSc, PhD etc.) in Computer Science, Data Science, Mathematics, Statistics, Artificial Intelligence or similar Strong programming skills ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

Senior Technical Lead (AI & Data Platform) Oxford, UK (Hybrid) An early-stage, mission-driven technology company is hiring a Senior Technical Lead to help build a next-generation analytics platform used by major investors, regulators, and infrastructure operators. Intersting applications to the sustainability space, and investor landscape. This … hands-on technical role working directly with the founders to design and build a scalable platform that combines data engineering, AI modelling, and modern web applications . You will shape the architecture, engineering standards, and technical direction of the platform while helping turn complex analytical models into production ...

expertise in algorithm development, optimization modelling, and power system techno-economic assessment. The ideal candidate will have deep knowledge of Pythons core features, data analysis, web frameworks, and modern development practices. Experience with mathematical optimization tools, containerization, and message-queue technologies will be considered a significant advantage. Mode … Software Engineering Develop, optimize, and maintain software using core Python features including iterators/generators, exception handling, file handling, type hints, OOP, and data structure design. Build scalable algorithms and write clean, maintainable, and well-structured code. Develop and maintain RESTful APIs using OpenAPI/Swagger, Connexion ...