501 to 525 of 681 Data Pipeline Jobs in the UK

Data Engineer Opportunity, DV-cleared only All candidates should make sure to read the following job description and information carefully before applying. London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

Informatica experience (IICS/ETL design and support) – this is critical SC clearance (or very close to obtaining it) Strong SQL/data engineering background , ideally in Azure‐based environments Nice to have/optional skills (not essential, but beneficial): Experience with Microsoft Fabric (e.g. Data … Factory, Synapse, OneLake) Exposure to financial services/FinTech environments Familiarity with Azure DevOps and/or GitHub Experience with testing practices for data pipelines (unit testing, QA) Broader Azure data services (Azure SQL, Managed Instance, Data Lake ...

Responsibilities: Design, develop, and maintain scalable, high-performance web applications and APIs using Node.js . Work closely with cross-functional teams, including data scientists, engineers, and product managers, to integrate AI-driven capabilities and infrastructure tools into our platform. Build robust backend services to support our platform … architecture, ensuring security, scalability, and optimal performance. Develop and integrate systems that can handle large datasets and support real-time data processing. Optimise codebase and algorithms to enhance the efficiency and reliability of infrastructure services. Troubleshoot and debug complex technical issues to maintain system stability. Write clean, modular ...

real-world machine learning systems used at scale? We’re looking for a curious and motivated Junior AI Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup with offices in London and Luton . This role is ideal for someone early … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and AI products, contributing to model development, data pipelines, and deployment workflows that power mission-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

senior stakeholders, procurement teams, and decision-making committees. Navigate procurement processes, vendor registration, framework agreements, NDA/commercial approvals, and compliance with regional data protection and information security standards. Collaborate with global solution … teams, delivery, legal, and marketing to design tailored proposals and ensure successful implementation and client satisfaction. Maintain up-to-date client data, pipeline forecasts, and sales activities using CRM. Achieve and exceed revenue, retention, and growth targets. Requirements: 7+ years of account management/business development/ ...

senior stakeholders, procurement teams, and decision-making committees. Navigate procurement processes, vendor registration, framework agreements, NDA/commercial approvals, and compliance with regional data protection and information security standards. Collaborate with global solution … teams, delivery, legal, and marketing to design tailored proposals and ensure successful implementation and client satisfaction. Maintain up-to-date client data, pipeline forecasts, and sales activities using CRM. Achieve and exceed revenue, retention, and growth targets. Requirements: 10+ years of account management/business development/ ...

Join a pioneering team that’s redefining how AI and cloud-native platforms power front-office trading. We’re hiring a hands-on Data Engineer to help shape the future of our platform, a critical infrastructure that supports Quantitative and Strat developers in building next-generation trading solutions. … This is not a standard engineering role. You’ll work closely with front‐office traders and quantitative developers, focusing on the data engineering required to design, build, and operate bespoke generative AI and agent‐based systems used directly in trading workflows. The work you do will have ...

summary The postholder will contribute to the development, validation and implementation of Artificial Intelligence and Machine Learning methodologies to enhance genomic data analysis and interpretation in a clinical setting. Working within the Translational Research and Bioinformatics team, the Research Bioinformatician will support translational research, optimise data pipelines for high-throughput sequencing, and integrate AI/ML approaches into clinical workflows. The role involves close collaboration with clinicians, scientists, data engineers and external partners to ensure research outputs are robust, reproducible and clinically relevant. In addition, the postholder will design and develop web portals ...

Senior Data Engineer - London (Hybrid) We are working with a forward-thinking client who is looking for a Senior Data Engineer with strong experience in either AWS or GCP. Their platform operates across both clouds, so deep expertise in one is essential, along with a willingness … work within the other. About the Role You will design, build and maintain backend data pipelines that support the organisations key data products. The position requires strong Python engineering skills and experience working with modern data ecosystems. Experience with multi-tenant architectures is highly ...

Graduate AI/Data Scientist/Machine Learning Engineer – Entry Level £28,000 – £35,000 | Hybrid Opportunities | North West/UK Are you a recent graduate looking to start your career in Artificial Intelligence, Machine Learning, Data Science or Software Engineering? We are currently working with … number of innovative technology organisations who are looking to recruit Graduate AI Engineers, Data Scientists and Machine Learning Engineers into their growing teams. This is an excellent opportunity for ambitious graduates who want to work with cutting-edge technologies including Artificial Intelligence, Machine Learning, Generative AI and Large ...

engineering team building AI solutions for large enterprise clients. Typical work includes: • Developing and deploying machine learning models • Building scalable AI and data pipelines • Engineering ML systems on modern cloud platforms • Working with architects and data engineers on enterprise AI platforms Technology • Python • SQL • Spark/… Databricks or Snowflake • Exposure to GenAI or LLMs Background We’re interested in engineers with experience in: • AI or machine learning engineering • Data engineering with ML exposure • Applied data science with production deployment Financial services and consulting experience is preferred, particularly across banking, capital markets ...

specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Science Engineer Location: Reading (Hybrid – 3 days per week onsite) Duration: 6 months contract initially The Opportunity: The Data Science team … seeking a dedicated Data Science Engineer. This role provides an outstanding opportunity to work with exceptionally skilled professionals and influence our sales strategy directly. You will be instrumental in driving business growth by successfully implementing data-driven models that identify and size potential opportunities. You will ...

Your new company Working for a globally renowned financial organisation Your new role We're looking for a Senior Software/Data Platform Engineer to help evolve a large-scale financial data platform. The environment includes both long-standing enterprise systems and modern AWS cloud services. … platform handles high-volume structured data and supports internal systems and customer-facing products.A big part of the role involves working with large SQL Server environments, so strong SQL skills are essential. You'll help modernise core systems, improve performance and reliability, and build scalable backend and data ...

Cleared DevSecOps Platform Architect & Engineer to join a high-profile, secure military IT programme, delivering highly resilient, automated, and secure data platforms. This role sits at the intersection of DevSecOps, platform engineering, cloud infrastructure, and secure data systems, supporting advanced research and large-scale data … where failure is not an option, you'll feel right at home. Key Responsibilities Design, build, and maintain secure DevSecOps platforms supporting sensitive data workloads Architect and deliver automated CI/CD and GitOps pipelines for rapid, secure deployments Develop and manage secure cloud and hybrid infrastructure Implement ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

digital tools supporting flexible connections and DERMS. Perform power system studies (thermal, voltage, fault level) to identify network constraints. Develop Python-based tools, data pipelines, dashboards, and APIs . Use GitHub for version control and collaborative development. Work with teams across DSO, Planning, Operations, and IT , as well ...

boundaries of modern cloud security. You’ll be joining a world-class engineering team tackling genuinely hard problems - distributed systems, large-scale data pipelines, real-time detection, and automated response systems. This is hands-on, high-impact work, with the code you ship being in production fast ...

operational challenges and build high-impact solutions that bridge product and deployment. The role is intentionally broad and may include: Building and optimising data pipelines Developing backend services and APIs Creating lightweight UI components where needed Supporting on-site integration with customer environments Feeding real-world insights back ...

automation, and scalable platform engineering , typically involving technologies such as: Large language model–driven systems AI-assisted automation and orchestration Intelligent workflow systems Data pipelines and evaluation frameworks Distributed platform architectures What We’re Looking For Core Experience Strong experience building complex software platforms or distributed systems Experience ...

great opportunities to combine foundational statistics with modern AI to find meaning in consumer finance data. We are looking for a hands-on Data Scientist to work alongside our lead data scientist to experiment, engineer, and deliver innovative predictive models into our modern AWS production environments. … Current Areas of Focus: Affordability, income and expenditure analysis, credit risk, and fraud detection, with excellence in Entity Resolution – tying together disparate consumer data into a holistic view. Your work will directly help traditionally underserved consumers to access the most suitable financial products, whilst supporting our customers ...

across major exchanges and wagering markets. This role sits within a small technical team responsible for building and maintaining the internal tools and data infrastructure that support trading activity. You will work closely with traders and analysts to develop systems that process large volumes of sports data and enable real-time decision making. The Role The position focuses on building internal platforms and data pipelines used by trading teams. The successful candidate will be involved in developing new functionality, maintaining existing systems, and ensuring data reliability across the trading environment. ...

availability and resilience across Azure-hosted environments Architect robust backend services in Python using modern frameworks (FastAPI, Pydantic), implementing clean API design, efficient data pipelines, and integration patterns within our Azure ecosystem Establish and enforce best practices for the TypeScript/React frontend, ensuring a highly performant, accessible … intuitive user experience, including real-time interfaces and interactive data visualisations Lead the configuration and optimisation of Azure cloud environments, establishing robust CI/CD pipelines with GitHub Actions or Azure DevOps, and ensuring cost-optimised use of Azure services and container orchestration resources Set the standard ...

Azure and AWS AI stacks, Fast API microservices, Kubernetes, and secure vector search patterns. Strong background in FinOps, secure landing zones, and regulated data architectures aligned to FS controls and Responsible AI standards. Have delivered cross-cloud AI patterns across Microsoft Partner ecosystems and interoperable 3Ps wih platform … agnostic vector architectures. Deep expertise in IT architecture, data platforms, and product development, combined with strong influence across ISD and the Microsoft Partner ecosystem. I create clarity in ambiguity - converting executive ambition into structured architecture, adoption, and measurable value help in shaping multi-year transformation portfolios, structuring investment ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives … their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‐to‐end processing. Deliver new technical features and components aligned to approved solution ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...