276 to 300 of 337 Data Pipeline Jobs in the UK

delivery and oversight of technology supporting AML and Financial Crime functions, including: Owning the system architecture of AML platforms (rule engines, alerting systems, data pipelines). Designing scalable, secure and high-performance systems for transaction monitoring and analytics. Translating regulatory and audit requirements (KYC, CDD, CRR) into actionable … technical logic. Managing integrations with third-party data sources (PEP lists, sanctions vendors, screenings). Acting as a technical intermediary between compliance stakeholders and platform engineering teams. Conducting detailed data analysis in line with business and regulatory needs. Performing feasibility assessments, estimating resources, timelines and system ...

works. You will help us automate manual tasks, connect AI agents to our CRM and ERP systems, strengthen customer interactions with data-driven “proof packages,” and explore new AI-enabled capabilities that strengthen our position as a UK leader in custom battery technology. This role is ideal … documentation, production forecasting). Create AI workflows that integrate with our CRM and ERP systems (including IFS Cloud), enabling smarter insights, rapid data retrieval, and improved traceability. Maintain AI agents that support internal teams, including text-analysis bots, report generators, and knowledge-retrieval tools. Data engineering ...

What You’ll Be Doing Research, train, and fine-tune large language models (LLMs) for real-world applications. Develop and optimise pipelines for data collection, preprocessing, and model evaluation. Collaborate with product engineers to deploy models into scalable production systems. Experiment with prompt engineering, RAG architectures, and multimodal … give you time and resources to explore, learn, and publish. What We’re Looking For 0–3 years of experience in Machine Learning, Data Science, or NLP/LLM. Strong Python skills; exposure to PyTorch/TensorFlow/Hugging Face. (Bonus) understand fundamentals of deep learning, LLMs ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible click apply for full job details ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible click apply for full job details ...

Graduates and Apprentices across the business. On joining, you will be assigned to start in one of the following roles. Insights and Data (I&D) Build secure, scalable data pipelines using modern tools and cloud platforms. Create dashboards, automate testing, and support data governance. … entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. Get the Future You Want ...

Graduates and Apprentices across the business. On joining, you will be assigned to start in one of the following roles. Insights and Data (I&D) Build secure, scalable data pipelines using modern tools and cloud platforms. Create dashboards, automate testing, and support data governance. … entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. Get the Future You Want ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/… Scala Experience: Experience working on large data sets, and complex data pipelines click apply for full job details ...

Role Summary We are seeking a highly skilled Data Engineer with strong AIML (LLMs, Generative AI, Agentic AI) and Python expertise to design, develop, and implement AI/ML-driven solutions for Test Automation within the Securities Processing domain. The ideal candidate will work on building innovative AIML … copilots, autonomous AI agents, and MCP-based systems. Build, train, fine-tune, and evaluate AIML models for automation use cases. Develop Python-based data pipelines and algorithms using NLTK, NumPy, Scikit-learn, Pandas. Collaborate with cross-functional teams in an Agile setup (sprint planning, refinement, retrospectives). Integrate ...

move faster than a typical tech organisation ever allows, this might be for you. What youll be doing Architect core infrastructure and data pipelines Build integrations with external APIs and providers Develop internal tooling and contribute directly to product roadmap decisions Work across backend, frontend, data … Python + TypeScript/Node.js (in equal measure) API integrations, ETL, schema validation React/TypeScript, Supabase, AWS Data quality systems and pipeline tooling Whatever the mission requires we optimise for impact, not rigidity What matters most Ownership: You think like a founder. You ship fast, iterate ...

currently working with a London-based Investment Bank who are actively seeking a highly skilled Data Scientist/Developer to join a market-leading team in the Fixed Income space. What you'll need to succeed Extensive Data Science experience within Investment Banking - Mandatory. We will … consider candidates without this experience. Strong Data Engineering and Data analysis experience, with strong knowledge of Pandas, NumPy, and visualisation tools. Strong Python programming experience, with good experience building and maintaining Data Pipelines. Good knowledge of Fixed Income products. Strong experience in statistical analysis ...

significant demand from global customers, the company is now looking to appoint a hands-on IoT/DevOps Engineer to own device connectivity, data flows, and system integration across their next-generation platform. This is a rare opportunity to join a small, agile, engineering-driven organisation where your …/Device → Tablet (Bluetooth) → Cloud Dashboard (ThingsBoard). You’ll work across real hardware, embedded devices, gateways, industrial protocols, and cloud dashboards—ensuring data moves cleanly, securely, and consistently. This is not a pure coding role. It is a practical, problem-solving IoT role suited to someone ...

threat intelligence integration, leveraging Microsoft Sentinel Model Context Protocol (MCP) for advanced context-aware analytics and automation. Develop and maintain security analytics and data pipelines within Sentinel Data Lake to support large-scale threat detection, incident response, and threat hunting, while optimizing cost and enabling Agentic … mentor a team of Cyber Defence Security Engineers. The Requirements: Must-Have Skills: Microsoft Sentinel Expertise : Architecture, deployment, management, including AI for Security, Data Lake optimization, MCP, and Sentinel Graph. Cloud Security Tools : Hands-on with Wiz Cloud (Defend, Runtime Sensor, Code), CSPM, and CWP. Automation & Integration : Using ...

leading provider of catering and support services to the education sector in Oxford are seeking a talented and detail-oriented Junior Data Analyst to join their team. KEY DUTIES Collect, clean, and analyse large datasets to uncover trends, patterns, and insights. Develop and maintain data pipelines … workflows to ensure data integrity and accessibility. Design and implement data models and visualizations to communicate findings to stakeholders. Collaborate with cross-functional teams to identify business requirements and translate them into data analysis solutions. Conduct ad-hoc analyses and deep dives to support ...

technical requirements, this isn't essential. Key Responsibilities Own the end-to-end system architecture for anti-money laundering platforms (rule engines, alerting, data pipelines) across banking and securities under a dual-hat remit. Design scalable, secure and high-performance solutions for transaction monitoring, sanctions screening and batch … planning: break large initiatives into phases, assess feasibility, estimate effort and impact, and propose new technologies where appropriate. Oversee integrations with third-party data providers (e.g. sanctions/PEP list vendors) and ensure data quality, lineage and reconciliation. Prepare and maintain operational documentation (HLD/ ...

Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: Youll work across backend, frontend, and data services, contributing to new features, improving existing systems … develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection ...

LLMs) for business use cases using prompt engineering and reinforcement learning. Experiment with model configurations to balance performance, cost, and scalability. Build robust data pipelines for continuous model improvement and retraining. Ensure compliance with ethical AI and data governance standards (privacy, bias mitigation). Develop APIs … Required Skills Programming: Python, .NET/C# (Key to have a background in C#) Knowledge of AI principles and AI ethics Knowledge of data safety in LLM usage Experience with: AWS: boto3, Bedrock, SageMaker, Lambda, S3, EC2 Azure: Azure OpenAI Service, Cosmos DB Retrieval-Augmented Generation (RAG), Graph ...

threats. As a Senior Backend Engineer , youll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assetshelping global security teams uncover exposures before attackers do. What youll be doing: Designing and building backend services and data pipelines powering a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally ...

Senior Backend Engineer , you’ll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assets—helping global security teams uncover exposures before attackers do. What you’ll be doing: Designing and building backend services and data pipelines powering a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data ...

demand (will be reimbursed) The Role This is for an Agentic AI Role in Lloyds Banking Group . Key Responsibilities Build scalable data pipelines and workflows on GCP (Big Query, Vertex AI, Dataflow, Pub/Sub, Redis and NoSQL Databases, maintaining chat history, etc.) Implement best practices … data governance, security, and MLOps on GCP Optimize model performance, monitor production systems, and ensure reliability, auto scaling using Prometheus, Dynatrace, and Lang Smith Desirable Skills/Knowledge/Experience Hands-on experience with GenAI, Gemini, or open-source LLMs; train, fine-tune, and onboard new LLMs Experience ...

work through an umbrella company for the duration of the contract. You must be able to implement and support content-related configurations and data pipelines, ensuring structured metadata and reliable delivery. You will have experience of designing and maintaining schemas, mappings and validation rules for content. You will … also be able to build/operate ETL/ELT jobs, ensuring data quality and lineage. You will collaborate with editors and product teams on release readiness and automate checks and monitoring. Experience of Data Engineering and SQL, Python and ETL tools. You must have knowledge ...

pipelines for ML models, agents, and GenAI applications. Deploy LLMs and orchestrate multi-agent systems (LangChain, LangGraph, or custom). Create and maintain data pipelines (Airflow, dbt, Step Functions). Implement monitoring, observability, and automated retraining (CloudWatch, Prometheus, Grafana, MLflow). Embed strong security, compliance, and guardrail practices … Experience with MLflow , CI/CD tools, and automated testing. Hands-on with LLM deployment and multi-agent systems . Proven experience building data pipelines and production ML workflows. Strong grounding in software engineering best practices and cost optimisation. Nice to Have Consulting or pre-sales background. Experience ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier ...

Databricks Data Engineer Azure Cloud & Performance Optimization £400-£458pd (Inside IR35) SC Clearance is Essential Remote Overview We are seeking a Databricks Data Engineer experienced in building high-quality data pipelines and optimizing large-scale workloads on the Databricks Data Intelligence Platform ...