1,751 to 1,775 of 2,479 Data Pipeline Jobs in the UK

Fabric Data Engineer: Build Scalable Pipelines & Analytics

Location
United Kingdom
Dynatechconsultancy is seeking a Microsoft Fabric Data Engineer to design and manage data pipelines and analytics platforms, working with architects and business teams to ensure reliable, high-performance data processing and reporting. Design and build pipelines with Microsoft Fabric … develop data transformation workflows, and ensure data quality and consistency across systems for accurate reporting. Collaborate with analytics teams, optimize pipeline performance, maintain documentation, and #J-18808-Ljbffr ...

Data Engineer - Scalable Pipelines & Impactful Dashboards

Location
Greater London, England, United Kingdom
NextGenEnergyJobs is seeking a data engineer to design, build, and maintain scalable data pipelines in Databricks while ensuring data reliability. You will own Databricks models, define schemas, test, and maintain a clean data warehouse. The role also focuses on automating processes with … Python and delivering useful dashboards for Finance and Asset Management. You will integrate systems via REST APIs, promote data quality through monitoring and governance, and collaborate with non-technical #J-18808-Ljbffr ...

Senior BI Analyst: Power BI, SQL & Azure Data Factory Lead

Location
Brighton, England, United Kingdom
provide expert analytics, reporting, and BI support for external partners in health and care. You will lead on complex datasets, dashboards, and data pipelines while ensuring data quality, governance and security. You will collaborate with multiple project teams, mentor junior analysts, and maintain relationships with internal … external stakeholders. The role requires strong SQL, Power BI skills, and experience with data integration tools such as #J-18808-Ljbffr ...

Lead Analyst - Payment Operations Risk

Hiring Organisation
Wise
Location
London, UK
Employment Type
Full-time
Operations Analyst who is passionate about our mission of Money Without Borders. You will partner with our Payment Operations organisation to help drive data-driven decisions that would evaluate the current risks the organisation faces, interpret risk appetite and monitor and control for these risks. The Payment Operations … that support the organisation's risk appetite and build control assurance models around our risky payment processing flows. You will also own the data behind the reconciliation of bank balances and customer funds to ensure that there are no material financial discrepancies. You will own the relationship with ...

Senior Audio AI Research Engineer

Hiring Organisation
Logitech
Location
London, UK
Employment Type
Full-time
within a given space. Address complex challenges before deploying new Audio AI technologies. This involves optimizing integration with other components in the Audio AI pipeline, identifying the most effective task combinations, and developing strategies to minimize bias while enhancing robustness against noise, reverberation, and echo. Conduct in-depth research … deployment, and C++ optimization. Demonstrate the ability to rapidly prototype Audio AI technologies by implementing research papers and extending them—such as modifying data augmentation strategies, adjusting FFT parameters, incorporating auxiliary tasks, and optimizing loss functions. Experience with data-driven algorithm tuning using metadata evaluations ...

Databricks Lead Engineer: Lakehouse & Pipelines

Location
Greater London, England, United Kingdom
DATA, Inc. is seeking an experienced Data Engineer to design and deliver Databricks-based data pipelines for complex client projects. You will engage with clients, collaborate with architects and engineers, and drive best practices across the data lifecycle. The role requires … years in data engineering, strong SQL/Python, and hands-on experience with Databricks on cloud platforms such as AWS, Azure, or GCP. #J-18808-Ljbffr ...

Director, Artificial Intelligence & Machine Learning Engineer

Hiring Organisation
Hackajob Ltd
Location
Edinburgh, Midlothian, Scotland, United Kingdom
Employment Type
Permanent, Work From Home
systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

Vice President, Artificial Intelligence & Machine Learning Engineer

Hiring Organisation
Hackajob Ltd
Location
Edinburgh, Midlothian, Scotland, United Kingdom
Employment Type
Permanent, Work From Home
deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

Director, Artificial Intelligence & Machine Learning Engineer

Location
City of Edinburgh, Scotland, United Kingdom
deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

Senior Forward Deployed Engineer

Location
Greater London, England, United Kingdom
enterprise that impacts the customer will be disrupted. We believe the future will run on the connective tissue between people, machines and data: all in the service of creating the most human processes and experiences for customers and employees. Job Description: About the Role As a Senior Forward … just coding - you're solving some of the most exciting challenges and problem solving in enterprise AI rollout, spanning enterprise data pipelines, multi‐agent orchestration/workflows and RAG/SLM finetuning. Responsibilities Lead the technical solution design and implementation of large‐scale Agentic and Knowledge AI solutions ...

AI-Powered Data Engineer for Scalable Pipelines

Location
Greater London, England, United Kingdom
Arct a L is seeking a data-obsessed individual to manage AI agents in Old Street, London. You will ensure data quality and build efficient data pipelines while debugging issues. This is a full-time, in-office position with a salary range … 100k and requires experience in data science or a related field. The role emphasizes data engineering and AI tool usage, making it ideal for candidates passionate about data accuracy and system optimization. #J-18808-Ljbffr ...

Full Stack Software Engineer

Hiring Organisation
SF Partners
Location
Nationwide, United Kingdom
Employment Type
Permanent
Salary
£90000 - £100000/annum great project work & progression
Full Stack Software Engineer with a proven track record of building enterprise, highly scalable data platforms is sought on hybrid basis by a market leading software house with offices across the UK. You will work across the full technology stack, developing APIs and microservices, building scalable data … Typescript, Python, Java etc - Solid front end understanding - React, Next, Vue.js etc - Experience building scalable pipelines (Apache Spark, Airflow, dbt etc) - Experience building data lakes, data warehouses and/or real-time streaming solutions would be a real plus - Strong API and microservices development experience - Cloud ...

Senior Software Engineer, Real-Time

Location
Greater London, England, United Kingdom
Build and improve software components that aggregate, correlate and present data from over 30 global distribution sites Develop applications and data-processing logic to identify performance issues, service degradation and hotspots across distributed systems Contribute to telemetry pipelines that ingest, transform and route metrics, logs … telemetry standards is desirable Exposure to Kubernetes, containers or cloud platforms is desirable Exposure to data-processing, event-streaming or telemetry-pipeline technologies is desirable Exposure to CI/CD, GitOps or configuration-as-code approaches is desirable Exposure to synthetic monitoring, automated testing, probes or distributed ...

AI Solutions Technical Engineering Manager

Location
Greater London, England, United Kingdom
ready to LEVEL-UP THE GAME? We’re looking for an AI Solutions Technical Engineering Manager to lead the delivery of AI- and data-enabled products and platforms from early shaping through to measurable outcomes in production. You’ll operate at the intersection of engineering leadership, AI delivery … drive innovation while delivering under tight timelines and high expectations. The role You will lead multidisciplinary engineering teams (AI/ML, data, software, platform) to deliver AI capabilities that are trusted, adopted, and production-grade . You’ll partner with senior stakeholders & Product Managers to define outcomes, guide ...

Senior Software Engineer (Backend)

Location
Greater London, England, United Kingdom
decision intelligence company used by governments, defence organisations, financial institutions, and corporates operating in complex, fast-moving environments. Our capabilities fuse curated data sources, domain-specific AI, and deep human expertise to transform information overload into clear, actionable foresight. Our ambition is to become the analytical backbone that … over which problems we take on. Breadth rather than a narrow track. The work follows the problem, which means service design one month and pipeline or infrastructure work the next. Engineers here have the opportunity to build depth across several areas rather than being funnelled into one. Progress without ...

Enterprise Architect

Location
Greater London, England, United Kingdom
within our Business Solutions Team, the role works across the whole of IT, collaborating closely with Infrastructure, Information Security, Business Solutions, Legal Tech, Data Architecture and Insights, Finance Systems and our Project Management Office to ensure solutions and platforms are designed from the ground up with our full … cloud strategy across major platforms. Cross-Team Collaboration: Work across the whole of IT, partnering with Infrastructure, Information Security, Business Solutions, Legal Tech, Data Architecture and Insights, Finance Systems and our Project Management Office to take solutions and platforms from concept through to production. Business Translation: Evaluate business ...

Senior Python Engineer

Hiring Organisation
INTEC SELECT LIMITED
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£450.00 per day
Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach … ability to take ownership in a fast-paced, evolving environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design ...

Applied AI ML Lead - Python & Agentic AI

Location
Auchentibber, Scotland, United Kingdom
maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Applied AI ML Lead - Python & Agentic AI

Location
Glasgow, Scotland, United Kingdom
maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Lead Data Engineer - Python, SQL - Team Lead - Vice President

Location
Greater London, England, United Kingdom
agile team that's constantly pushing the envelope to innovate, build, enhance and deliver top-notch technology products. As a Lead Data Engineer at JPMorgan Chase within the GIB and a part of the Capital Markets Team you are an integral part of an agile team that works … solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Lead a Squad of Data Engineers to meet business deliveries working with Product and Design leads. Lead Agile ceremonies including standups, retros and technical refinements. Self-starter able ...

RVP Forward Deployed Engineering, Salesforce

Location
Greater London, England, United Kingdom
future of Salesforce. We are Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower … Technical Authority: Serve as the final technical escalation point for your portfolio. Maintain deep architectural judgment across the Salesforce platform, advanced LLM techniques, data pipelines, and agentic orchestration. Guide Enterprise Implementations: Unblock complex data readiness, tool integration, and multi-agent orchestration challenges. Step in directly ...

Staff Software Engineer - Machine Learning

Hiring Organisation
Capital One UK
Location
London, UK
Employment Type
Full-time
United Kingdom, London, London Staff Software Engineer - Machine Learning About this role We’re on a mission to transform the way we use data and AI to service our customers and drive efficiency across the business. Do you love shaping the technical landscape and driving innovation across … MLOps standards and practices across teams, including CI/CD for models, automated testing, monitoring, and deployment pipelines Collaborate with enterprise platform and data science teams, contributing to platform capabilities where appropriate and partnering on use case delivery Build and maintain strong relationships with key stakeholders, including senior ...

Azure Data Engineer — Real-Time Analytics for Energy Markets

Location
Greater London, England, United Kingdom
RocketFin Inc in Greater London is looking for a skilled Data Engineer to build and enhance data pipelines and automation workflows on Azure. Responsibilities include maintaining and optimizing toolkits, databases, and supporting real-time analytics within a dynamic trading environment. The ideal candidate will have strong … proficiency in Python and hands-on experience with Azure services like Data Factory and Databricks. Familiarity with Snowflake data models and third-party market data APIs is essential for success in this role. #J-18808-Ljbffr ...

Software Quality Engineer

Location
Greater London, England, United Kingdom
agents and LLM-powered applications Design and develop robust, scalable, and maintainable automated test frameworks Collaborate with product managers, machine learning engineers, and data scientists to translate AI features and model behaviors into test cases and validation criteria Improve testing processes and infrastructure, integrating automated checks into … model performance and contribute to post-release quality validation Champion quality best practices across engineering teams Design, manage, and maintain test data strategies and mock services Manage the full defect lifecycle using customer feedback and debugging logs Report directly to the director of engineering Requirements 5+ years ...

Lead Software Engineer, Team Lead

Hiring Organisation
Marsh & McLennan Companies
Location
London, UK
Employment Type
Full-time
Lead end-to-end delivery of CAT products (e.g., Concierge an agentic AI workflow tool, Prism a Mercer knowledge fabric for scheme data, and similar initiatives), from problem framing and design through build, release, and support. Translate risk advisory/consulting needs into clear technical requirements, user stories … solution designs; partner with stakeholders through UAT and rollout. Own the backend and integration approach (APIs, data flows, security, RBAC), and ensure solutions are scalable, maintainable, and well documentedProvide technical leadership for a distributed team (London + India): sprint planning input, code reviews, mentoring, and raising engineering standards. ...