476 to 500 of 580 Data Pipeline Jobs in the UK excluding London

Lead AI Engineer Leeds or Edinburgh £72,000 - £108,000 Your new role The Data, Technology and Innovation (DTI) division enables the group to be a digital-first, data-led smart regulator by delivering a secure, agile, and cost-effective technology and data ecosystem … consistency and delivery quality to enable more reliable and scalable product development Establish end-to-end technical architectures for LLM-enabled systems, covering data pipelines, retrieval/RAG, prompt orchestration and agent workflows to support robust and effective AI implementation Analyse complex constraints across product, data ...

ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and securityUnderstanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage … within team practicesHands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environmentPreferred qualifications, capabilities, and skillsExperience leading engineering teams within a large, complex organizationFamiliarity with modern cloud technologies and deployment practicesExperience ...

critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within … team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred qualifications, capabilities, and skills Experience leading engineering teams within a large, complex organization Familiarity with modern cloud technologies ...

FanDuel is seeking a Senior Engineering Manager to lead teams of data engineers and consultants in building scalable data pipelines powering BI, analytics, fraud detection, and reporting. You will partner with Data Architects, Product Managers, Analytics, and Engineering to set strategy, govern platforms … ensure reliable, cost-effective data services. You will mentor and grow a high-performing team, balance hands-on engineering with people leadership, and drive data-driven decision making #J-18808-Ljbffr ...

from identification to a live, production-ready state. Build Robust Automations: Ensure all AI-driven processes are backed by enterprise-grade technology, robust data pipelines, and reliable API integrations. Report on Service Health: Provide the Senior Director, Global IT with data-driven insights into the performance … operational friction. Adopt AI Guardrails: Collaborate with the Security team to ensure all internal AI implementations remain compliant with InfoSec pillars and data privacy standards. WHAT YOU NEED TO BE SUCCESSFUL IN THIS ROLE Execution Experience: 8+ years in IT or Software Engineering, with at least 3 years ...

Sperry Rail is seeking Full Stack Engineers with a data science focus to design, build, and maintain data-driven applications behind Zula 2.0, the platform that ranks and fuses outputs from rail inspection systems. You will work across the full stack with emphasis on backend data processing, analytics, and ML workflows hosted on AWS. Bring strong Python, data pipelines, AWS experience, and a collaborative mindset to translate rail inspection requirements into scalable technical solutions while #J-18808-Ljbffr ...

production ML/AI platforms on Microsoft Azure. You will coach a compact team of MLOps, Analytics and AI Engineers, and collaborate with Data Science and Software teams to push reliable, auditable models into production. The role emphasises governance, CI/CD, and scalable data pipelines. ...

Viridien (www.viridiengroup.com) is an advanced technology, digital and Earth data company that pushes the boundaries of science for a more prosperous and sustainable future. With our ingenuity, drive and deep curiosity we discover new insights, innovations, and solutions that efficiently and responsibly resolve complex natural resource, digital, energy … language applications. Adapt agent workflows, models, tools, retrieval systems and configurations for production use. Integrate AI systems with enterprise APIs, databases, applications and data platforms. Develop reusable connectors, APIs and Model Context Protocol tools. Build automated CI/CD, testing, configuration management and deployment workflows. Implement authentication, access ...

Viridien () is an advanced technology, digital and Earth data company that pushes the boundaries of science for a more prosperous and sustainable future. With our ingenuity, drive and deep curiosity we discover new insights, innovations, and solutions that efficiently and responsibly resolve complex natural resource, digital, energy transition … language applications. Adapt agent workflows, models, tools, retrieval systems and configurations for production use. Integrate AI systems with enterprise APIs, databases, applications and data platforms. Develop reusable connectors, APIs and Model Context Protocol tools. Build automated CI/CD, testing, configuration management and deployment workflows. Implement authentication, access ...

applications on AWS . Integrate Large Language Models (LLMs), vector databases, and modern AI frameworks into production systems. Build secure, reliable, and performant data pipelines to power AI applications. Collaborate with product managers, engineers, and stakeholders throughout the deployment lifecycle. Optimize AI solutions for performance, reliability, and cost. … developing Generative AI applications using modern LLMs. Strong understanding of AI application architecture, APIs, and distributed systems. Experience working with structured and unstructured data . Ability to rapidly prototype solutions and iterate in fast-moving customer environments. Excellent problem-solving and debugging skills. Strong communication skills with ...

existing codebase while growing your skills in an agile, supportive environment. Required Skills & Experience of the Software Engineer: Strong Python: Writing and maintaining data pipelines. Able to solve complex problems. Excellent written, oral and visual communication skills to explain complex information. Enjoys and works well in a team … modifying existing/legacy codebases; good documentation and PR practices. SQL Databases: PostgreSQL and SQLite experience (schema design, migrations, basicperformance tuning). Orchestration & data engineering: experience with workflow/orchestration tools (Prefect or similar) and distributed task queuing (e.g. Celery, RabbitMQ). Testing & automation: writing unit and basic ...

Worky in the United Kingdom seeks a Full Stack Engineer with a data science focus to bridge data engineering and user-facing dashboards for Zula 2.0, the platform ranking and fusing rail inspection data. This seat decides what analysts and customers see and drives progress through … year-end. You will design data pipelines, build dashboards with React, develop RESTful APIs, and deploy ML models on AWS, collaborating with analysts, engineers, and product managers across the rail business. #J-18808-Ljbffr ...

dashboards. Working with key stakeholders to develop and deliver a digital transformation roadmap focused on efficiency, waste reduction and continuous improvement. Partnering with Data Science and AI teams to explore how predictive analytics can be integrated into production processes. Identifying opportunities to improve manufacturing performance through digital tools … automation, data insights and Industry 4.0 solutions. Creating governance and change management processes for internally developed digital tools, ensuring they are secure, structured and sustainable. Tracking the success of digital initiatives by defining and monitoring KPIs, ensuring digital investments deliver measurable improvements. Acting as the link between ...

JPMorganChase's Investment Banking Data Products team is seeking a Software Engineer III to design and deliver reliable data collection, storage, and analytics solutions that are secure, scalable, and compliant with enterprise standards. You will develop and maintain data pipelines using Python and Databricks … review controls for data protection, and apply AI-assisted development tools to improve quality while ensuring traceability and auditability. #J-18808-Ljbffr ...

Opus have partnered with a global FinTech company who're undergoing a large transformation to move their existing data platform from BigQuery to Snowflake. - Rate: £450 per day (Outside IR35) - Start Date: September 2026 - Length : 6 months - Working pattern : Fully-remote Key Requirements: Strong Snowflake experience (ideally 2+ … years) Experience with data platform migrations, particularly into Snowflake Building data pipelines, lineage frameworks, dynamic tables and semantic views Strong SQL and Python skills Experience with dbt (or similar tools such as Dataform) Exposure to Snowflake Cortex and Streamlit applications is highly desirable Agile environment experience ...

JPMorganChase is seeking a Data Engineer to enhance, build, and deliver scalable data collection, storage, and analytics solutions for CIO, Treasury & Corporate Risk Management. You will maintain critical data pipelines across multiple technical areas and drive AI-powered data initiatives while ensuring ...

JPMorgan Chase & Co. is seeking a Lead Data Engineer to join the Corporate Technology team in Glasgow. You will enhance, build, and deliver data collection, storage, access, and analytics solutions that support AI and analytics initiatives across the firm. The role emphasizes secure, scalable data pipelines and architectures, with a focus on governance and regulatory compliance. You will collaborate with cross‐functional teams to enable data-driven decisions, drive innovation, and raise the bar #J-18808-Ljbffr ...

Role Overview and Responsibilities TT Electronics, Bedlington , are hiring for a Lead Digitisation Engineer to lead the strategy, architecture, and implementation of automated data pipelines, IoT integration, smart manufacturing systems, and advanced analytics. Working directly to drive yield optimisation, predictive maintenance, and lights-out automation across our cleanroom … infrastructure. Key Responsibilities Include: Designing and owning the Industry 4.0 Strategy & Roadmap. Driving the integration of legacy and modern microelectronics equipment. Architecting robust data pipelines to collect, store, and analyse process data. Collaborating with process engineers to implement advanced process control (APC), statistical process control (SPC), and machine ...

Vertus Partners is seeking an experienced AI/data engineer to help with the greenfield design and build of the next generation data foundations that power search, analytics and AI-driven applications across the business. This is a hands-on role focused on designing robust data pipelines, improving data accessibility and creating scalable solutions that enable better use of information across a complex technology environment. #J-18808-Ljbffr ...

JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and deliver AI and data engineering solutions at scale, with a focus on secure, reliable production systems. You will drive agentic AI initiatives, build data pipelines, and collaborate across teams to align ...

with cloud and third-party AI services to deliver production-ready outcomes. Your role spans the full solution lifecycle assessing client needs and data, selecting and customizing models (including Deep Learning, Generative AI, and Large Language Models), designing scalable data and DevOps &MLOpspipelines for training … practical, efficient, and scalable AI and Machine Learning solutions Develop and implement machine learning algorithms, models, and computational systems; design and build scalable data pipelines to support model training and production with DevOps &MLOps Customize and apply Deep Learningand Gen AI models for various use cases based ...

carbon-dioxide fluxes, and their coupling with the atmosphere, including links with atmospheric composition. It works closely with colleagues specialising in atmospheric composition, data assimilation, atmospheric modelling, machine learning, evaluation and operations, as well as with Member and Co-operating States and external partners, to support the delivery … European Commission Strengthen ECMWF’s engagement with WMO G3W and take a proactive role in collaborations with the wider greenhouse-gas observation, modelling, data-assimilation and inverse-modelling communities, representing ECMWF where appropriate Design numerical experiments, develop robust scientific software and support the transition of scientifically mature developments ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

make clear recommendations on what to ship, iterate, or retire. Build and maintain LLM-powered features: retrieval pipelines, reranking systems, insight agents, data mining agents, and automated taxonomy generation. Design and run robust evaluation frameworks: build test sets, define metrics, evaluate non-deterministic systems, handle class imbalance … retrieval, evolving from embedding-based approaches toward more advanced methods. Write production-quality code and collaborate closely with Engineering on productionisation, model serving, data pipelines, and monitoring. Work with Product and Commercial teams to translate business needs into practical ML solutions, and support client evaluations and accuracy benchmarking. ...