101 to 125 of 261 Data Pipeline Jobs in the UK excluding London

Data Lead - GCP We are looking for an experienced Data Manager to lead a high-performing Data Engineering team building scalable data and reporting platforms used by global stakeholders. In this role, you will guide the development of high-throughput, database-centric … applications that process and deliver critical operational data at scale. Working within a cloud-first architecture on Google Cloud Platform (GCP), you will play a key role in designing and delivering modern data solutions using BigQuery and distributed systems. You will lead a geographically distributed team ...

Data Engineer (Permanent) Salary: Up to £65,000 Location: London Victoria (1 day per week onsite, rest remote) The Role We are seeking a skilled Data Engineer to join a growing team delivering modern, scalable data solutions. This is a permanent opportunity offering … days per week in London Victoria and the remainder working remotely. You will play a key role in designing, building, and optimising data pipelines and platforms, supporting advanced analytics and business intelligence initiatives. Key Responsibilities Design and develop scalable data pipelines and data processing ...

Lead Data Engineer Up to £100,000 *Kafka or Kinesis required London (4 days onsite) This is a great opportunity to join a high-growth organisation where you can take ownership of building and architecting a greenfield data platform for an AI-driven product. THE COMPANY … EXPERIENCE: You will bring strong capability in: Python development and building scalable distributed data systems Data architecture design and pipeline development Batch and streaming data processing Relational databases (PostgreSQL or similar) NoSQL and modern vector databases (e.g., Qdrant, Milvus, pgvector) THE BENEFITS ...

most recognised and celebrated personal lines insurers. The successful candidate will be working alongside a talented team of Data & AI Engineers, Data Scientists, Analysts, Developers and Architects to design and deliver cutting-edge machine learning and AI-driven solutions. From enabling advanced analytics to supporting product … performance optimisation using tools such as DBT and distributed processing frameworks like SparkSQL. Experience with CI/CD, version control (e.g. Git, Jenkins) and pipeline orchestration tools such as Airflow. A collaborative mindset with excellent interpersonal skills, and a passion for building robust, scalable data platforms. ...

Lead Data Platform Engineer – DataOps Location: Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core financial data ecosystem. This senior, hands‐on engineering role … operations, ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong ...

Data Engineering Lead - Value & Analytics Location: London or Edinburgh Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking … Data Engineering Lead to join its Value Management function. You will build the technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard ...

Role Summary We are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation . Key Responsibilities Act as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams. Design and deliver Voice ...

Overview Expleo is seeking a Data Engineer/Data Scientist with a strong background in IT quality, testing, and aerospace engineering to join our dynamic team in Derby. This role is ideal for someone who thrives in high-integrity environments and is passionate about ensuring data accuracy, reliability, and performance in mission-critical systems. You'll work at the intersection of Python development, data validation, and engineering analytics, supporting aerospace programmes with cutting-edge tools and methodologies. Responsibilities Rapidly design, configure & deploy EHM solutions to support the service and improve its effectiveness. ...

Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer … join a critical, secure environment. This role involves designing, building, and maintaining robust data pipelines and platforms to enable advanced analytics and intelligence operations. What you'll be doing: Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. Manage ETL/ ...

Senior Data Engineer - London (Hybrid) - Up to £65,000 We're supporting a leading organisation to deliver diverse transformation programmes. This is an excellent opportunity for an experienced Data Engineer to play a key role in delivering enterprise-scale data and AI solutions, while … providing technical leadership across complex projects. You'll work alongside highly skilled engineers, architects, and data specialists to build innovative data platforms that support advanced analytics, AI, and machine learning initiatives. Whether you're looking to expand your influence as a technical leader or take ownership ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineer to join our team in Milton Keynes on a permanent basis. This role offers a salary of £48,000 - £53,000 per annum with … code reviews and shared problem-solving What you will need: Solid hands-on experience with Azure Data Factory, including end-to-end pipeline delivery Proficient in Python, Spark and SQL for data processing and transformation Experience with Databricks in a production or near-production environment ...

Data & ML Engineer Location: Newcastle upon Tyne (Hybrid 3 days onsite) Salary: £40,000£65,000 + Benefits We're looking for an experienced Data & ML Engineer to join a growing technology team delivering modern data platforms and AI-driven solutions. This … excellent opportunity to work on large-scale data engineering and machine learning projects using the latest cloud technologies. The Role You'll design, build and optimise scalable data pipelines while developing and deploying machine learning solutions that solve complex business challenges. Working across cross-functional teams ...

Lead Data Engineer - London London Hybrid - Monday to Thursday in the office. Friday work from home Salary £85,000-£95,000 dependent on experience Ref J13147 Build the function. Lead the team. Stay hands on. Join a fast-growing AI SaaS business where Data Engineering sits … heart of the platform. This is an opportunity to join at a pivotal stage of the company's growth. As Lead Data Engineer, you'll shape and scale the Data Engineering function, define engineering standards and build a high-performing team, while remaining hands on with ...

Sparta Global are hiring a Senior Data Engineer - this is a role that combines hands-on engineering with technical leadership, including mentoring junior engineers and driving best practice across an organisation's data engineering function. This is a 12-Month Fixed Term Contract , requiring 3 days … week on-site in Blackpool. Role Summary: Designing, building, and optimising scalable data pipelines that support analytics, reporting, and operational use cases. You will play a key role in shaping the organisations data architecture, ensuring data is reliable, accessible, and performant across multiple systems ...

ENGINEER LONDON/HYBRID UP TO £60,000 This is a rare opportunity to join an organisation at an early stage of its data journey, where you will have genuine influence over how data is designed, modelled, and used across the business. You will … working with modern data platforms and concepts such as lakehouse or medallion architecture. Exposure to Databricks for data transformation and pipeline development is highly desirable. Confident communicator who can work effectively with both technical and non-technical stakeholders. APPLY BELOW ...

Data Engineer (Security Cleared-Outside IR35) Hertfordshire | Hybrid (1 day on site per week) | Contract We're looking for an experienced Data Engineer to join a high-profile digital transformation programme delivering modern cloud-based data solutions for the UK public sector. Working within … talented technical team, you'll design and build scalable data pipelines, support complex data migration activities and help deliver secure, high-quality data solutions using modern AWS technologies. You must have active SC clearance for this role. Key responsibilities Design, develop and maintain data ...

Data Engineer - Build Solutions That Shape Decisions - Up to £50,000 We're working with an expanding technology-led company who are looking for a talented Data Engineer to join their data function. This is a fantastic opportunity for someone who enjoys modelling modern … responsible for the data development that powers reporting, analytics and business intelligence capabilities. Key Experience Strong understanding of ETL/ELT pipeline development. Experience building and maintaining data pipelines in cloud environments. Data modelling experience - Dimensional and 3NF concepts. Data warehousing ...

will be joining a fast growing consultancy at the forefront of secure data and cloud infrastructure, building AI-ready platforms for high-impact projects. You'll help build and maintain a secure batch and real-time data platform for a government client. You'll work with … modern commercial and open-source tools to ingest, transform, and deliver data to support analytics and decision-making. Build, test, and maintain data pipelines Design logical and physical data models Support the growth of the data platform to meet new use cases ...

Title: Lead Data & AI Delivery Consultant (Workforce Intelligence) Location: Sheffield, UK (Hybrid - 2/3 days per week on-site) OR flexible frequent travel to Sheffield Employment Type: Contract/Full-Time About the Role We are seeking a highly experienced Lead Data & AI Consultant … role; it is a strategic technical leadership position that requires you to act as the critical bridge between client stakeholders (C-suite & SMEs), Data Scientists, AI Engineers, and multi-disciplinary delivery pods. You will be responsible for the end-to-end governance of AI outputs-from use case ...

Data EngineerBristol | Hybrid (3 Days Onsite) Salary + Benefits – £60,000 to £71,000 + 10% bonus, 33 days holiday, pension, healthCareer Progression + Modern Tech StackPyspark | ML | AI | Databricks | Kafka | AWSAre you a Data Engineer with strong Python, SQL and PySpark skills who is looking … opportunity to step up and accelerate your career We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking ...

days in 2 days WFH Competitive Salary + Bonus We're working with a leading London law firm to recruit a Senior Data Adviser for its Lawtech team. This is a newly created role and a rare opportunity to become the firm's first dedicated data specialist. You will help shape how the firm uses data, AI and knowledge assets to improve legal service delivery. You will work closely with lawyers, IT, Risk, Finance, Marketing and innovation colleagues to build data models, develop reporting, support AI-ready knowledge repositories ...

everyone deserves the best night’s sleep. As part of our Transport Standardisation & Compliance team, you’ll support the business by ensuring our data is accurate, accessible and increasingly automated, helping colleagues make better decisions and delivering exceptional experiences for our customers. Your Purpose You will support … tools and techniques. Desirable: Experience with reporting or dashboard tools (e.g. Power BI, Tableau, Power Automate) or exposure to ETL/data pipeline concepts. Previous experience in warehousing or logistics is beneficial. Familiarity with PIM/ERP systems or an interest in logistics data management. ...

Data Engineer Pay Rate: £490/day (Inside IR35) Clearance Required: SC required. Candidates holding SC with another governing body. Current timescales for SC transfer are approx. 8 weeks+ from submission of application. Duration: 6 months Location: Mostly Remote (Telford - 2x/month onsite) Industry: Public Sector … Description: We're seeking a Data Engineer to join a Data Acquisition team supporting one of the Public Sector's strategic SAS-based data platforms, designed to industrialise the identification and risking of tax-related activity. The platform is currently deployed for Self Assessment ...

join a growing Data & Analytics team with a leading insurerPermanent, hybrid working and office attendance when required - Surrey – up to £60,000, plus bonus and benefits – up to £80,000, plus bonus and benefitsIf you enjoy building clean, reliable data products, improving data pipelines … helping businesses get more value from modern data platforms then this is a great next step for you.You’ll be working closely with data engineers, data scientists, analysts, developers, architects and product teams to support analytics, machine learning and wider data-driven ...

recruiting for a Data Engineer on behalf of one of the UK's most recognised and celebrated personal lines insurers. The successful candidate will join a collaborative team of data and AI engineers, scientists, developers, analysts, and architects. Together, they will design and build modern machine … chance to work on a very modern tech stack and learn from an incredible team. Key Responsibilities Building and supporting data products within modern data platform. Designing and delivering solutions with engineers, scientists and product teams. Developing and optimising data pipelines across the analytics ...