1 to 25 of 30 Data Pipeline Jobs in Manchester

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

driving the evolution of our enterprise data engineering capabilities across our cloud and legacy environments. Your remit spans cloud platform engineering, pipeline automation, real‐time data processing, curation, and the enablement of business intelligence, data science and AI teams. You will … concepts clearly and frame engineering decisions in terms of business impact. Ensure data platforms meet regulatory, security, and compliance requirements, including secure pipeline design, access control, and lineage. Embed good governance practices across metadata, cataloguing, quality, and monitoring. Define and maintain data engineering standards, documentation ...

Title: Data Engineer Location: Greater Manchester (Hybrid - 3 days per week onsite) Salary: £60,000 - £70,000 + Bonus + Excellent Benefits We're working with a well-established, market-leading organisation that is investing heavily in its data and technology capabilities. They are looking … appoint an experienced Data Engineer to lead the development of a modern cloud-based data platform that will support reporting, analytics and business decision-making across the organisation. This is an exciting opportunity to join a growing business undergoing digital transformation, where you'll have ...

Data Platform & Analytics Lead (Microsoft Fabric/AI Enablement) Manchester or Leeds (hybrid working available) The role: The Data & Analytics Lead owns my clients' enterprise data platform and is responsible for ensuring it supports analytics, AI, and machine learning use cases in a structured … governed, and scalable way. This includes end-to-end accountability for data ingestion, transformation, lakehouse design, semantic modelling, and the development of reliable data products. The role ensures business data is accessible, consistent, and trusted, with clearly defined metrics that enable high-quality analysis ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Apprentice Data Engineer Location: Bristol, Nottingham, Birmingham, Leeds, Oldham, Newcastle, Uxbridge Salary: £30,485 per annum Vacancy Type: Fixed term apprenticeship, 2 years Closing Date: 12th of July 2026 This Apprenticeship combines working and learning, in a great opportunity where you’ll earn a salary, get workexperience … finish the apprenticeship with a Level 5 Qualification in Data Engineering – which you won’t have to pay a penny for! We will provide a fully paid 24 month Apprenticeship to help you gain a Level 5 qualification specialising in Data Engineering and provide hands ...

Data Engineer Manchester £45,000 About the Company A fast-growing, family-oriented organisation operating across multiple locations in the UK with a strong focus on people, development and long-term career growth are looking for a Data Engineer to join their growing team. As their … business continues to expand, they are investing heavily in data and technology to support smarter decision-making and innovation across the organisation. This is an excellent opportunity for someone with some hands-on experience who is eager to further develop their career in data engineering, with ...

Data Warehouse Architect £75,000+ benefits Bury (Hybrid) We are seeking a Data Warehouse Architect to design, establish, and govern a modern enterprise data platform. This role will bridge complex raw data and business insights by creating scalable, high-performance lakehouse … data warehouse architectures. You will play a key role in consolidating data assets, eliminating silos, and ensuring a single, source of truth to support advanced analytics and AI. Data Warehouse Architect Responsibilities: Design and implement enterprise-wide data architecture across Microsoft Fabric ...

Were looking for a Head of Integration, Data & GenAI Engineering to lead a critical engineering capability within Technology Services at AJ Bell. This role brings together leadership across three important parts of our technology landscape: integration engineering, data engineering and Generative AI engineering. Reporting … Director of IT Strategy & Architecture, you will lead through three senior technical leaders: Senior Engineering Manager (EA), Senior Data Engineering Manager, and Software Engineering Team Lead (GenAI). You will help shape the platforms, capabilities and engineering practices that support AJ Bells long-term strategy. This ...

Description Role SummaryWe are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation .Key ResponsibilitiesAct as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams.Design and deliver Voice AI/Agentic ...

Role Summary We are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation . Key Responsibilities Act as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams. Design and deliver Voice ...

Senior Data Engineer Location: Manchester (Hybrid 1 day per month on-site) My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment … passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python it s for someone who understands how to model, optimise, and apply data to support better business decisions. ...

Data Engineer Location: Mainly remote working - Adhoc visit maybe required to Manchester office Type: Temporary contract estimated to run 6 months with potential to be extended Salary: £30.77 - £34.62ph About the Role We're supporting a well-established organisation in the fintech sector who are in search … skilled Data Engineer . This is a fantastic opportunity to join a forward-thinking business that places data at the centre of its operations and is investing heavily in its analytics capabilities. Role Overview As a Data Engineer, you'll be responsible for developing ...

Title: Senior Data Scientist Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions … enable customers to derive insights quickly. Atreides transforms the chaos of petabyte-scale, all-domain data land, air, sea, space, and cyber into real-time operational clarity. We are a fast-moving, high-performance international scale company. We trust our team with autonomy, believing it leads to better ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that … support analytics and operational decision-making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable ...

Support & Customer Value Quantification Provide the technical evidence base and build business cases for renewals and expansions, translating platform telemetry and incident response data into clear customer outcomes. Proactively health-check environments, close technical gaps, and resolve visibility issues ahead of renewal conversations. Collaborate with Sales Engineering … optimise security operations workflows. Work confidently across backend languages (Python preferred; Go, JavaScript, and Bash valued) utilising RESTful APIs, webhooks, and data pipeline patterns. Detection Engineering & SIEM Development Write, tune, and maintain high-fidelity, low-noise SIEM detection rules by translating threat intelligence and attacker behaviour. ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … mission-critical programmes within the National Security sector, delivering innovative solutions across AI, machine learning, cyber security and geospatial intelligence. As a Senior Data Engineer, you will join a collaborative Agile environment, playing a key role in designing, building and maintaining scalable data platforms and processing ...

Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope. Our new Central Data Engineering team will inform data quality standards, access standards, create templatised … solutions, assist in managing mission-level datasets/dashboards, and prepare our mission s data for the AI Future that expected to impact every squad and product area. As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between ...

Senior Data Engineer (Knowledge Systems) This organisation is building a modern, cloud-native platform and evolving towards an AI-first engineering model , where intelligent systems rely on high-quality, well-structured knowledge to power automation, decision-making and software delivery. They are looking for a Senior Data … multiple sources. Choose the most appropriate storage and retrieval approach for different use cases, including document stores, graph databases, vector databases and traditional data platforms. Model complex business domains to improve retrieval quality and contextual understanding. Design and optimise hybrid retrieval strategies using semantic search, keyword search, embeddings ...

lead the design and implementation of our clients Adobe Martech ecosystem, with a focus on Adobe Experience Platform (AEP), Real-Time Customer Data Platform (RTCDP), and Adobe Journey Optimizer (AJO). The role will be responsible for defining scalable architecture, enabling real-time customer data capabilities … ensuring alignment with enterprise standards. Lead end-to-end solution architecture for Adobe Martech platforms (AEP, RTCDP, AJO). Define data architecture, ingestion patterns, and activation frameworks across channels. Translate business requirements into scalable architecture, data models, and integration designs. Design and govern identity management, segmentation ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

fully configured, technically sound, and accelerating toward platform outcomes. Where CSMs own the relationship and business outcomes, you own the technical depth integrations, data flows, product configuration, API health, and escalation triage. In this role, you ll do: Serve as the dedicated technical point of contact … company Experience owning technical relationships with enterprise-tier accounts not transactional; strategic, named accounts Demonstrated ability to work across APIs, integrations, data pipeline concepts, and SaaS platform configuration without needing Engineering to hand-hold every step Familiarity with influencer marketing, creator economy, or social media data ...