26 to 50 of 63 Data Pipeline Jobs in Manchester

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

Junior Data Scientist - Fully remote (UK based only) – TimeSeries, NLP, Computer Vision We’re partnering with a fast-growing analytics and technology business operating in the media streaming sector to recruit a Full Stack Data Scientist. They provide data analytics tools for major entertainment brands that are household names around the globe. This role … offers a chance to build models, generate insights, and work directly with real-world product and customer data across multiple data types - text, images, and time-series (tabular) data. The Role You’ll join a small, collaborative data team in a Full stack Data Science role (ETL process through to building predictive … evaluating time-series forecasts Prototyping AI/ML models (NLP and computer vision exposure) Translating findings into clear visual reports and concise business narratives Contributing to simple, reliable data pipelines and automated quality checks About You Minimum 1 year of commercial Data Science experience Strong hands-on Python (pandas, NumPy, scikit-learn) and SQL Sound understanding More ❯

+ Benefits Robert Walters are delighted to be supporting a well-known business in Manchester on an exclusive basis. We're searching for a Solutions Architect with a Data background, that wants to be part of an exciting transformation journey. Responsibilities: Gaining in-depth knowledge of existing business legacy systems and mapping migration strategies to Azure cloud-native … solutions. Designing future systems with built-in security to comply with regulatory requirements and company standards. Assessing and prioritising business needs and new requirements within the data architecture strategy to support evolving reporting and analytics. Driving innovation by leading solution development and facilitating technical workshops to align on architecture and design. Defining and managing relationships between data sources while overseeing the impact of future or proposed changes. As a Solutions Architect you will have: 7+ years of experience migrating systems and data platforms from on-premises data centres to public cloud environments (Azure preferred but not required). Deep knowledge of cloud services for data storage, data More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Senior Analytics Engineer Whitefield, Manchester- Hybrid Up to £60,000 (DOE) + benefits As the Senior Analytics Engineer, you'll work closely with the Head of Data and business stakeholders to design, build, and optimise data pipelines and analytics solutions that power strategic decision-making. You'll be hands-on with SQL Server, Alteryx, Power BI … ensuring the platform is robust, scalable, and future-ready. Senior Analytics Engineer responsibilities: Partner with business teams to understand requirements and deliver meaningful, actionable insights. Design and implement data pipelines from APIs and relational sources. Model data effectively using Kimball/Star Schema methodologies. Develop dashboards, reports, and automated integrations in Power BI. Support the onboarding … of data from newly acquired businesses. Contribute to data strategy, process improvement, and best practice development. Stay ahead of emerging tools, technologies, and AI trends to continually enhance the analytics function. Essential skills and experience: Advanced SQL proficiency (joins, CTEs, window functions). Strong Power BI skills, including semantic modelling, DAX, and report design. Experience building More ❯

to inform and influence the Group’s future technology direction. Key Responsibilities: Explore and evaluate emerging technologies to identify opportunities for innovation and business impact. Design and deliver a pipeline of proofs of concept (PoCs) and early-stage projects aligned with the Innovation strategy. Act as a technical SME for our Reference Architecture, defining the evolution and optimisation of … this platform Collaborate with business stakeholders, architects, data SMEs, and delivery teams to shape priorities and approaches. Build and test prototypes, ensuring they are scalable and production-ready where appropriate. Lead infrastructure and environment setup for innovation projects, including CI/CD pipelines and cloud environments. Support the development of data pipelines, processing, and storage for … programming skills in Python, C#, or similar languages. Experience with CI/CD pipelines, containerisation (Docker/Kubernetes) Familiarity with cloud platforms (Azure, AWS, or GCP) Understanding of data engineering principles, including ETL, data pipelines, and database management. Working knowledge of ML/AI concepts and technologies, including model deployment and monitoring. Strong problem-solving skills More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You'll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You'll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

the DNA of the platform What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical leadership with high-level solution More ❯

the DNA of the platform What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical leadership with high-level solution More ❯

the DNA of the platform What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical leadership with high-level solution More ❯

Role: Azure Senior Data Engineer Location: Manchester, Lancashire Hybrid working: go into office 1x day a week Salary: £60,000 - £70,000 (dependent on experience) Insight into the Company: A large retail organisation - market leaders in their industry – are looking for a Senior Data Engineer to enter their team. You will be working in a small … team of 3 (including you!) and they are looking to build up the team over the next year. The ideal candidate will have experience with managing data warehouses from start to finish and liaise with IT teams regularly. The role will involve stakeholder management, working with diverse roles, such as software engineers, sales and marketing professionals and more. … Therefore, communicating your projects needs and understanding others is an essential part of this role. Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure – from collecting, to transforming to loading! Skills and Experience: Essential More ❯

Role: Azure Senior Data Engineer Location: Manchester, Lancashire Hybrid working: go into office 1x day a week Salary: £60,000 - £70,000 (dependent on experience) Insight into the Company: A large retail organisation - market leaders in their industry – are looking for a Senior Data Engineer to enter their team. You will be working in a small … team of 3 (including you!) and they are looking to build up the team over the next year. The ideal candidate will have experience with managing data warehouses from start to finish and liaise with IT teams regularly. The role will involve stakeholder management, working with diverse roles, such as software engineers, sales and marketing professionals and more. … Therefore, communicating your projects needs and understanding others is an essential part of this role. Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure – from collecting, to transforming to loading! Skills and Experience: Essential More ❯

Senior Software Engineer (Data-Centric) Manchester (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter decision-making. We … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

Senior Software Engineer (Data-Centric) Manchester (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter decision-making. We … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯