1 to 25 of 55 Data Pipeline Jobs in Manchester

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Summary The Data Engineering Consultant, working independently under limited oversight, empowers the organization through architecting, designing, and executing advanced analytics capabilities. In an agile team setting, they collaborate with data scientists, data analysts, and product teams to translate business needs into technical specifications … develop complex data pipelines. This role sets the strategic and technical direction for data capabilities, designing pipelines for data extraction, transformation, and loading from diverse sources. They handle large, complex data sets, solve business challenges using unstructured data ...

looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms ...

description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team … mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value ...

description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team … mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value ...

flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written ...

flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Contract Data Engineer 3 month initial contract (with good chance of extension) Manchester, 2 days per week on-site Outside IR35 Start before Christmas Overview My client are a well knwon organsation just outside Manchester looking for a contract Data Engineer. You will review and improve … Skills Strong hands-on Data Engineering experience Advanced Python for data transformation Google Cloud Platform production experience Data pipeline design and optimisation Data quality automation and monitoring Customer data and identity matching GDPR and data governance delivery ...

About the role The Analytics Capabilities team is responsible for developing and managing data products that drive intelligent experiences, decisions and actions across the Tesco ecosystem. We work in close partnership with business and technology teams across Stores, Finance, People, Customer, Commercial to enable the seamless build, consumption … integration and expansion of Data & AI capabilities. This is a fantastic opportunity to join our team and play a leading role in defining, building and launching new type of data products that have a real impact on Tesco business & colleagues. This is a hybrid role with ...

About the role The Analytics Capabilities team is responsible for developing and managing data products that drive intelligent experiences, decisions and actions across the Tesco ecosystem. We work in close partnership with business and technology teams across Stores, Finance, People, Customer, Commercial to enable the seamless build, consumption … integration and expansion of Data & AI capabilities. This is a fantastic opportunity to join our team and play a leading role in defining, building and launching new type of data products that have a real impact on Tesco business & colleagues. This is a hybrid role with ...

Databricks Data Engineer - Manchester £100,000 | 2 days in office My client, a leading technology consultancy, is seeking an experienced Databricks Data Engineer to join their team on a high-profile engagement with a major insurance client. This is a hands-on technical role focused … designing, building, and optimising cloud-based data integration and analytics solutions in the insurance domain. This is an opportunity to work on complex, enterprise-scale data transformation programmes using cutting-edge Azure and Databricks technologies. Salary and Benefits Highly competitive salary ...

Head of Data Engineering Hybrid Permanent About CAVU For airports, for partners, for people. We are CAVU. At CAVU, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody—from the smallest ideas to the biggest transformations. Every … term data ambitions. Data Architecture: Design, oversee, and continually improve CAVU’s data storage, processing, and integration architecture. Pipeline Excellence: Ensure the delivery of scalable, high-quality data pipelines for ingestion, transformation and storage. Cross-Functional Collaboration: Partner closely with data ...

Data and Insights Manager Full-Time, Permanent Salary: £50,000 per annum + company bonus scheme Working: 35 hours, Monday to Friday Location : Hybrid with frequent travel to Leeds office We're looking for an experienced Data & Insight Manager to join our growing team … part of our team, responsible for extracting actionable insights from field data to inform business decisions and shape strategies to maximise return on investment and drive success for our customers. Key Responsibilities: Contribute to data strategy development and utilise data to solve business challenges ...

fast-growing UK-based company helping customers navigate complex financial and insurance claims. Our success is built on trust, innovation, and data-driven decision-making - and now we're looking to expand our analytics team to support smarter, faster business outcomes. We are seeking a Senior Data Engineer to join their high-performing data team and help shape the future of our data ecosystem. You will play a key role in designing, building, and scaling robust data platforms that support analytics, reporting, and advanced insight across the organisation. ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Master Data Management (MDM) Analyst - Manchester - Hybrid (3 days on-site) - Up to £50k Client Details: A data-driven recruitment organisation based in Manchester is looking for an MDM Analyst to support and improve its master data capability, with Tamr at the core … platform. The Role: Support day-to-day operation of the Tamr platform Ensure data quality, integrity and accurate mastering across key data domains Work closely with Finance, Operations and Analytics teams Contribute to data governance and stewardship initiatives Key Responsibilities: Monitor data ...

seeking a highly experienced DevOps Engineer with a strong background in Google Cloud Platform (GCP) and a proven track record in delivering complex data analytics projects for clients. In this full-time, permanent role, you will be responsible for designing, implementing, and managing the infrastructure and deployment processes … infrastructures tailored to each client's unique project requirements, ensuring high performance, availability, and security. Work closely with client stakeholders, full-stack developers, data engineers, and data scientists to define and execute efficient data ingestion, processing, and storage solutions that meet project deliverables. Implement ...

have an exciting opportunity for a Senior DataOps Engineer to join the Group and take responsibility for inspiring and coaching our Data Engineering teams. The person in post will be working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality … data solutions that serve as the backbone of our decision-making and digital services. Driving automation and CI/CD practices across data pipelines and infrastructure, the Senior DataOps Engineer will build robust, scalable, and secure infrastructure that supports our data platform strategy. ...

DETAILS JOB BAND: D CONTRACT TYPE: 10 Month Attachment/Fixed-term, Full-time DEPARTMENT: Product Group - Data Platform LOCATION: London, hybrid PROPOSED SALARY RANGE: Up to £75,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external … like more information on BBC Extend, please visit the BBC Extend webpage. (EXTEND code: EX2324). PURPOSE OF THE ROLE The BBC Data Platform underpins how data flows across the organisation. It powers our analytics, personalisation, and insights for products such as iPlayer, Sounds, and News. ...

Bolton As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa … including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed ...

/ELT pipelines, transformations, and data quality Strong SQL and performance optimisation - Experience with data integration patterns (batch/real-time, CDC, APIs) A major client of ours is looking to build a team of strong Talend ETL Data Engineers for a long-term … project migrating legacy systems and Data into a Talend ecosystem, and is looking for experienced Talend Data Engineers.This is an approved Outside IR35 contract role with the potential to run long-term over 12 months.However, you will need to have been a UK resident ...

Data Engineer - Digital Bank | Outside IR35 - Tableau, Basel III, BigQuery Location: Remote-first (occasional travel to client site in Northern England) Duration: 6 months Engagement: Outside IR35 Day Rate: £400-450pd Start: ASAP Client: Leading Data Consultancy supporting a high-growth Digital Bank About … Role We Are Dcoded are partnered with a specialist consultancy delivering high-impact data, analytics, and cloud programmes across financial services. Their end-client, a leading digital bank, is scaling capability across its regulatory data environment and requires an experienced GCP Data Engineer ...

Work Location: UK Salford Hybrid: Hybrid,State: Manchester; City: Salford Zip: M50 2UE Job description: Key Responsibilities Design, develop, and maintain metadata-driven data pipelines using ADF and Databricks. Build and implement end-to-end metadata frameworks, ensuring scalability and reusability. Optimize data workflows leveraging SparkSQL … Pandas for large-scale data processing. Collaborate with cross-functional teams to integrate data solutions into enterprise architecture. Implement CI/CD pipelines for automated deployment and testing of data solutions. Ensure data quality, governance, and compliance with organizational standards. Provide technical ...