1 to 25 of 34 Permanent Data Ingestion Jobs in Manchester

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data & analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll … are eager to learn and grow, so if you want to supercharge your career, join Qodea! What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain … automated data pipelines to monitor data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends and technologies in big data and data engineering Ensure data quality, accuracy, and completeness Implement and enforce data More ❯

Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving … won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the … and outside our business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks More ❯

partnership and our shared values. Your Opportunity We are seeking an experienced Principal Consultant who will be responsible for managing a team involved in data architecture and design. You will be at the forefront of Microsoft technology and will contribute to direction of the development team by staying up … to date with the latest developments in the Data, Azure, Power Platform and related technologies. Ideally, we are look for applicants who have experience of the following: Defining best practice and advising clients Data architecture Mapping Data Flows Stored Procedures Loading restructured/transformed data into … Synapse or Azure SQL Implementing CI/CD for pipelines (using Azure DevOps) Automating data refreshes and error handling Configuring Azure Data Factory pipelines for ingestion The role will assume Tech Lead responsibility in transformational projects with a focus on ensuring best practice data architecture as More ❯

partnership and our shared values. Your Opportunity We are seeking an experienced Principal Consultant who will be responsible for managing a team involved in data architecture and design. You will be at the forefront of Microsoft technology and will contribute to direction of the development team by staying up … to date with the latest developments in the Data, Azure, Power Platform and related technologies. Ideally, we are look for applicants who have experience of the following: Defining best practice and advising clients Data architecture Mapping Data Flows Stored Procedures Loading restructured/transformed data into … Synapse or Azure SQL Implementing CI/CD for pipelines (using Azure DevOps) Automating data refreshes and error handling Configuring Azure Data Factory pipelines for ingestion The role will assume Tech Lead responsibility in transformational projects with a focus on ensuring best practice data architecture as More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

ECOM are pleased to be exclusively recruiting for a Senior Data Engineer here in Manchester. You'll join a team where your work reaches millions. This role is within a forward-thinking company leading, offering a dynamic environment where you can grow, make an impact, and shape the future … of technology. The Role: As a Data Engineer, you'll design, develop, and optimise data pipelines on a Databricks-based platform, Symphony. You'll collaborate with teams to create scalable data solutions, ensuring efficient data ingestion, transformation, and analysis. Responsibilities: Design and maintain scalable data pipelines and infrastructure using Databricks. Collaborate with commercial teams to define data product requirements and visualisations. Develop and optimise ETL/ELT processes for smooth data flow and accurate analysis. Ensure adherence to data architecture principles and support the development of data dashboards. Monitor and More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Generative AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure seamless … effectively. 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration & Roadmap More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Generative AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure seamless … effectively. 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration & Roadmap More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Generative AI for automated ad creation, content personalization, and A/B testing. Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. 3. Data & Integration Framework Define data ingestion, processing, and activation strategies across first-party, second- party, and third-party data sources. Ensure seamless … effectively. 4. Ad-Tech Stack & Cloud Architecture Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. Optimize data pipelines, real-time analytics, and identity resolution mechanisms. Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. 5. Stakeholder Collaboration & Roadmap More ❯