17 of 17 Permanent Data Ingestion Jobs in Leeds

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Data Engineer - SC Clearance Leeds (Hybrid and Flexible Working Available) 65K + Bonus **🔐 MUST HAVE ACTIVE SC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. 🔍 What You’ll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll More ❯

Machine Learning Engineer Salary: £70,000 Location: Leeds or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment … framework for all data science services. You will have oversight of how data will flow into the data science life cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we More ❯

Machine Learning Engineer Salary: £70,000 Location: Leeds or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment … framework for all data science services. You will have oversight of how data will flow into the data science life cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Principal Test Specialist (DATA) £75,000 + Profit Share | Hybrid with flexible monthly office visits | Permanent Are you a hands-on, technically advanced Test Specialist looking to take the lead on testing strategy across a cutting-edge data environment? We're working exclusively with a high-performing organisation … who are making a rare and strategic external hire into their specialist team - and they're looking for a Principal Test Specialist (DATA) to elevate testing across their data engineering and analytics function. This is a business-critical role, working at the intersection of technical strategy and hands … on delivery. You'll help define and implement scalable test automation across complex data pipelines and analytical models, directly impacting the quality and reliability of data products used business-wide. What You'll Be Doing Partner with the Test Manager to modernise and optimise test processes across the More ❯

I'm looking for an Analytics Engineer to join a global business who are building modern, AI-ready data platform, allowing for better decision-making for both themselves and their customers. Their modern tech stack includes Snowflake, dbt, Azure, Power BI and other next-gen BI platforms, offering the … chance to work on cutting-edge technologies. You'll join their newly established Data Team, based in their modern office space in Leeds - you'll spend at least 3 days per week in the office to collaborate with your team, in what's a very fast-paced, forward-thinking … and entrepreneurial environment. The purpose of this role is to design and deliver scalable data models in Snowflake, applying analytics best-practices using dbt. You'll collaborate closely with Power BI developers to deliver insightful Power BI reports, build curated data layers that enable consistent KPI definitions, and More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

Principal Test Specialist (DATA) £75,000 + Profit Share | Hybrid with flexible monthly office visits | Permanent Are you a hands-on, technically advanced Test Specialist looking to take the lead on testing strategy across a cutting-edge data environment? We’re working exclusively with a high-performing organisation … who are making a rare and strategic external hire into their specialist team – and they’re looking for a Principal Test Specialist (DATA) to elevate testing across their data engineering and analytics function. This is a business-critical role, working at the intersection of technical strategy and hands … on delivery. You’ll help define and implement scalable test automation across complex data pipelines and analytical models, directly impacting the quality and reliability of data products used business-wide. What You’ll Be Doing Partner with the Test Manager to modernise and optimise test processes across the More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

We are seeking an experienced Kafka Real-Time Architect to design and implement scalable, high-performance real-time data processing systems leveraging Apache Kafka. In this role, you will be responsible for architecting and managing Kafka clusters, ensuring system scalability and availability, and integrating Kafka with various data processing platforms. This position requires a deep understanding of Kafka and related technologies, along with a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are robust, highly … available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster Management: Configure, deploy, and maintain highly available Kafka clusters, ensuring scalability and fault tolerance across distributed environments. Manage configurations, optimize cluster performance, and troubleshoot issues to maintain smooth operations. Integration & Data Processing More ❯

Role : Kafka Architect Location : Leeds.UK Job Type: Contract Job Description: A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms. Designing … and architecting scalable, real-time systems in Kafka. Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams to understand … data requirements and design solutions that meet business needs. Implementing security measures to protect Kafka clusters and data streams. Monitoring Kafka performance and troubleshooting issues to ensure optimal performance. Providing technical guidance and support to development operations teams. Staying updated with the latest Kafka features, updates and industry More ❯

role will report into Operations Lead UK and Europe. You will work alongside the Sales & Distribution, Technology, Finance and Outsourced Operations teams to manage data onboarding, premium and cash management of speciality underwriters within Europe and UK, at Accelerant we call them members. In this role you will build … relationships and intimate knowledge of our Members data, technology and processes and will be the point contact on all data queries, problems and solutions. You will work alongside our members to assist them in the analysis and resolution of data quality issues that impact data ingestion, regulatory compliance, and reporting, utilising your knowledge and experience of the applicable data standards. Your role will contribute to the overall success of the Operations function who are charged with transforming our data processes to deliver governed, timely and high-fidelity data sources. Key Responsibilities Member More ❯

TalentCo are thrilled to be working with a VC-backed AI infrastructure startup building the future of multimodal data systems. Having recently raised a substantial Seed round, they are now looking to hire an exceptional backend focused Senior Rust Engineer to join their high-calibre, distributed team in Europe. … analytical databases purpose-built for high-throughput, multimodal time-series data. Working in Rust, you’ll architect performant, scalable systems that handle everything from ingestion and indexing to complex query execution. If you're keen to be at the sharp-end of the AI boom, love building technical infrastructure … logs. Work with technologies like Rust, Apache Arrow, and Datafusion to build scalable, low-latency systems. Collaborate on every part of the stack—from data ingestion and indexing to query planning and optimisation. Build observability, reliability, and scalability into a product being designed for some of the most More ❯

is a high-impact role supporting a flagship payroll platform used by thousands of businesses. 🎯 Key Objectives Platform Uplift – Enhance the Payroll Reporting API, data ingestion layer, and ETL pipeline to meet top-tier engineering and reliability standards. UK Delivery – Launch features specifically tailored for UK payroll compliance … and user experience. Strategic Vision – Help define the long-term architecture of payroll reporting, aligning with broader global data and AI goals. 🛠️ Tech Stack : React, .NET 🧠 You’ll bring : Proven expertise in React and .NET in production environments Strong experience with system design, observability, and performance optimisation Great communication More ❯

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/… and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning More ❯

processes. Configure correlation searches and alerting mechanisms, optimising rules to minimise false positives. Serve as the Subject Matter Expert (SME) for SIEM deployment, supporting data ingestion from sources such as AWS and Qualys. Assist in the integration of SIEM alerts with Jira, enabling streamlined alert tracking and incident More ❯