Data Ingestion Jobs in Yorkshire

25 of 25 Data Ingestion Jobs in Yorkshire

Microsoft Fabric Consultant

Leeds, England, United Kingdom
Hybrid / WFH Options
JR United Kingdom
improvement and innovation. We support clients in becoming self-sufficient by providing incubation support with out-of-the-box capabilities supported by skilled practitioners. The Role Are you a data enthusiast passionate about transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're excited about helping organizations unlock their data's full potential, we’d love to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure … Data Factory, or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing More ❯
Posted:

Data Engineer

Wakefield, England, United Kingdom
Pinion
develop those core skills while delivering critical technology solutions for a variety of customers. About the Role Design and development with Informatica IICS or PowerCenter in either/both Data Warehousing and Enterprise Integration projects Development of ETL [Extract Transform & Load] by utilizing relevant technologies (e.g. Informatica, MS Azure Data Factory, Azure Data Lake, etc.). Develop … Data Ingestion and Integration from data sources to Azure Data Warehouse, based on Data Pipeline Framework(s) established by our Data Analytics and Information Technology teams as well as technical requirement specifications developed across all departments. Develop all necessary ad-hoc Data Ingestion/Integration processes into operational procedures for our Production … Environment by adhering to agile, reliable, secure, high-performing, efficient, and effective methodology. Build and deploy Data Gathering/Integration solutions for periodic ingestion of field-generated or subject expert-generated content into a centralized reporting environment. Work with various business teams and departments to increase efficiency and accuracy of business processes through business process automation. Performance Tuning More ❯
Posted:

Data Scientist

Sheffield, England, United Kingdom
HSBC
help design and build digital services that allow our millions of customers around the world, to bank quickly, simply and securely. They also run and manage our IT infrastructure, data centres and core banking systems that power the world's leading international bank. Our multi-disciplined teams include DevOps Engineers, IT Architects, Front and Back End Developers, Infrastructure specialists … Cyber experts, as well as Project and Programme managers. We are looking for a highly experienced and visionary Data Scientist to drive innovation through data and artificial intelligence. This role is the perfect fit for an individual who can identify, lead, and execute impactful data science and AI projects, transforming complex data into strategic insights within … advanced analytical techniques and cutting-edge AI technologies to address critical business challenges. This involves proactively identifying opportunities, leading initiatives from concept to deployment, and fostering a culture of data-driven decision-making. Responsibility • Strategic Data Insights: Proactively identify and lead key data-driven initiatives, with a focus on improving performance and efficiency, particularly in the DevSecOps More ❯
Posted:

Data Scientist

Sheffield, England, United Kingdom
HSBC Global Services Limited
help design and build digital services that allow our millions of customers around the world to bank quickly, simply, and securely. They also run and manage our IT infrastructure, data centres, and core banking systems that power the world’s leading international bank. Our multi-disciplined teams include DevOps Engineers, IT Architects, Front and Back End Developers, Infrastructure specialists … Cyber experts, as well as Project and Programme managers. We are looking for a highly experienced and visionary Data Scientist to drive innovation through data and artificial intelligence. This role is ideal for an individual who can identify, lead, and execute impactful data science and AI projects, transforming complex data into strategic insights within a dynamic … advanced analytical techniques and cutting-edge AI technologies to address critical business challenges. This involves proactively identifying opportunities, leading initiatives from concept to deployment, and fostering a culture of data-driven decision-making. Responsibilities: Strategic Data Insights: Proactively identify and lead key data-driven initiatives, focusing on improving performance and efficiency, particularly in the DevSecOps space (e.g. More ❯
Posted:

Data Engineering Manager

Doncaster, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of … all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Work … with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business alignment by engaging with leaders across domains and geographies. Ensure data engineering initiatives match evolving business priorities. Promote a product mindset, balancing technical efficiency with clear business value. Team Management Lead the Data Engineering team, providing supervision More ❯
Posted:

Analytics Engineer

Bradford, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Are you passionate about building scalable, analytics-ready data models that power business intelligence and AI? I’m looking for an Analytics Engineer to join a global organisation that’s investing heavily in a modern, AI-ready data platform - and this is your chance to help shape it from … the ground up. You’ll be part of a newly formed, high-impact Data Team working in a fast-paced, collaborative, and entrepreneurial environment. Based in their modern Leeds office, you’ll spend 4 days a week on-site, working closely with engineers, analysts, and business stakeholders. ? About the Platform: This greenfield initiative is focused on building a next … gen data ecosystem with a tech stack including: Snowflake for cloud data warehousing dbt for transformation and modelling Azure for cloud infrastructure and orchestration Fivetran for automated data ingestion Power BI and other modern BI tools for reporting and visualisation ? What You’ll Do: Design and implement scalable, well-documented data models in Snowflake using More ❯
Posted:

Analytics Engineer

Leeds, West Yorkshire, England, United Kingdom
Tenth Revolution Group
Are you passionate about building scalable, analytics-ready data models that power business intelligence and AI? I'm looking for an Analytics Engineer to join a global organisation that's investing heavily in a modern, AI-ready data platform - and this is your chance to help shape it from the ground up. You'll be part of a … newly formed, high-impact Data Team working in a fast-paced, collaborative, and entrepreneurial environment. Based in their modern Leeds office, you'll spend 4 days a week on-site, working closely with engineers, analysts, and business stakeholders. About the Platform: This greenfield initiative is focused on building a next-gen data ecosystem with a tech stack including … Snowflake for cloud data warehousing dbt for transformation and modelling Azure for cloud infrastructure and orchestration Fivetran for automated data ingestion Power BI and other modern BI tools for reporting and visualisation What You'll Do: Design and implement scalable, well-documented data models in Snowflake using dbt Build curated, reusable data layers that support More ❯
Employment Type: Full-Time
Salary: £65,000 per annum
Posted:

MLOps Engineer | Python | Machine Learning | GCP | Kubernetes | CI/CD | Remote, UK

Leeds, West Yorkshire, United Kingdom
Hybrid / WFH Options
Enigma
Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯
Posted:

Lead Data Engineer

Leeds, England, United Kingdom
Hybrid / WFH Options
Robert Walters UK
Lead Data Engineer Leeds - Hybrid working £85,000-£90,000 Robert Walters are delighted to be partnering with an 8-figure turnover business based in Leeds. They are currently undergoing a transformation and are looking to hire a Lead Data Engineer to spearhead a greenfield project. The ideal candidate will have experience with Microsoft Fabric, with additional experience … in Azure or AWS being highly advantageous. Responsibilities Lead the end-to-end design and development of a new, cloud-based data platform focusing on scalability, performance, and security to support enterprise data initiatives. Serve as the subject matter expert for Microsoft Fabric, guiding its implementation and integration within the company's cloud environment, which is currently AWS … with potential migration to Azure. Establish and enforce best practices for data ingestion, transformation, storage, and orchestration, laying a solid foundation for analytics, reporting, and AI/ML projects. Collaborate with data analysts, data scientists, and business leaders to gather requirements and develop scalable data solutions. Design and build scalable data pipelines and ETL More ❯
Posted:

Principal Quality Assurance Engineer

Leeds, England, United Kingdom
Hybrid / WFH Options
JR United Kingdom
Share | Hybrid with flexible monthly office visits | Permanent Are you a hands-on, technically advanced Test Specialist looking to take the lead on testing strategy across a cutting-edge data environment? We’re working exclusively with a high-performing organisation who are making a rare and strategic external hire into their specialist team – and they’re looking for a … Principal Test Specialist (DATA) to elevate testing across their data engineering and analytics function. This is a business-critical role, working at the intersection of technical strategy and hands-on delivery. You’ll help define and implement scalable test automation across complex data pipelines and analytical models, directly impacting the quality and reliability of data products … used business-wide. What You’ll Be Doing Partner with the Test Manager to modernise and optimise test processes across the data and analytics function. Lead the development of test automation frameworks that support data ingestion, transformation (ETL/ELT), and analytical models. Work hands-on with tools like Snowflake, dbt, Fivetran , and Tableau , alongside SQL and More ❯
Posted:

Senior Rust Engineer

York, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading … AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process … data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin More ❯
Posted:

Senior Rust Engineer

Wakefield, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading … AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process … data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin More ❯
Posted:

Senior Rust Engineer

Bradford, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading … AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process … data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin More ❯
Posted:

Senior Rust Engineer

Doncaster, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading … AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process … data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin More ❯
Posted:

Senior Rust Engineer

Sheffield, England, United Kingdom
JR United Kingdom
right Job Views: 12 Posted: 28.06.2025 Expiry Date: 12.08.2025 col-wide Job Description: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity … join a leading AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While … most companies process data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform More ❯
Posted:

Senior Rust Engineer

Leeds, England, United Kingdom
JR United Kingdom
right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity … join a leading AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While … most companies process data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform More ❯
Posted:

Senior Rust Engineer

Hull, England, United Kingdom
JR United Kingdom
right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity … join a leading AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While … most companies process data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform More ❯
Posted:

Data Engineer

Leeds, England, United Kingdom
KDR Talent Solutions
Data Engineer | Location: Leeds (4 days per week in office with some flexibility) | Salary: £60,000-£80,000 The Opportunity Our client is seeking a skilled and motivated Data Engineer to play a key role in the creation of a brand-new data platform within the Azure ecosystem including Azure Data Factory (ADF), Synapse and PySpark …/Databricks and Snowflake. You will be a data ingestion and ETL Pipeline guru, tackling complex problems at source in order to retrieve the data and ensure to can flow upstream to the Snowflake DWH. You will not be an analytics engineer or someone who operates at the latter stages of the development lifecycle unless you have … skills and desire to work on data ingestion, ETL/ELT. Key Responsibilities Build & Develop robust ETL/Data Ingestion pipelines leveraging Azure Data Factory, Synapse, PySpark and Python. Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes. Data Integrity – Embed quality measures, monitoring, and alerting mechanisms. CI More ❯
Posted:

Machine Learning Engineer

Leeds, England, United Kingdom
SPG Resourcing
Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from SPG Resourcing Data Recruitment Consultant | Connecting Top Talent with Data-Driven Companies | North of the UK Machine Learning Engineer Location: Leeds or Manchester This position is for an experienced Machine Learning … Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping … transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life cycle from the wider business data warehouse. Oversight of the automation of the data More ❯
Posted:

Machine Learning Engineer

Leeds, England, United Kingdom
SPG Resourcing
Machine Learning Engineer Location: York or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The … engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life … cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we move to production. Automate the data science pipeline (data prep to deployment). Collaborate with cross-functional teams to ensure smooth productionisation of models. Write clean, production-ready Python code. Apply More ❯
Posted:

Solution Architect

Leeds, England, United Kingdom
Hybrid / WFH Options
Axiom Software Solutions Limited
Job title: Solution Architect Location: Leeds, UK (Hybrid- 3 days/week) Type: Contract Client: Wipro Job description As part of the CTO Data Ingestion Service, the incumbent will be required to: Designing and architecting scalable, real-time systems in Kafka, with a focus on on-premise Cloudera open source Kafka and disaster recovery aspects. Configuring, deploying, and … maintaining Kafka clusters to ensure high availability, resiliency, and scalability, including understanding and explaining features like KRAFT. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. Implementing security measures … to protect Kafka clusters and data streams. Monitoring Kafka performance, troubleshooting issues, and enhancing disaster recovery strategies. Providing technical guidance and support to development operations teams. Staying updated with the latest Kafka features, industry practices, and real-time technologies like Spark. Mandatory keywords: Experience with on-premise/cloudera open source Kafka Focus on disaster recovery aspects Knowledge of More ❯
Posted:

Chief Technology Officer

Bradford, England, United Kingdom
Pipped
build a top-tier engineering organisation from the ground up. What you’ll own Tech vision & roadmap – Translate product goals into a clear architecture from MVP to full platform. Data collection at scale – Design compliant pipelines that pull from X/Twitter, Meta, Reddit, YouTube and third-party sources. Infrastructure & ML – Deliver real-time + batch processing, embedding AI … models directly into production. Social-media intelligence – Craft novel metrics for hidden-influencer detection, bridge mapping and predictive analytics. Team leadership – Hire, mentor and inspire a lean group of data scientists & engineers. What you’ll bring 5+ years’ senior engineering leadership in SaaS, data or analytics scale-ups. Deep experience with API data ingestion, distributed systems More ❯
Posted:

Marketing Business Development Manager

Leeds, England, United Kingdom
Hybrid / WFH Options
Marmion
product training and develop an excellent understanding of the platform’s functionalities and outputs. Develop a solid understanding of the technical capabilities and limitations of the platform, including integrations, data ingestion, and reporting. Work closely with the marketing and internal sales team on qualifying inbound leads. Efficiently and effectively follow-up and convert qualified inbound leads. When required … teams. SKILLS & EXPERIENCE: 5-10 years’ experience in a proactive, consultative, solution Sales Consultant/Specialist role or similar is essential. Previous experience selling CRM systems, Marketing Automation platforms, Data Management/Analytics software or similar is highly desirable. Excellent understanding of sales methodologies and experience in applying them to complex solution sales cycles, resulting in successful outcomes. Self More ❯
Posted:

Marketing Business Development Manager

Leeds, England, United Kingdom
Hybrid / WFH Options
Marmion
product training and develop an excellent understanding of the platform’s functionalities and outputs. Develop a solid understanding of the technical capabilities and limitations of the platform, including integrations, data ingestion, and reporting. Work closely with the marketing and internal sales team on qualifying inbound leads. Efficiently and effectively follow-up and convert qualified inbound leads. When required … teams. SKILLS & EXPERIENCE: 5-10 years’ experience in a proactive, consultative, solution Sales Consultant/Specialist role or similar is essential. Previous experience selling CRM systems, Marketing Automation platforms, Data Management/Analytics software or similar is highly desirable. Excellent understanding of sales methodologies and experience in applying them to complex solution sales cycles, resulting in successful outcomes. Self More ❯
Posted:

Staff AI Engineer

Leeds, England, United Kingdom
JR United Kingdom
right Job Views: 6 Posted: 09.06.2025 col-wide Job Description: About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member … inference of generative AI models. Design and implement advanced methodologies like LoRA, prefix-tuning, and adapter-based approaches for fine-tuning AI models. Develop robust, fault-tolerant systems for data ingestion, processing, and model customisation. Optimise GPU utilisation and system performance using frameworks like DeepSpeed, Triton Inference Server, TensorRT, and custom CUDA/Rocm kernels. Conduct performance testing … production environments. Proficiency in Python and PyTorch, with a strong understanding of transformer architectures, LLMs, and multimodal generative models. Expertise in distributed training frameworks like DeepSpeed or Fully Sharded Data Parallel (FSDP). Experience with GPU programming and optimisation e.g CUDA, TensorRT, or ROCm. Knowledge of fine-tuning methods, such as LoRA, prefix-tuning, and adapter-based techniques, and More ❯
Posted:
Data Ingestion
Yorkshire
25th Percentile
£57,500
Median
£60,000
75th Percentile
£62,500