17 of 17 Data Ingestion Jobs in the North of England

by the infected blood community to provide financial compensation to victims of infected blood on a UK-wide basis. This role will lead our data platform architecture and modelling team within the Data Operations arm of the IBCA Data Directorate. The Data Operations team is responsible … for developing and running safe and secure data solutions that provide a single source of truth for those going through their compensation journey. They are designing and building a new data platform using Amazon Web Services (AWS) and data management and intelligence products using Databricks and Quantexa. … We are taking a product-centric approach treating data as a product and are building squads around our products, with a focus on paying compensation to those impacted by the infected blood scandal seamlessly. You will focus on designing scalable and flexible data solutions for data management More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable … data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology-first environment -- work … with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools.? Collaborating with cross More ❯

and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with deep … expertise in designing and implementing cloud-native data platforms . The ideal candidate will have strong experience across Azure and AWS , with the ability to create scalable, secure, and high-performing data architectures that meet complex business needs. You will play a key role in shaping data More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap to maximize long-term business … value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design … and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and third-party resources. Establish clear service definitions, SLAs, and performance More ❯

ECOM are pleased to be exclusively recruiting for a Senior Data Engineer here in Manchester. You'll join a team where your work reaches millions. This role is within a forward-thinking company leading, offering a dynamic environment where you can grow, make an impact, and shape the future … of technology. The Role: As a Data Engineer, you'll design, develop, and optimise data pipelines on a Databricks-based platform, Symphony. You'll collaborate with teams to create scalable data solutions, ensuring efficient data ingestion, transformation, and analysis. Responsibilities: Design and maintain scalable data pipelines and infrastructure using Databricks. Collaborate with commercial teams to define data product requirements and visualisations. Develop and optimise ETL/ELT processes for smooth data flow and accurate analysis. Ensure adherence to data architecture principles and support the development of data dashboards. Monitor and More ❯

Data Engineer - SC Clearance Leeds (Hybrid and Flexible Working Available) 65K + Bonus **🔐 MUST HAVE ACTIVE SC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. 🔍 What You’ll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll More ❯

and ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … solutions (e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … latest advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data Architect in the Insurance … or Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and Claims More ❯

I'm looking for an Analytics Engineer to join a global business who are building modern, AI-ready data platform, allowing for better decision-making for both themselves and their customers. Their modern tech stack includes Snowflake, dbt, Azure, Power BI and other next-gen BI platforms, offering the … chance to work on cutting-edge technologies. You'll join their newly established Data Team, based in their modern office space in Leeds - you'll spend at least 3 days per week in the office to collaborate with your team, in what's a very fast-paced, forward-thinking … and entrepreneurial environment. The purpose of this role is to design and deliver scalable data models in Snowflake, applying analytics best-practices using dbt. You'll collaborate closely with Power BI developers to deliver insightful Power BI reports, build curated data layers that enable consistent KPI definitions, and More ❯

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

Data Engineer (Python Spark SQL) *Newcastle Onsite* to £70k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive … growth potential. As a Data Engineer you'll be instrumental in transitioning the core data platform to Azure, managing 3rd party data ingestion and integration. You'll collaborate and be supported by a small team, seeking ways to improve the data quality and introduce event … top tier university, Computer Science or similar technical/scientific discipline, backed by minimum A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data More ❯

We are seeking an experienced Kafka Real-Time Architect to design and implement scalable, high-performance real-time data processing systems leveraging Apache Kafka. In this role, you will be responsible for architecting and managing Kafka clusters, ensuring system scalability and availability, and integrating Kafka with various data processing platforms. This position requires a deep understanding of Kafka and related technologies, along with a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are robust, highly … available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster Management: Configure, deploy, and maintain highly available Kafka clusters, ensuring scalability and fault tolerance across distributed environments. Manage configurations, optimize cluster performance, and troubleshoot issues to maintain smooth operations. Integration & Data Processing More ❯

GBP/Day (Inside IR35) Role Description: A Security Solutions Architect + GenAI would design and implement secure AI/ML solutions, ensuring data protection and compliance while leveraging AI's capabilities. This role combines expertise in cybersecurity, AI/ML, and cloud technologies to architect secure and scalable … AI solutions. Responsibilities : Security Architecture: Design and implement security solutions for AI/ML applications, focusing on data privacy, confidentiality, and integrity. GenAI Solution Design: Develop and deploy AI-powered solutions, integrating security measures throughout the life cycle, from data ingestion to model deployment. Skills and Qualifications … understanding of cybersecurity principles, threat modelling, vulnerability assessment, and penetration testing. Cloud Computing: Familiarity with cloud platforms (AWS, Azure, GCP) and their security features. Data Privacy and Compliance: Knowledge of data privacy regulations (GDPR, CCPA) and industry standards. Problem-solving and Analytical Skills: Ability to identify, analyze, and More ❯

The Role We are seeking an experienced Software Development Manager with extensive expertise in AI, Data Engineering, and Architecture. You will lead the development of scalable, AI-driven solutions, combining deep technical knowledge of AWS Cloud Services, MLOps, and core Data Science concepts with proven leadership and strong … up for quality for our customers then we want to talk to you. Key responsibilities Lead engineering teams to deliver high-quality AI and Data solutions. Define and oversee solution and technical architecture decisions. Drive the technical vision, including the selection of appropriate technologies, frameworks, and architectural patterns. Review … designs, providing feedback to Product Management and Architects. Oversee the end-to-end lifecycle of AI projects including data ingestion, ML model development, deployment, and monitoring. Implement and refine MLOps processes, ensuring robust and scalable delivery of models into production. Plan, initiate, manage, and monitor technical projects from More ❯

Primavera P6, SAP SuccessFactors and other key construction centric systems. Verify the integrity of extracted data. Awareness of, and support embedding and applying revised Data Governance and Information Security standards and best practices. Applying Murphy best practices to code management, documentation and release. Working as part of the Planning … you: Detailed knowledge and practical experience with Primavera P6 and PowerBI. Demonstrable experience with Visual Studio and Azure toolsets. Working knowledge of ETL and data ingestion (API knowledge). Experience within construction and/or civil engineering processes and applications. What's in it for you? 27 days More ❯