12 of 12 Data Ingestion Jobs in the North of England

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable … data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology-first environment -- work … with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools.? Collaborating with cross More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap to maximize long-term business … value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design … and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and third-party resources. Establish clear service definitions, SLAs, and performance More ❯

Data Engineer - SC Clearance Leeds (Hybrid and Flexible Working Available) 65K + Bonus **🔐 MUST HAVE ACTIVE SC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. 🔍 What You’ll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft’s data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You’ll More ❯

Data Engineer - SC Clearable Leeds (Hybrid and Flexible Working Available) 65K + Bonus **?? MUST BE ELIGIBLE FORSC CLEARANCE Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance … to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies. ?? What You'll Be Doing: Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and business … intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft's data stack to unlock actionable insights and improve internal reporting capabilities. We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You'll More ❯

and ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … solutions (e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … latest advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data Architect in the Insurance … or Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and Claims More ❯

Senior Data Platform Engineer Location: Primarily Remote (1 day/month in-office) Salary: £70,000 – 85,000 Join a cutting-edge Data Platform Engineering team working on real-time analytics and microservices architecture to power one of the most sophisticated martech solutions in the industry. About the … Role: Reporting directly to the Platform Engineering Manager , you'll be a vital part of a team that enables real-time data processing and analytics. This role involves developing and maintaining microservices, capturing user events and feeding them into a Snowflake-powered analytics platform. What You’ll Be Doing … Developing microservices that handle real-time data ingestion from APIs into the data warehouse Working with live-streaming data Writing clean, efficient Java code (Python is a bonus!) Enhancing and scaling the experimentation framework to support data science and ML operations Ensuring high-quality, accurate More ❯

Data Engineer (Python Spark SQL) *Newcastle Onsite* to £70k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive … growth potential. As a Data Engineer you'll be instrumental in transitioning the core data platform to Azure, managing 3rd party data ingestion and integration. You'll collaborate and be supported by a small team, seeking ways to improve the data quality and introduce event … top tier university, Computer Science or similar technical/scientific discipline, backed by minimum A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data More ❯

GBP/Day (Inside IR35) Role Description: A Security Solutions Architect + GenAI would design and implement secure AI/ML solutions, ensuring data protection and compliance while leveraging AI's capabilities. This role combines expertise in cybersecurity, AI/ML, and cloud technologies to architect secure and scalable … AI solutions. Responsibilities : Security Architecture: Design and implement security solutions for AI/ML applications, focusing on data privacy, confidentiality, and integrity. GenAI Solution Design: Develop and deploy AI-powered solutions, integrating security measures throughout the life cycle, from data ingestion to model deployment. Skills and Qualifications … understanding of cybersecurity principles, threat modelling, vulnerability assessment, and penetration testing. Cloud Computing: Familiarity with cloud platforms (AWS, Azure, GCP) and their security features. Data Privacy and Compliance: Knowledge of data privacy regulations (GDPR, CCPA) and industry standards. Problem-solving and Analytical Skills: Ability to identify, analyze, and More ❯

The Role We are seeking an experienced Software Development Manager with extensive expertise in AI, Data Engineering, and Architecture. You will lead the development of scalable, AI-driven solutions, combining deep technical knowledge of AWS Cloud Services, MLOps, and core Data Science concepts with proven leadership and strong … up for quality for our customers then we want to talk to you. Key responsibilities Lead engineering teams to deliver high-quality AI and Data solutions. Define and oversee solution and technical architecture decisions. Drive the technical vision, including the selection of appropriate technologies, frameworks, and architectural patterns. Review … designs, providing feedback to Product Management and Architects. Oversee the end-to-end lifecycle of AI projects including data ingestion, ML model development, deployment, and monitoring. Implement and refine MLOps processes, ensuring robust and scalable delivery of models into production. Plan, initiate, manage, and monitor technical projects from More ❯