1 to 25 of 135 Data Ingestion Jobs in the UK excluding London

We are seeking a strategic and hands-on Lead Data Engineer to own the development of Aerial Direct’s cloud-native data platform. Working primarily within the Microsoft Azure ecosystem, you will be responsible for building and maintaining scalable data pipelines, optimising architecture for performance, and enabling actionable insights across the business. In addition to technical delivery … you will lead a small team of data engineers and analysts, helping to embed best practices, mentor talent, and deliver enterprise-grade data services that power automation, reporting, and transformation initiatives. You will play a central role in shaping how data is stored, governed, and consumed across the business, ensuring security, scalability, and compliance are built in … Programme offering confidential Wellbeing Support Regular events and activities throughout the year including our famous Christmas Party, summer party & Employee Awards! Company pension scheme You’ll get involved in: Data Strategy, Architecture & Engineering Owning and evolving Aerial Direct’s Azure-based data platform, ensuring performance, security, and scalability. Design, management, and optimisation of data warehouse and data More ❯

Job Description Data Architect Data Architects at Next work closely with the Next Architect teams to identify potential technology innovations, make recommendations that support business growth and drive efficiencies, align business requirements with Next strategy, and are responsible for designing, managing, and deploying an organisation’s data and analytics infrastructure. The position requires strong problem-solving skills … detailed knowledge of corporate and legal data standards, and an understanding of information systems. The Data Architect is also expected to plan and manage their own work efficiently. About the Team An Architect at Next Technology is an IT specialist with a focus on enterprise IT design, implementing complex solutions and specifying the design of services that support … IT strategy, organisational roadmaps, and Next Technology Solutions standards. About the Role Set technical direction and roadmap for the data platform (Data Engineering and Analytics) and provide technical leadership in collaboration with key technical and business stakeholders. Define, document, share (explain/present), and maintain solution architectures and high-level design patterns for the data platform in More ❯

Europe's leading Google Cloud specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data and analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll work alongside specialists in … motivated and energetic people who are eager to learn and grow, so if you want to supercharge your career, join Qodea! What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain automated data pipelines to … monitor data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends and technologies in big data and data engineering Ensure data quality, accuracy, and completeness Implement and enforce data governance policies and procedures to ensure data quality and accuracy: Collaborate with data More ❯

Join to apply for the Data Engineer role at Somerset Bridge Group Join to apply for the Data Engineer role at Somerset Bridge Group Get AI-powered advice on this job and more exclusive features. Application Deadline: 27 June 2025 Department: [SBSS] Enterprise Data Management Location: Newcastle Compensation: £55,000 - £68,500/year Description We're … building something special — and we need a talented Data Engineer to help bring our Azure data platform to life. This is your chance to work on a greenfield Enterprise Data Warehouse programme in the insurance sector, shaping data pipelines and platforms that power smarter decisions, better pricing, and sharper customer insights. The Data Engineer will … design, build, and optimise scalable data pipelines within Azure Databricks, ensuring high-quality, reliable data is available to support pricing, underwriting, claims, and operational decision-making. This role is critical in modernising SBG’s cloud-based data infrastructure, ensuring compliance with FCA/PRA regulations, and enabling AI-driven analytics and automation. By leveraging Azure-native services More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

About the role... Do you get satisfaction out of all things data? Interested in pushing your career to the next level at one of the Sunday Times Top 100 Best Companies to Work For? Cooper Parry are seeking a skilled and proactive Data Engineer to join our growing Data & Analytics team. You will play a critical role … in designing, building, and maintaining robust, scalable data infrastructure on the Azure and Microsoft stack, enabling enterprise-wide analytics, reporting, and data science initiatives. This role offers the opportunity to shape the foundation of our future "lab and factory" model of analytics and ML delivery. A day in the life of a CP Data Engineer... Design and … build end-to-end data pipelines and integrations using Azure Data Factory, Azure Synapse and related tools Monitor data pipeline schedules and resolve issues related to job failures, data delays, or quality problems Develop and support a Lakehouse architecture, including structured and unstructured data ingestion, processing, and consumption layers Implement and optimise semantic models More ❯

services for both civil and defence markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Leonardo's Data practice works across a diverse array of sectors including Defence, Telecommunications, Energy and Finance to help secure … national infrastructure in the UK and beyond. What you will do as a Senior Data Engineer This is a highly rewarding and hands-on role with exposure across both traditional and cutting-edge enterprise IT as well as bespoke Operational Technology systems. You will be working in a dynamic environment with a team that is motivated to deliver innovative … grow our practice and solve some of the most challenging, exciting and critical challenges to the UK's digital landscape. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security More ❯

services for both civil and defence markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Leonardo’s Data practice works across a diverse array of sectors including Defence, Telecommunications, Energy and Finance to help secure … national infrastructure in the UK and beyond What you will do as a Senior Data Engineer This is a highly rewarding and hands on role with exposure across both traditional and cutting edge enterprise IT as well as bespoke Operational Technology systems. You will be working in a dynamic environment with a team that is motivated to deliver innovative … grow our practice and solve some of the most challenging, exciting and critical challenges to the UK’s digital landscape. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security More ❯

Job Description Job Title: Senior Data Engineer Salary: up to £65,000 Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong … data engineer to work in the data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data, Databricks and dbt Manage and optimize data storage solutions such as Amazon S3, Redshift, RDS, and DynamoDB. Implement and manage infrastructure-as-code (IaC) using tools like More ❯

Social network you want to login/join with: Senior Data Engineer, warrington, cheshire col-narrow-left Client: The Citation Group Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight in the … Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the data engineering team, to expand and maintain the data infrastructure that provides … the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain More ❯

Job Description Description: We are actively seeking a Data Engineer responsible for designing, building, and maintaining infrastructure that supports data storage, processing, and retrieval. The role involves working with large data sets and developing data pipelines to transfer data from source systems to data warehouses, data lakes, and other storage and processing systems. … The Data Engineer will collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the KR data architecture and data-driven solutions. Note: Due to federal security clearance requirements, applicants must be U.S. citizens or Permanent Residents with the ability to obtain an … full-time employment after the contract. Benefits include Medical, Dental, Vision, 401k with company matching, and life insurance. Rate: $80 - $86/hr W2 Responsibilities: Develop, optimize, and maintain data ingestion flows using Apache Kafka, Apache Nifi, and MySQL/PostgreSQL. Develop within AWS cloud services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena. Coordinate with data More ❯

Greggs Newcastle Upon Tyne, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Azure Data Engineer role at Greggs Greggs Newcastle Upon Tyne, England, United Kingdom Join to apply for the Senior Azure Data Engineer role at Greggs This range is provided by Greggs. Your actual pay will be … based on your skills and experience — talk with your recruiter to learn more. Base pay range We have a fantastic opportunity to join the growing Data Platform team at Greggs as a Senior Azure Data Platform Engineer. You will be part of the team responsible for ensuring high quality data is sourced and curated in our Azure … cloud platform and to ensure that this is a foundation for growth for all data, analytic and AI services. Your involvement will span the entire data lifecycle: from orchestrating data ingestion into our Azure Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Join to apply for the Lead Data Engineer role at Motability Operations Ltd 4 days ago Be among the first 25 applicants Join to apply for the Lead Data Engineer role at Motability Operations Ltd Continuing Defleet’s data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking … for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem … of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. About You We are looking for a skilled Lead Data Engineer who: Personal Attributes Self-starter with initiative and enthusiasm More ❯

and improving in everything they do. We support our clients with incubation services, offering ready-made capabilities supported by smart, execution-focused practitioners. The Role Are you passionate about data and transforming raw information into valuable insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. … This role suits someone who enjoys working with advanced technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're excited about unlocking the full potential of data for organizations, we want to hear from you. Proven experience in data engineering, with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with … Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming, especially for data manipulation and engineering. A genuine interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and More ❯

and innovating in everything they do. We support clients with incubation services, offering out-of-the-box capabilities backed by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role suits someone who enjoys working with advanced technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you are excited about helping organizations unlock their data's full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or … Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication More ❯

Job summary We are seeking 3 Data Engineers to join our defence & security client on a contract basis. Key skills required for this role DV cleared, Data Engineer, ETL, Elastic Stack, Apache NiFi Important DV Cleared - Data Engineer - ELK & NiFi - Outside IR35 Location: Worcester Duration: 6 months initial contract Security: Active DV clearance required In this role … you will help design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. These positions are onsite in Worcester and require active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack and Apache NiFi. Implement data ingestion, transformation … and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Role: Data Engineer Location: Belfast Duration: Long Term Contract Opportunity - Rolling Contract Rate: Market Rates - Inside IR35 Job Description : Fujitsu's Decision Intelligence practice in the UK helps organisations bridge the gap between data and insights, empowering businesses to make smarter decisions, optimise operations, and drive innovation. From AI-powered analytics to data governance and security, we … comprehensive suite of services to help our Public and Private Sector customers unlock the full potential of their data. Job Summary : We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies … Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services. Data Transformation and Cleaning: Transform and clean raw data to ensure data quality More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company's reporting and … analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. You’ll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear documentation. Collaborate with Power BI developers and business analysts More ❯

We are looking for an experienced Senior Data Engineer to join one of our client's team. Role and Responsibilities: Design, develop, and maintain scalable data pipelines using Python, PySpark and Databricks. Implement data orchestration workflows using Airflow or similar tools. Manage and optimize data storage solutions on Azure Cloud. Develop and maintain containerized microservices using … Docker. Collaborate with cross-functional teams to ensure data quality and integrity. Support the setup of blockchains. Build tools to acquire data from blockchains and perform analysis on the data using Databricks. Support production infrastructure, including monitoring and automation using tools like Datadog. Participate in agile development practices, contributing to planning exercises and working in cross-functional … groups. Skills and Qualifications: Bachelor's or Master's degree in Computer Science, Data Science, or a related field. Advanced Python knowledge for data processing and scripting. Proven experience with Spark and SQL for data engineering and analysis. Experience with data orchestration tools like Airflow. Hands-on experience with one or more cloud services (Azure, AWS More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

teammates who drive continual improvement and innovation, supporting clients towards self-sufficiency with out-of-the-box capabilities and expert practitioners. The Role Are you passionate about transforming raw data into meaningful insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role is ideal for … someone enthusiastic about working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're eager to help organizations unlock their data’s potential, we want to hear from you. Proven experience in data engineering, with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or … a strong willingness to learn. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science, with a desire to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities for a consultancy environment. Experience in data modeling More ❯

self-sufficiency and growth. We support our clients with incubation services and out-of-the-box capabilities, backed by smart, execution-focused practitioners. The Role Are you passionate about data and transforming raw information into insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role … is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you’re excited about unlocking data’s full potential for organizations, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with … Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities More ❯