1 to 25 of 79 Data Ingestion Jobs in the UK excluding London

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable … data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology-first environment -- work … with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools.? Collaborating with cross More ❯

customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced in Microsoft … Azure, and have a working knowledge of other technology platforms. You will also be able to lead engagements and have experience in data strategy, master data management, data architecture, data integration, and data visualisation. Reporting to: Data & AI Delivery Lead Key Responsibilities: Define the More ❯

Build and maintain the configuration of the data stack within the DevOps framework. • Develop data objects and write code in and around the data stack. • Interact with upstream and downstream systems and API for data ingestion and egestion. • Build ETL pipelines and data framework … for monitoring the pipeline. • Ensure performance, quality, and consistency in the data and processes. • Champion good data design practices and promote data quality. • Collaborate and contribute with data architecture, DBA's, and other team members. • Review use cases, data demand, envision future demands to develop … data services to support Business needs. • Explore new ways of improving data utilization/consumption, discovery, and lineage. • Develop and champion data principles and define/lead efforts for adoption. • Develop tools and functions for cross-system data quality and data cleansing. • Implement data More ❯

have an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data ready to be consumed … field execution tools as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

As a Tech Manager - Data Engineer with AWS experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS … Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data quality and data governance best practices to maintain data integrity. Performance More ❯

value of technology and build a more sustainable, more inclusive world. Your Role We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. As an SME you will serve … matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in … cloud data engineering providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture … that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide … technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for More ❯

Purple. Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … and Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of data … real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role in our success. If you're a maestro of mapping business processes and deciphering complex data More ❯

Skilled Data Engineer (Azure, Databricks, Data Lakes) Location: Belfast (3 days a week in the office) Recruiter: Kelly Nixon at VANRATH We are currently seeking a Skilled Data Engineer to join a leading Professional Services client based in Belfast. This is an exciting opportunity to work on … high-impact data engineering projects, leveraging cutting-edge technologies like Azure , Databricks , and Data Lakes . About the Role: As a Data Engineer, you will be responsible for building and maintaining scalable data solutions that will drive actionable insights for a range of professional services clients. … You will play a critical role in the design and implementation of data architecture, working with large datasets to ensure their availability, reliability, and security across a variety of applications. Key Responsibilities: Design, implement, and manage data lakes and data pipelines using Azure and Databricks . Develop More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

of mutuality, Nationwide Building Society continues to invest in and accelerate its lakehouse architecture. This role is a key part of the Enterprise-wide data platform team, who are a driving force of enabling the data strategy. We are happy to consider flexible working approaches to help you … the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing You’ll be managing data ingestion in enterprise scale data platforms and leading a team of engineers in that activity. Your day to day will be dealing … with the challenges and opportunities that handling thousands of different source system data feeds bring, in respect of the need to provide adherence to quality controls, governance and process, which ensures our business stakeholders have access to trusted data, at the right time. As a senior engineer in More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will help design, develop, and maintain secure and scalable data pipelines using … are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality … and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity Develop robust data models to support analytics and reporting More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

digital services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … team to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … and product teams to build and optimize a scalable architecture, including managing an Azure Data Lake Gen2, Azure Data Factory, Snowflake warehouse, and RudderStack for customer data flows. Your responsibilities will include designing and maintaining data integrations from sources such as HubSpot and Shopify, enabling efficient More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity that is … redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising data pipelines, virtualised environments, and … business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data infrastructure, ensuring scalability, reliability, and security. Define and More ❯

Title : Data and AI Practice Solution Sales Lead Location: London Experience: 15Years We at Coforge are hiring Data and AI Practice Solution Sales Lead professional with the following skillset: Job Summary: We are looking for a skilled Data and AI Practice Solution Sales professional in UK (based … out of London) with a strong delivery and sales background in Data Analytics and AI. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Experience in mining accounts, drive DATA and AI demands, manage CXO interactions, bid … presentations and meeting revenue targets is essential. Sales, Delivery, Presales experience is mandatory within Data Analytics and AI Practice alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Key Responsibilities: 1. Ability to mine key and strategic Accounts across verticals More ❯

I'm working with a client who is looking for a Data Engineer to take ownership of their data infrastructure as they build out a brand-new insurance-focused product suite. This is a rare opportunity to work directly with experienced data leaders who've collaborated on … platform. The business has secured 60% of its funding and is about to sign its first client. They've already designed tooling for AI, data migrations, and integrations-and now need someone to help build out these tools on top of Informatica, while translating SAP requirements and setting up … robust data infrastructure in the cloud. Please apply if the below sounds exciting to you-but only if you have strong experience with SAP, Informatica, and AWS. Key Responsibilities Build and optimize scalable data pipelines on Informatica Translate SAP data requirements into Informatica-based solutions Design tooling More ❯

customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced in Microsoft … Azure, and have a working knowledge of other technology platforms. You will also be able to lead engagements and have experience in data strategy, master data management, data architecture, data integration, and data visualisation. Reporting to: Data & AI Delivery Lead Key Responsibilities : Define the More ❯

Iglu: is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our product teams, agilely, to ensure … data is imported & transformed accurately and timely from both internal and external data stores. You'll work with the Product Owner to deliver new data processing requirements and changes to existing pipelines. You'll be responsible for supporting and maintaining our existing data ingestion pipelines More ❯

Iglu: is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our product teams, agilely, to ensure … data is imported & transformed accurately and timely from both internal and external data stores. You'll work with the Product Owner to deliver new data processing requirements and changes to existing pipelines. You'll be responsible for supporting and maintaining our existing data ingestion pipelines More ❯

Are you passionate about shaping data strategies that drive real change and innovation? Do you excel at designing scalable data solutions, implementing best practices, and leading the adoption of cutting-edge technologies? Could you be our next Data Engineer Architect, helping to enhance our data-driven … Were also making significant investments in our people, including providing a modern, vibrant workplace and embracing hybrid working. What youll be doing As a Data Engineer Architect, youll play a pivotal role in transforming The IETs data landscape, ensuring our data strategy and technology solutions are cutting … edge, efficient, and aligned with our strategic objectives. Reporting to the Head of Data Technology and CRM, youll lead the evolution of our data architecture, championing best practices and driving the adoption of Azure-based data solutions. Youll be at the forefront of modernising our data More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap to maximize long-term business … value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design … and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and third-party resources. Establish clear service definitions, SLAs, and performance More ❯