1 to 25 of 299 Data Ingestion Jobs in England

of economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. As a Data Engineer you will have direct oversight and responsibility for the development implementation review and establishment of data and techniques used in the Advanced … Data Analytics Portfolio (DAP). You will collaborate with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data suitable for analysis, and … developing and maintaining data models. You will support the design of analytical services, products, and models that meet the needs of NHSCFA. The post holder will be required to have a NPPV3. This is a Fixed Term contract until 31st March 2026. Potential applicants can contact Naga Balam at More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The … data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their … data needs as well as working closely with our engineering teams to deliver scalable, high-performance data solutions. Key tasks Azure Data Warehouse Development: Lead the design, development, and maintenance of enterprise-level data warehouses using Azure based data warehouse technologies such as Azure Data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable … data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology-first environment -- work … with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools.? Collaborating with cross More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced in Microsoft … Azure, and have a working knowledge of other technology platforms. You will also be able to lead engagements and have experience in data strategy, master data management, data architecture, data integration, and data visualisation. Reporting to: Data & AI Delivery Lead Key Responsibilities: Define the More ❯

have an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data ready to be consumed … field execution tools as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

As a Tech Manager - Data Engineer with AWS experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS … Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data quality and data governance best practices to maintain data integrity. Performance More ❯

value of technology and build a more sustainable, more inclusive world. Your Role We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. As an SME you will serve … matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in … cloud data engineering providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality More ❯

balance. That's waiting for you at Sainsbury's. Think about the scale it takes for us to feed the nation. The level of data, transactions and variety it involves. Then you'll realise that ours is a modern software engineering environment because it has to be. We've … such as Agile, Scrum and XP. So you can look forward to awesome opportunities in everything from AI to reusable tech. Sainsburys Tech - Senior Data Engineer with core skills in Python, AWS, SQL, CI/CD Why Join Us: We are looking for an experienced Senior Data Engineer … with core skills in Python, AWS, SQL, CI/CD. As an Engineer, you'll have the chance to write great SQL, design complex data models, collaborate with a talented team, and deliver robust data products alongside Data Architects, Data Engineers and Product Managers. Join us More ❯

Job Title: SC Cleared Azure Data Engineer - Government client - Fully Remote Location: Fully Remote - UK Based Salary/Rate: Up to £455 a day Inside IR35 Start Date: April/May Job Type: 3 Month Contract (with scope to extend) Company Introduction We are looking for an SC Cleared … Data Engineer to join our client in the Government Administration sector. **Candidates applying for this role must hold active Security Clearance** As a senior data engineer, you would be engaging with data leads, data scientists, analysts and users around the data space for the data analytics, data insights development and implementation of this team. Engage with business analyst, data scientist , project and delivery leads in analysing backlogs, defining/redefining metric tickets, implementation logic, data mapping, related tasks creation and estimations. A strong actioner of data standards for ETL purposes More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture … that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide … technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for More ❯

Purple. Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … and Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of data … real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role in our success. If you're a maestro of mapping business processes and deciphering complex data More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Senior Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will lead the design … development, and implementation of a real-time data backbone. This position focuses on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You will work closely with various teams to ensure the infrastructure meets the business's growing data More ❯

Our ideal teammate is curious, has an eye for details and always insists on the highest standards. He/she has deep knowledge in data analysis and is able to wrangle the expected data from any data source. Key job responsibilities Data Ingestion, Data Transformation, Data Comparison, Data Validation and Data Monitoring of multiple data sources from multiple different systems Create and Manage ETL jobs, resolve any issues arising during the execution of the jobs Extract data from multiple systems using SQL queries and ETL jobs based on … support ticket requests Monitor health of Data sources and ETL Pipeline Infrastructure with the help of dashboards Monitoring & Resolution of Trouble Tickets within defined SLA's Diving deep into large data sets to identify patterns, gap areas using SQL, Excel and other data manipulation languages BASIC QUALIFICATIONS More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

of mutuality, Nationwide Building Society continues to invest in and accelerate its lakehouse architecture. This role is a key part of the Enterprise-wide data platform team, who are a driving force of enabling the data strategy. We are happy to consider flexible working approaches to help you … the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing You’ll be managing data ingestion in enterprise scale data platforms and leading a team of engineers in that activity. Your day to day will be dealing … with the challenges and opportunities that handling thousands of different source system data feeds bring, in respect of the need to provide adherence to quality controls, governance and process, which ensures our business stakeholders have access to trusted data, at the right time. As a senior engineer in More ❯

of mutuality, Nationwide Building Society continues to invest in and accelerate its lakehouse architecture. This role is a key part of the Enterprise-wide data platform team, who are a driving force of enabling the data strategy. We are happy to consider flexible working approaches to help you … the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing You’ll be managing data ingestion in enterprise scale data platforms and leading a team of engineers in that activity. Your day to day will be dealing … with the challenges and opportunities that handling thousands of different source system data feeds bring, in respect of the need to provide adherence to quality controls, governance and process, which ensures our business stakeholders have access to trusted data, at the right time. As a senior engineer in More ❯

Key Responsibilities: 1. Requirements Gathering: Collaborate with stakeholders, including Fund Owners, Operations & Compliance teams, IT professionals, to elicit, document, and prioritize business requirements. 2. Data Analysis: Analyze data to identify data quality issues, anomalies, and gaps. Work with data teams to define data requirements and … ensure accurate data ingestion. 3. Domain data modeling: Understand the Fund owner's data, analyze data integrity and create foundational domain data model for consumption. 4. Functional Documentation: Understand data consumption aspects by different personas, create detailed functional specifications for data consumption, use … and IT teams. 5. Testing and Quality Assurance: Develop test plans, conduct user acceptance testing (UAT), and collaborate with testing teams to ensure that data changes align with business needs and perform as expected. 6. Change Management: Assist in developing change management strategies and training materials to ensure a More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will help design, develop, and maintain secure and scalable data pipelines using … are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality … and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity Develop robust data models to support analytics and reporting More ❯