1 to 25 of 109 Data Ingestion Jobs in London

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our highly successful … with stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions and … assuring the delivery of good quality, fit-for-purpose solutions. The DPA team are expected to have a broad understanding of Conceptual and Logical Data structures across all the systems within specific business domains. This role is focussed on the cross-functional enterprise IT domains of Data Management More ❯

of economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. As a Data Engineer you will have direct oversight and responsibility for the development implementation review and establishment of data and techniques used in the Advanced … Data Analytics Portfolio (DAP). You will collaborate with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data suitable for analysis, and … developing and maintaining data models. You will support the design of analytical services, products, and models that meet the needs of NHSCFA. The post holder will be required to have a NPPV3. This is a Fixed Term contract until 31st March 2026. Potential applicants can contact Naga Balam at More ❯

have an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data ready to be consumed … field execution tools as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

balance. That's waiting for you at Sainsbury's. Think about the scale it takes for us to feed the nation. The level of data, transactions and variety it involves. Then you'll realise that ours is a modern software engineering environment because it has to be. We've … such as Agile, Scrum and XP. So you can look forward to awesome opportunities in everything from AI to reusable tech. Sainsburys Tech - Senior Data Engineer with core skills in Python, AWS, SQL, CI/CD Why Join Us: We are looking for an experienced Senior Data Engineer … with core skills in Python, AWS, SQL, CI/CD. As an Engineer, you'll have the chance to write great SQL, design complex data models, collaborate with a talented team, and deliver robust data products alongside Data Architects, Data Engineers and Product Managers. Join us More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Senior Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will lead the design … development, and implementation of a real-time data backbone. This position focuses on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You will work closely with various teams to ensure the infrastructure meets the business's growing data More ❯

Our ideal teammate is curious, has an eye for details and always insists on the highest standards. He/she has deep knowledge in data analysis and is able to wrangle the expected data from any data source. Key job responsibilities Data Ingestion, Data Transformation, Data Comparison, Data Validation and Data Monitoring of multiple data sources from multiple different systems Create and Manage ETL jobs, resolve any issues arising during the execution of the jobs Extract data from multiple systems using SQL queries and ETL jobs based on … support ticket requests Monitor health of Data sources and ETL Pipeline Infrastructure with the help of dashboards Monitoring & Resolution of Trouble Tickets within defined SLA's Diving deep into large data sets to identify patterns, gap areas using SQL, Excel and other data manipulation languages BASIC QUALIFICATIONS More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

of mutuality, Nationwide Building Society continues to invest in and accelerate its lakehouse architecture. This role is a key part of the Enterprise-wide data platform team, who are a driving force of enabling the data strategy. We are happy to consider flexible working approaches to help you … the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing You’ll be managing data ingestion in enterprise scale data platforms and leading a team of engineers in that activity. Your day to day will be dealing … with the challenges and opportunities that handling thousands of different source system data feeds bring, in respect of the need to provide adherence to quality controls, governance and process, which ensures our business stakeholders have access to trusted data, at the right time. As a senior engineer in More ❯

of mutuality, Nationwide Building Society continues to invest in and accelerate its lakehouse architecture. This role is a key part of the Enterprise-wide data platform team, who are a driving force of enabling the data strategy. We are happy to consider flexible working approaches to help you … the advert earlier than the advertised date, so please apply as soon as you can. What you’ll be doing You’ll be managing data ingestion in enterprise scale data platforms and leading a team of engineers in that activity. Your day to day will be dealing … with the challenges and opportunities that handling thousands of different source system data feeds bring, in respect of the need to provide adherence to quality controls, governance and process, which ensures our business stakeholders have access to trusted data, at the right time. As a senior engineer in More ❯

Key Responsibilities: 1. Requirements Gathering: Collaborate with stakeholders, including Fund Owners, Operations & Compliance teams, IT professionals, to elicit, document, and prioritize business requirements. 2. Data Analysis: Analyze data to identify data quality issues, anomalies, and gaps. Work with data teams to define data requirements and … ensure accurate data ingestion. 3. Domain data modeling: Understand the Fund owner's data, analyze data integrity and create foundational domain data model for consumption. 4. Functional Documentation: Understand data consumption aspects by different personas, create detailed functional specifications for data consumption, use … and IT teams. 5. Testing and Quality Assurance: Develop test plans, conduct user acceptance testing (UAT), and collaborate with testing teams to ensure that data changes align with business needs and perform as expected. 6. Change Management: Assist in developing change management strategies and training materials to ensure a More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects, and … business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation. What you will be responsible for End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution. Build data integrations and hand … Manage offshore and onshore teams spread globally. What we value These skills will help you succeed in this role: Full stack cloud developer skills: Data (Delta Lake/Databricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management. Strong experience in Python, Scala/ More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity that is … redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising data pipelines, virtualised environments, and … business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data infrastructure, ensuring scalability, reliability, and security. Define and More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity that is … redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising data pipelines, virtualised environments, and … business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data infrastructure, ensuring scalability, reliability, and security. Define and More ❯

Title : Data and AI Practice Solution Sales Lead Location: London Experience: 15Years We at Coforge are hiring Data and AI Practice Solution Sales Lead professional with the following skillset: Job Summary: We are looking for a skilled Data and AI Practice Solution Sales professional in UK (based … out of London) with a strong delivery and sales background in Data Analytics and AI. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Experience in mining accounts, drive DATA and AI demands, manage CXO interactions, bid … presentations and meeting revenue targets is essential. Sales, Delivery, Presales experience is mandatory within Data Analytics and AI Practice alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Key Responsibilities: 1. Ability to mine key and strategic Accounts across verticals More ❯

Title : Data and AI Practice Solution Sales Lead Location: London Experience: 15Years We at Coforge are hiring Data and AI Practice Solution Sales Lead professional with the following skillset: Job Summary: We are looking for a skilled Data and AI Practice Solution Sales professional in UK (based … out of London) with a strong delivery and sales background in Data Analytics and AI. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Experience in mining accounts, drive DATA and AI demands, manage CXO interactions, bid … presentations and meeting revenue targets is essential. Sales, Delivery, Presales experience is mandatory within Data Analytics and AI Practice alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Key Responsibilities: 1. Ability to mine key and strategic Accounts across verticals More ❯

into London should be possible for everyone in our team. The role We are looking for a Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle to … advance the Trudenty Trust Network. A bit more on what you'll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle Develop and maintain ETL processes for … data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced machine learning algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous model improvement and optimization Data More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations … FinTech and market data, with expertise around strategic cost and human resourcing benchmarking in wholesale finance. Founded in 2001 as an independent research boutique, Expand is a wholly owned subsidiary of the Boston Consulting Group, headquartered in London and with offices in Singapore and New York. At Expand we … entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not More ❯

to be the cornerstones of our organization and these values are upheld only because of our people. Role Essential Responsibilities Design and implement Azure data engineering solutions (Ingestion & Curation) Create and maintain Azure data solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. … Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Ensure data quality/security and compliance. Optimize Azure SQL databases for efficient query performance. Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Lead Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will take an individual … contributor position with leadership responsibilities focused on architecting, developing, and delivering real-time data pipelines and infrastructure. The ideal candidate will collaborate closely with engineering, product, and analytics teams to ensure seamless data flow across the organisation while leveraging cutting-edge technologies for real-time data processing. More ❯

I'm working with a client who is looking for a Data Engineer to take ownership of their data infrastructure as they build out a brand-new insurance-focused product suite. This is a rare opportunity to work directly with experienced data leaders who've collaborated on … platform. The business has secured 60% of its funding and is about to sign its first client. They've already designed tooling for AI, data migrations, and integrations-and now need someone to help build out these tools on top of Informatica, while translating SAP requirements and setting up … robust data infrastructure in the cloud. Please apply if the below sounds exciting to you-but only if you have strong experience with SAP, Informatica, and AWS. Key Responsibilities Build and optimize scalable data pipelines on Informatica Translate SAP data requirements into Informatica-based solutions Design tooling More ❯

I'm working with a client who is looking for a Data Engineer to take ownership of their data infrastructure as they build out a brand-new insurance-focused product suite. This is a rare opportunity to work directly with experienced data leaders who've collaborated on … platform. The business has secured 60% of its funding and is about to sign its first client. They've already designed tooling for AI, data migrations, and integrations-and now need someone to help build out these tools on top of Informatica, while translating SAP requirements and setting up … robust data infrastructure in the cloud. Please apply if the below sounds exciting to you-but only if you have strong experience with SAP, Informatica, and AWS. Key Responsibilities Build and optimize scalable data pipelines on Informatica Translate SAP data requirements into Informatica-based solutions Design tooling More ❯