1 to 25 of 98 Data Ingestion Jobs in London

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our highly successful … with stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions and … assuring the delivery of good quality, fit-for-purpose solutions. The DPA team are expected to have a broad understanding of Conceptual and Logical Data structures across all the systems within specific business domains. This role is focussed on the cross-functional enterprise IT domains of Data Management More ❯

of economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. As a Data Engineer you will have direct oversight and responsibility for the development implementation review and establishment of data and techniques used in the Advanced … Data Analytics Portfolio (DAP). You will collaborate with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data suitable for analysis, and … developing and maintaining data models. You will support the design of analytical services, products, and models that meet the needs of NHSCFA. The post holder will be required to have a NPPV3. This is a Fixed Term contract until 31st March 2026. Potential applicants can contact Naga Balam at More ❯

understanding the needs of its clients. Job purpose One of AL's main objectives is to ensure that as a Bank, we become a data driven organisation. We need to understand our data, where it is mastered, how it is used, and that systems and data are … working effectively to support and improve internal processes and service to clients. This is an integral role working closely with the Data Quality Manager to deliver the Banks data quality assurance programme. Responsible for upholding the completeness, accuracy and validity of our data, work to improve current … data quality processes, ensure data is consistent across the Banks core systems and that the data held is meets the relevant standards, collaborate with stakeholders across AL sharing data quality best practices, and ensure data is suitable for reporting purposes, including regulatory reports. Where applicable More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

Senior GCP Data Engineer (Contract) Position: Senior GCP Data Engineer Location: London (Hybrid 3 days onsite) Contract Type: 12-month Contract Day Rate: £500(Inside IR35) Start Date: ASAP Client: Leading Investment Bank (Cyber Security Division) ?? Why Join Us? Innovative Projects: Lead the development of cutting-edge data … setting. Professional Growth: Engage in projects that offer opportunities for skill enhancement and career advancement. ??? Role Overview We are seeking a seasoned Senior GCP Data Engineer to spearhead data initiatives within our cyber security division. The ideal candidate will possess a robust background in data engineering, particularly … within the Google Cloud Platform (GCP), and will be adept at designing and implementing scalable data solutions. ?? Key Responsibilities API Development: Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources More ❯

have an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data ready to be consumed … field execution tools as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Senior Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will lead the design … development, and implementation of a real-time data backbone. This position focuses on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You will work closely with various teams to ensure the infrastructure meets the business's growing data More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

Key Responsibilities: 1. Requirements Gathering: Collaborate with stakeholders, including Fund Owners, Operations & Compliance teams, IT professionals, to elicit, document, and prioritize business requirements. 2. Data Analysis: Analyze data to identify data quality issues, anomalies, and gaps. Work with data teams to define data requirements and … ensure accurate data ingestion. 3. Domain data modeling: Understand the Fund owner's data, analyze data integrity and create foundational domain data model for consumption. 4. Functional Documentation: Understand data consumption aspects by different personas, create detailed functional specifications for data consumption, use … and IT teams. 5. Testing and Quality Assurance: Develop test plans, conduct user acceptance testing (UAT), and collaborate with testing teams to ensure that data changes align with business needs and perform as expected. 6. Change Management: Assist in developing change management strategies and training materials to ensure a More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects, and … business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation. What you will be responsible for End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution. Build data integrations and hand … Manage offshore and onshore teams spread globally. What we value These skills will help you succeed in this role: Full stack cloud developer skills: Data (Delta Lake/Databricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management. Strong experience in Python, Scala/ More ❯

Come and be part of the International Seller Services (ISS) Central Analytics Data Engineering (DE) team and work on solving problems! We are a team of Data Engineers supporting Applied Scientists, Data Scientists, and Economists who experiment, research, and turn machine learning, deep learning, and AI research … into great products for our customers. ISS is seeking a smart, highly motivated, and experienced Data Engineer to join our team. In this role, you'll help create the right Data and ML infrastructure. As a Data Engineer, you will provide technical leadership, lead data engineering … are highly available, scalable, stable, secure, and cost-effective. You should be passionate about working with large datasets and experienced in organizing and curating data for analytics. You should have a strategic, long-term view on architecting advanced data ecosystems. You should have experience in building efficient and More ❯

Title : Data and AI Practice Solution Sales Lead Location: London Experience: 15Years We at Coforge are hiring Data and AI Practice Solution Sales Lead professional with the following skillset: Job Summary: We are looking for a skilled Data and AI Practice Solution Sales professional in UK (based … out of London) with a strong delivery and sales background in Data Analytics and AI. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Experience in mining accounts, drive DATA and AI demands, manage CXO interactions, bid … presentations and meeting revenue targets is essential. Sales, Delivery, Presales experience is mandatory within Data Analytics and AI Practice alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Key Responsibilities: 1. Ability to mine key and strategic Accounts across verticals More ❯

Title : Data and AI Practice Solution Sales Lead Location: London Experience: 15Years We at Coforge are hiring Data and AI Practice Solution Sales Lead professional with the following skillset: Job Summary: We are looking for a skilled Data and AI Practice Solution Sales professional in UK (based … out of London) with a strong delivery and sales background in Data Analytics and AI. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Experience in mining accounts, drive DATA and AI demands, manage CXO interactions, bid … presentations and meeting revenue targets is essential. Sales, Delivery, Presales experience is mandatory within Data Analytics and AI Practice alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Key Responsibilities: 1. Ability to mine key and strategic Accounts across verticals More ❯

into London should be possible for everyone in our team. The role We are looking for a Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle to … advance the Trudenty Trust Network. A bit more on what you'll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle Develop and maintain ETL processes for … data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced machine learning algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous model improvement and optimization Data More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations … FinTech and market data, with expertise around strategic cost and human resourcing benchmarking in wholesale finance. Founded in 2001 as an independent research boutique, Expand is a wholly owned subsidiary of the Boston Consulting Group, headquartered in London and with offices in Singapore and New York. At Expand we … entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not More ❯

to be the cornerstones of our organization and these values are upheld only because of our people. Role Essential Responsibilities Design and implement Azure data engineering solutions (Ingestion & Curation) Create and maintain Azure data solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. … Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Ensure data quality/security and compliance. Optimize Azure SQL databases for efficient query performance. Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Lead Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will take an individual … contributor position with leadership responsibilities focused on architecting, developing, and delivering real-time data pipelines and infrastructure. The ideal candidate will collaborate closely with engineering, product, and analytics teams to ensure seamless data flow across the organisation while leveraging cutting-edge technologies for real-time data processing. More ❯

The role We are looking for a Data Engineer to join the Data Science & Engineering team in London. Working at WGSN Together, we create tomorrow A career with WGSN is fast-paced, exciting and full of opportunities to grow and develop. We're a team of consumer and … design trend forecasters, content creators, designers, data analysts, advisory consultants and much more, united by a common goal: to create tomorrow. WGSN's trusted consumer and design forecasts power outstanding product design, enabling our customers to create a better future. Our services cover consumer insights, beauty, consumer tech, fashion … interiors, lifestyle, food and drink forecasting, data analytics and expert advisory. If you are an expert in your field, we want to hear from you. Role overview As a Data Engineer, you will be responsible for managing and improving the company's data ingestion, transformation, and More ❯

Job ID: AMZN Dev Cntr Poland sp. z.o.o Ring AI Data Management are seeking to hire a Data Engineer (a) to work in one of the largest and complex data warehouse (DW) environments, (b) to lead the design and implementation of the architecture of DW solutions for … daily experience in the design, creation, management, and business use of large datasets. Key job responsibilities - Work with engineering and business stakeholders to understand data requirements - Lead the design, model, and implementation of large, evolving, structured and unstructured datasets - Evaluate and implement efficient distributed storage and query techniques - Interact … and integrate with internal and external teams and systems to extract, transform, and load data from a wide variety of sources - Implement robust and maintainable code with clear and maintained documentation - Implement test automation on code implemented through unit testing and integration testing A day in the life The More ❯

Sr. Delivery Consultant - Data Architect, ProServe SDT North The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that … trends and emerging technologies Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts BASIC QUALIFICATIONS - 5+ years' experience architecting and implementing data platforms (Data Lake, Data Lakehouse, Data Mesh, Data Warehouse) at enterprise scale - Experience building end-to-end data solutions … including data ingestion (batch/streaming), storage, orchestration, governance, security, analytics, and observability. - Highly technical and analytical mindset with ability to think strategically about business, product, and technical challenges in an enterprise environment - Extensive hands-on experience with data platform technologies, including at least three of: Spark More ❯