1 to 25 of 151 Data Ingestion Jobs in London

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our highly successful … with stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions and … assuring the delivery of good quality, fit-for-purpose solutions. The DPA team are expected to have a broad understanding of Conceptual and Logical Data structures across all the systems within specific business domains. This role is focussed on the cross-functional enterprise IT domains of Data Management More ❯

understanding the needs of its clients. Job purpose One of AL's main objectives is to ensure that as a Bank, we become a data driven organisation. We need to understand our data, where it is mastered, how it is used, and that systems and data are … working effectively to support and improve internal processes and service to clients. This is an integral role working closely with the Data Quality Manager to deliver the Banks data quality assurance programme. Responsible for upholding the completeness, accuracy and validity of our data, work to improve current … data quality processes, ensure data is consistent across the Banks core systems and that the data held is meets the relevant standards, collaborate with stakeholders across AL sharing data quality best practices, and ensure data is suitable for reporting purposes, including regulatory reports. Where applicable More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

have an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data ready to be consumed … field execution tools as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI … software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI … with agreed architectural principles and toolsets. Capable of working closely with the business and delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional More ❯

As a Data Engineer on the Data and AI team, you will design and implement robust data pipelines and infrastructure that power our organization's data-driven decisions and AI capabilities. This role is critical in developing and maintaining our enterprise-scale data processing systems … that handle high-volume transactions while ensuring data security, privacy compliance, and optimal performance. You'll be part of a dynamic team that designs and implements comprehensive data solutions, from real-time processing architectures to secure storage solutions and privacy-compliant data access layers. The role involves … close collaboration with cross-functional teams, including software development engineers, product managers, and scientists, to create data products that power critical business capabilities. You'll have the opportunity to work with leading technologies in cloud computing, big data processing, and machine learning infrastructure, while contributing to the development More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Senior Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will lead the design … development, and implementation of a real-time data backbone. This position focuses on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You will work closely with various teams to ensure the infrastructure meets the business's growing data More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting … opportunity for you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve … endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting … opportunity for you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve … endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. More ❯

Investment Desktop Key Responsibilities: Requirements Gathering: Collaborate with stakeholders, including Fund Owners, Operations & Compliance teams, IT professionals, to elicit, document, and prioritize business requirements. Data Analysis: Analyze data to identify data quality issues, anomalies, and gaps. Work with data teams to define data requirements and … ensure accurate data ingestion. Domain Data Modeling: Understand the Fund owner's data, analyze data integrity, and create foundational domain data model for consumption. Functional Documentation: Understand data consumption aspects by different personas, create detailed functional specifications for data consumption, use cases, and … development and IT teams. Testing and Quality Assurance: Develop test plans, conduct user acceptance testing (UAT), and collaborate with testing teams to ensure that data changes align with business needs and perform as expected. Change Management: Assist in developing change management strategies and training materials to ensure a smooth More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both technical teams … and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data governance, integrations, observability, DevOps, and … London-based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . Provide More ❯

responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm. We are seeking an experienced data engineer to shape and accelerate the delivery of target state … data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others. Your impact within our firm We are looking for a Data Engineer with expertise in Python development, who is passionate about cloud-based data engineering using AWS services and loves to build data solutions as part of a multi-disciplinary team. You would be working closely with digital product professionals, data scientists, cloud engineers and others. You More ❯

responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm. We are seeking an experienced data engineer to shape and accelerate the delivery of target state … data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others. Your impact within our firm We are looking for a Data Engineer with expertise in Python development, who is passionate about cloud-based data engineering using AWS services and loves to build data solutions as part of a multi-disciplinary team. You would be working closely with digital product professionals, data scientists, cloud engineers and others. You More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

Job Title: Data Integration Lead (London) Get The Future You Want! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and … us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as … the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. Ket Responsibilities Single point of contact from data platform for data ingestion. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Document data More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity that is … redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising data pipelines, virtualised environments, and … business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data infrastructure, ensuring scalability, reliability, and security. Define and More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity that is … redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising data pipelines, virtualised environments, and … business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data infrastructure, ensuring scalability, reliability, and security. Define and More ❯

into London should be possible for everyone in our team. The role We are looking for a Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle to … advance the Trudenty Trust Network. A bit more on what you'll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle Develop and maintain ETL processes for … data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced machine learning algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous model improvement and optimization Data More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations … FinTech and market data, with expertise around strategic cost and human resourcing benchmarking in wholesale finance. Founded in 2001 as an independent research boutique, Expand is a wholly owned subsidiary of the Boston Consulting Group, headquartered in London and with offices in Singapore and New York. At Expand we … entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not More ❯

to be the cornerstones of our organization and these values are upheld only because of our people. Role Essential Responsibilities Design and implement Azure data engineering solutions (Ingestion & Curation) Create and maintain Azure data solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. … Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Ensure data quality/security and compliance. Optimize Azure SQL databases for efficient query performance. Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data More ❯

build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have … culture and continuously invest in each individual. The Role Our Technology team is growing! We're looking for a highly skilled and experienced Lead Data Engineer to design and build a robust, scalable, and high-performance real-time data backbone. In this role you will take an individual … contributor position with leadership responsibilities focused on architecting, developing, and delivering real-time data pipelines and infrastructure. The ideal candidate will collaborate closely with engineering, product, and analytics teams to ensure seamless data flow across the organisation while leveraging cutting-edge technologies for real-time data processing. More ❯

Job title: GCP Data Analyst/SME Location: London Hybrid: thrice a week. Rate: £400 per day inside (IR 35) Duration of assignment: 6 months Start date: As soon as possible Role description: (Please include a brief outline of the impact this role will have, including an overview of … the customer industry and projects, access to cutting-edge technology, etc.) Experienced data analyst to analyse the existing Database or Data Warehouse jobs and work with a Data Modeller in designing the Data Products on GCP. Key responsibilities: Back trace the Database or Data Warehouse … STTM (Source-To-Target Mapping) sheets • Identify the source and downstream systems corresponding to system in scope of migration/re-imagination • Identify the data ingestion and data consumption patterns and define the target state requirements • Should help the Data Modeler in designing Enterprise Data More ❯

Job title: GCP Data Analyst/SME Location: London Hybrid: thrice a week. Rate: £400 per day inside (IR 35) Duration of assignment: 6 months Start date: As soon as possible Role description: (Please include a brief outline of the impact this role will have, including an overview of … the customer industry and projects, access to cutting-edge technology, etc.) Experienced data analyst to analyse the existing Database or Data Warehouse jobs and work with a Data Modeller in designing the Data Products on GCP. Key responsibilities: Back trace the Database or Data Warehouse … STTM (Source-To-Target Mapping) sheets • Identify the source and downstream systems corresponding to system in scope of migration/re-imagination • Identify the data ingestion and data consumption patterns and define the target state requirements • Should help the Data Modeler in designing Enterprise Data More ❯