1 to 25 of 64 Data Ingestion Jobs in London

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion More ❯

Data Engineer - STR - London, UK Job Description OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights … our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. STR is the global leader in hospitality data benchmarking, analytics, and marketplace insights for the global hospitality industry. STR delivers data that is confidential, accurate, and actionable to empower our clients to strategize and compete in … their markets. Learn more about STR . ROLE DESCRIPTION The role of Data Engineer will be a key role within the STR Data Operations Team, reporting to the Director, Technical Data Operations. The Data Operations team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data More ❯

technology enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the business. We … care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services that ingest data from … source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led by a product manager, an engineering manager More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by … tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing More ❯

solutions through an agile framework. Our Technology team is responsible for: Software Development Infrastructure DevOps and Automation Service Delivery Project Management Brief Role Objective: As a member of the Data Development team, you will be responsible for developing ways to consolidate, analyse, and present our data to support the operations and future growth of our business. In this … role you will be involved in a wide variety of high-profile business facing initiatives from developing data extracts and PowerBI reports to optimising the data warehouse to deliver data more quickly to the business each day. You will work with the Lead Data Engineer and other members of the Data Engineering team to deliver … our new strategic enterprise data platform based on Snowflake and DBT, while also maintaining our legacy data platform. Key Responsibilities: Data warehouse design and implementation working towards the creation of a single source of truth. Development of data ingestion/transformation pipelines using Fivetran, DBT and Gitlab. Creation of management information dashboards. Work with business More ❯

Data Engineer - Integration Location: London-based (Hybrid - 1 day per week in the office) Contract: FTC - 23 months £56,500 per annum Overview: We are currently recruiting on behalf of a well-established nationwide charity for a Data Engineer - Integration . This is an exciting opportunity to play a key role in designing and developing data products … and services that improve how data is accessed and used across the organisation. You'll help ensure data is accurate, timely, and fit for purpose, supporting a wide range of departments and strategic goals. Role Summary: As a Data Engineer, you will work to connect systems, streamline business processes, and optimise data warehouse platforms. You'll … collaborate with stakeholders to deliver bespoke BI solutions, ranging from custom queries to dashboards and reports. Your work will transform raw data into actionable insights that drive the charity's mission forward.In addition to building and maintaining data integration pipelines, you'll help ensure the ongoing performance and reliability of the charity's core data platforms, which More ❯

Data Engineer London/Hybrid - Europe/Remote About Snowplow: Snowplow is the global leader in customer data infrastructure for AI, enabling every organization to transform raw behavioral data into governed, high-fidelity fuel for AI-powered applications-including advanced analytics, real-time personalization engines, and AI agents. Digital-first companies like Strava, HelloFresh, Auto Trader, Burberry … and DPG Media use Snowplow to collect and process event-level data in real time, delivering it securely to their warehouse, lake, or stream, and integrate deep customer context into their applications. Thousands of companies rely on Snowplow to uncover customer insights, predict customer behaviors, hyper-personalize customer experiences, and detect fraud in real time. The Opportunity: You'll … building Snowplow Signals - our new solution for enabling real-time, AI-powered customer experiences. Your work will contribute to the infrastructure that powers these capabilities, unlocking value from behavioral data in real time . Alongside this, you'll work on the foundational components that continue to make Snowplow powerful and flexible for data teams: developing and maintaining dbt More ❯

The banks' expertise and services span across Business Services, Corporate banking, Wealth Management, Group Functions, Retail and Investment Banking. On behalf of this organisation, AMS are looking for a Data Engineer for a 12 month contract based in London (hybrid -2 days in the office per week). Purpose of the role: The Data Engineer will help drive … the build of effortless, digital first customer experiences, simplifying the organisation by developing innovative data driven solutions through data pipelines, modelling and ETL design, inspiring to be commercially successful through insight and keep customers and the organisation's data safe and secure. What you'll do: Build advanced automation of data engineering pipelines through removal of … manual stages. Embed new data techniques through role modelling, training and experiment design oversight. Deliver a clear understanding of data platform costs to meet departments cost saving and income targets. Source new data using the most appropriate tooling for the situation. Develop solutions for streaming data ingestion and transformations in line with the client's More ❯

We are looking for a highly talented and driven Data Engineer who takes pride in their work, to expand our Engineering team in London. Successful candidates will join a cross functional team including product managers and designers working closely with the rest of our business to deliver working code that solves real problems for both internal and external customers. … services managed by your team, ensuring that their development aligns with the higher level AlphaSights Engineering strategy, while mentoring more junior Engineers. If you're passionate about solving complex data challenges with code, and enjoy collaborating with talented colleagues in a high-performance environment, this role is a perfect fit for you. What you'll do: Design solutions: Design … develop, deploy and support data infrastructure, pipelines and architectures, contributing to an architectural vision that will scale up to be the world's leading research platform. Ship working code: Write clean, efficient, and maintainable code that powers data pipelines, workflows, and data operations in a production environment. Implement reliable, scalable, and well-tested solutions to automate data More ❯

About the Role: Grade Level (for internal use): 11 About the Role: The Team: The Enterprise Marketing Analytics team empowers data-informed decision-making across S&P Global by delivering actionable insights on marketing performance. We focus on enterprise-level reporting across web, paid media, events, and campaign conversions-driving consistency, engagement, and ROI through advanced analytics. Our team … Analytics, Power BI, Marketo, Adobe Target, Drift, Conversica, ON24, Adobe CDP, and Salesforce. Impact: Reporting to the Director of Enterprise Marketing Analytics, this role leads marketing performance reporting and data visualization across the enterprise. You will define and manage scalable reporting processes, own the marketing data visualization strategy, ensure insights are accurate, accessible, and aligned to strategic priorities. … This role is essential in translating data into action, influencing decision-making, and fueling marketing effectiveness at scale. Responsibilities Enterprise Marketing Reporting & Visualization Own the marketing analytics dashboard strategy using Power BI or other tools ; oversee data ingestion, transformation, visualization, and automation to support self-service access. Lead Adobe Analytics Workspace reporting for engagement and conversion metrics More ❯

ll build analytics pipelines that help deliver actionable, automated user insights from product adoption data. You'll collaborate directly with product analysts, engineers, and business stakeholders to build robust data integrations, including Salesforce, Gainsight, JIRA and Github. Your work will be pivotal in empowering data-driven decisions across our organization, significantly impacting product strategy and customer engagement. What … to expect? Analytics Pipelines & Data Modeling: Convert existing product analyst queries and reports into efficient and maintainable analytics pipelines primarily using dbt, and optimize data for self-service analytics in Tableau. Owning Analytics Projects: Take ownership of medium-to-large analytics projects, from scoping through implementation. Product Event Data: Transform and maintain scalable product adoption datasets, ensuring … ease of downstream integration and rapid onboarding of new events or features. Data Egestion: Develop and manage data pipelines for exporting curated datasets from Redshift to platforms like Salesforce and Gainsight using reverse ETL tools (e.g., Hightouch). Data Ingestion: Own end-to-end responsibility for ingesting key productivity data from platforms such as GitHub More ❯

Senior Data Engineer MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Salary - £70-80k with 15% bonus Hybrid working - couple of days in the office City of London We are looking for: Good understanding of data engineering principles A good technical grasp of Snowflake and automating it, and transforming complex datasets SnowPro core certification. AWS Skillset Delivery experience Building … solutions in snowflake Insurance experience - advantageous but not necessary MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Key Responsibilities: Lead the design and implementation of Snowflake [and Redshift] based data warehousing solutions within an AWS environment Mentoring of team members through code reviews and pair programming Build and support new AWS native cloud data warehouse solutions Develop and optimize ETL … processes using AWS services (e.g. AWS Glue, Lambda) to ensure efficient data ingestion, transformation, storage, and cost optimization. Deliver data to presentation layers to power reporting and analytics Collaborate with stakeholders, product owners, and developers Create and maintain data models that serve as a foundation for reporting and analytics Monitor performance metrics and troubleshoot issues within More ❯

Senior Data Engineer - £82,000 - Hybrid & Remote Flexibility No Sponsorship Available Company We are a forward-thinking technology company dedicated to simplifying complex processes through innovative solutions. With a focus on enhancing efficiency and transparency, we strive to deliver outstanding experiences for our customers. Our team operates with a flexible hybrid working model, fostering collaboration and innovation in a … supportive environment. Responsibilities As a Senior Data Engineer, you'll play a pivotal role in advancing our data infrastructure to support our expanding scope and responsibilities. Key responsibilities include: Enhancing the reliability and stability of our data infrastructure. Managing data ingestion pipelines using tools such as Azure Data Factory (ADF) and Python. Ensuring the … quality of raw datasets to empower Data Analysts in creating robust data models. Deploying and managing data tools on Kubernetes (Airflow, Superset, RStudio Connect). Supporting Data Analytics through the management of DBT, DevOps, and deployment rules. You will have the opportunity to work end-to-end, making meaningful contributions within a small, agile team. Experience More ❯

Job Title: Data Engineer (NPPV3 + SC Clearance Required)Location: Hybrid (UK-based)Contract: 3 Months (with potential extension/move to other projects)Rate: £550 per day (Outside IR35)A bout the Role:We are seeking an experienced Data Engineer with NPPV3 + SC clearance to join our dynamic team on a 3-month contract basis. This … role offering the flexibility of working both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and … storage in cloud environments.* Troubleshoot and optimise data workflows for performance and reliability.* Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions. More ❯

About us: SynMax is a pioneering geospatial data analytics company built on the principle of "Why guess when you can know." We deliver AI-powered intelligence to maritime and energy sectors, transforming satellite imagery, AIS feeds, and market data into actionable insights through our platforms: Hyperion (energy intelligence), Theia (maritime domain awareness), Leviaton (LNG tracking), and Vulcan (power … monitoring).With offices in Houston and London, we're a diverse team of engineers, data scientists, intelligence analysts, and industry experts dedicated to bringing transparency to traditionally opaque industries. Job Summary: We're seeking a talented Machine Learning Software Engineer to join our growing engineering team and help build industry-disrupting analytics platforms. You'll work at the intersection … of machine learning, data engineering, and large-scale data processing, applying AI to diverse datasets to solve complex real-world problems in energy and maritime intelligence. This is an exceptional opportunity for someone who thrives in a dynamic startup environment and wants to grow their career alongside a rapidly expanding company. As we scale, you'll have the More ❯

a unified, trusted and sustainable value chain that enables the most efficient production and logistics outcomes, while lowering the impact on the environment. We deliver actionable digital solutions and data insights that connect global supply chains, improving the safety, quality and sustainability of food and consumer goods, all in a way that's traceable and clear to the end … right price, creating more sustainable production and consumption outcomes. As part of our Food, Beverage and Consumer Goods team, you'll help our customers connect business processes and leverage data-driven technology for better visibility, agility and responsiveness. The purpose of this role is to complete technical tasks as required in the delivery of client implementations of Trade Promotion … using SQL Server stack 2012 or above, Knowledge of SQL Server Suite, V12. • Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server • Kimball methodologies for Data Warehousing • Strong experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, • An analytical mindset, excellent communication and interpersonal skills More ❯

The Role: * Primary focus is utilizing your extensive insurance domain and data architecture experience, defining the target data architecture of Client strategic initiatives, stewardship of data solution designs, defining data domain strategic roadmaps reflected in their data lineage maps and defining data architecture policy and outcomes across the insurance value chain (eg Insurance, Pricing … Finance, HR, Data, Security, Infrastructure, etc.). In doing so, the enterprise data architect must: * Operating within Enterprise Architecture team, own and drive the data architecture strategy leading our transition to a data-driven, digitized underwriting and claims business. * Defining and evolving data architecture to support operational, analytical, and AI-driven initiatives. * Overseeing data governance and compliance, ensuring adherence to industry regulations and best practices for data management (including MDM), data sharing and data access. * Providing the designs of data ingestion, storage, and movement across operational systems, data lakes, AI and analytics platforms. * Collaborating with business and technology teams to align data strategies with company goals More ❯

Services AI Data Solution Principal (Services Technical PreSales), based LondonJob Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. This role requires strong technical expertise in AI and associated Data engineering and … Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while collaborating closely with Dell sales, delivery, product, and partner teams.This role carries sales pipeline joint-ownership within an aligned pod of professionals, quota-bearing objectives, and … s services portfolio, delivery capabilities, and financial objectives.Entrepreneurial focus to drive innovation, efficiency, process/IP improvement opportunities, coach and enable Dell sales and presales teams on AI/Data solution positioning, capabilities, and value articulation.Build and maintain a strong personal network across Dell's global sales, product, engineering, and partner ecosystem to effectively orchestrate deal success.Customer Engagement & Executive More ❯

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. This role requires strong technical expertise in AI and associated Data engineering … and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while collaborating closely with Dell sales, delivery, product, and partner teams. This role carries sales pipeline joint-ownership within an aligned pod of professionals, quota-bearing … services portfolio, delivery capabilities, and financial objectives. Entrepreneurial focus to drive innovation, efficiency, process/IP improvement opportunities, coach and enable Dell sales and presales teams on AI/Data solution positioning, capabilities, and value articulation. Build and maintain a strong personal network across Dell's global sales, product, engineering, and partner ecosystem to effectively orchestrate deal success. Customer More ❯