1 to 25 of 132 Data Ingestion Jobs in England

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career … within the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a More ❯

Data Engineer - STR - London, UK Job Description OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights … our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. STR is the global leader in hospitality data benchmarking, analytics, and marketplace insights for the global hospitality industry. STR delivers data that is confidential, accurate, and actionable to empower our clients to strategize and compete in … their markets. Learn more about STR . ROLE DESCRIPTION The role of Data Engineer will be a key role within the STR Data Operations Team, reporting to the Director, Technical Data Operations. The Data Operations team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data More ❯

and throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Bring Join a dynamic team transforming our organization into a data-driven enterprise! The Data Layer Team is where we build essential data connectors, data pipelines, and capabilities to empower our clients and colleagues with high-quality … and reusable data. Our Data Layer Team focuses on creating scalable data solutions and advancing our data infrastructure that are the foundation of AI products that will drive informed decision-making across the company. As the Data Layer Connectors & Ingestion Delivery Owner, you will oversee data engineering practices, data connectors, integrations, while driving … continuous improvement, and ensuring alignment with data governance, security, and compliance standards. You will lead the Platform Build & Connectors squad compose of data engineers, architects, and you will closely collaborate with cross-functional teams to ensure timely delivery and operational excellence. Your responsibilities include defining the data layer technology ecosystem, supporting BCG's data strategy. You More ❯

Overview We are looking for a data engineer experienced in DevOps-based pipeline delivery, who can not only develop the pipeline but also establish the foundational framework for reusable data ingestion processes. The ideal candidate is proactive, a self-starter, and demonstrates a strong can-do attitude. While not essential, experience with Health Data systems would … be highly advantageous. Responsibilities Ingestion Framework Delivery: Responsible for building reusable metadata driven data pipelines within a framework to handle batch and near-real-time data feeds. Data Pipeline Development: Develop end-to-end data pipelines, including data load patterns, error handling, automation, and hardware optimisation. Requirements Formulation: Collaborate with Business Analysts, Architects, SMEs … teams to define requirements and implement solutions using modern EDW cloud tools and best practices. Detailed Solution Design: Work with architects and analysts to create detailed solution designs for data pipelines, ensuring adherence to policies, rules, and standards. Promote DevOps best practices for iterative solution delivery including CI/CD, version control, monitoring and alerting, automated testing and IaC. More ❯

Decision Intelligence in making their decisions. This leads to better business decisions with improved accuracy, reduced errors, and better outcomes across various aspects of the business. Team Description: The Data Ingestion and Pipelines (DIP) team is responsible for designing, building, and optimizing scalable data systems that integrate and process data from a variety of sources. We … develop efficient data pipelines that ensure seamless data flow into our data lake and transform it to support business intelligence and machine learning applications. Our work spans the entire data lifecycle; from ingesting data from clients, to developing complex ETL processes, to building systems for scraping external datasets (e.g., traffic, weather, points of interest, etc. … . The team is dedicated to delivering high-performance, reliable infrastructure that enables data-driven decision-making across the organization. Job Summary: The Data Ingestion and Pipelines (DIP) team is seeking a highly skilled Software Engineer. The ideal candidate will have a strong background in software development with a focus on building and optimizing data pipelines More ❯

leading global advisory, broking, and solutions company. We work with clients across a wide range of industries, helping them manage risk, optimise benefits, and improve performance. As a Fabric Data Engineer, you will play a key role in leveraging Microsoft Fabric, Azure, and Python to design and build advanced data solutions in the insurance domain. Location: London, UK … Role: Hybrid Workstyle (Full-time) Role Overview: As a Fabric Data Engineer at WTW, you will take ownership of developing and optimising data pipelines, workflows, and ETL processes. You will work with cutting-edge technologies to ensure that data is efficiently processed, stored, and made accessible for analysis. This role is a key part of our data engineering team and requires specific expertise in Microsoft Fabric, Azure, and Python. Key Responsibilities: Fabric or Azure Data Engineer (Non-Negotiable): Lead the design and development of scalable data pipelines and ETL processes using Microsoft Fabric or Azure technologies. Manage and optimise notebooks, pipelines, and workflows to enhance the performance and efficiency of our data architecture. More ❯

Kingdom Hull, Yorkshire, United Kingdom Leeds, Yorkshire, United Kingdom Milton Keynes, Buckinghamshire, United Kingdom Newcastle upon Tyne, Tyne and Wear, United Kingdom Eastleigh, Southampton, United Kingdom Birmingham, United Kingdom Data Ingestion Manager We are seeking an experienced Data Ingestion Manager to join our team. In this role, you will manage the daily operations of our data ingestion function, oversee client data extraction and standardization, and ensure consistent service delivery across RSM. Your efforts will support our digital transformation, enabling teams to focus on delivering insights and value to clients. Key Responsibilities: Manage the data ingestion team's daily workflows and resources. Coordinate with teams and clients to gather requirements and resolve … data issues. Train and develop team members' technical skills. Troubleshoot complex data problems from various accounting systems. Identify and implement efficiency improvements. Ideal Candidate Profile: Experience in data ingestion from ERP systems, preferably in professional services. Proficiency with Alteryx or similar data processing tools. Leadership experience with staff development. Strong project management and client communication More ❯

Senior Data Engineer We are seeking a highly skilled Data Engineer to focus on maintaining data streams and ETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow … across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data solutions. You will play a critical role in understanding the business context of data, supporting analytics and decision … making by collaborating with data scientists, analysts, and other key stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable data pipelines using best-fit technologies. What's in … it for you? - Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering. - Greenfield deployment -- minimal legacy constraints, just innovation. - Critical role -- influence architecture, tooling, and best practices from day one. - Technology-first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be doing - Designing and implementing … high-performance data pipelines for real time and batch processing. - Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools. - Collaborating with cross-functional teams to drive data strategy and governance.- Optimising performance, ensuring scalability, security, and reliability. What we're looking for - Proven experience in data modelling and data More ❯

Move to Skip to Content Link Select how often (in days) to receive an alert: Date: 2 Aug 2025 Company: Royal London Group Job Title: Lead Software Engineer (Azure Data) Contract Type: Permanent Working style: Hybrid 50% home/office based Closing date: 15th August 2025 We are seeking a highly skilled and experienced Lead Software Engineer (Azure Data … our applications and will provide a blend of both solid leadership experience and technical expertise. This role is focussed within the Engagement Services platform with a focus on Azure Data and contributes to our purpose of strengthening the mutual choice for our customers, by providing the best technology solutions to our customers. About the role Design, develop, and maintain … ETL/ELT data pipelines using Azure Data Factory (ADF) for automating data ingestion, transformation, and orchestration from diverse data sources. Build scalable data integration processes to bring in data from on-premises , cloud , and external APIs into Azure Data Lake Storage (ADLS). Data Transformation & Modeling : Utilize Azure data More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by … tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. This role requires strong technical expertise in AI and associated Data engineering … and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while collaborating closely with Dell sales, delivery, product, and partner teams. This role carries sales pipeline joint-ownership within an aligned pod of professionals, quota-bearing … services portfolio, delivery capabilities, and financial objectives. Entrepreneurial focus to drive innovation, efficiency, process/IP improvement opportunities, coach and enable Dell sales and presales teams on AI/Data solution positioning, capabilities, and value articulation. Build and maintain a strong personal network across Dell's global sales, product, engineering, and partner ecosystem to effectively orchestrate deal success. Customer More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Risk Reporting Data Engineering Lead Central London/Hybrid Financial Risk Data/Data Analytics/International Banking Base salary: c. £135k + bonus + comprehensive bens. As a tech recruitment partner for this international bank, we're assisting in hiring a Technical Lead for the Risk Reporting team, which involves designing technologies for data warehousing … mining, BI, and reporting. Are You Ready to Lead in a Fast-Paced, Global Environment? The client seeks a Data & Analytics Engineering Lead to head an international team (10-15 members), driving innovation in Risk Reporting. As the organisation evolves with regulations and tech, they need someone with strong technical leadership, a passion for data, and a drive … Main Purpose Lead and develop a high-performing team of 10-15 Engineers delivering robust, scalable risk reporting solutions globally. Key Responsibilities Mentor an international team focused on risk data ingestion, transformation, and reporting. Act as SME in database and reporting solutions, working with Risk stakeholders to meet business needs. Design innovative, fault-tolerant systems for large-scale More ❯

Risk Reporting Data Engineering Lead Central London/Hybrid Financial Risk Data/Data Analytics/International Banking Base salary: c. £135k + bonus + comprehensive bens. As a tech recruitment partner for this international bank, we're assisting in hiring a Technical Lead for the Risk Reporting team, which involves designing technologies for data warehousing … mining, BI, and reporting. Are You Ready to Lead in a Fast-Paced, Global Environment? The client seeks a Data & Analytics Engineering Lead to head an international team (10-15 members), driving innovation in Risk Reporting. As the organisation evolves with regulations and tech, they need someone with strong technical leadership, a passion for data, and a drive … Main Purpose Lead and develop a high-performing team of 10-15 Engineers delivering robust, scalable risk reporting solutions globally. Key Responsibilities Mentor an international team focused on risk data ingestion, transformation, and reporting. Act as SME in database and reporting solutions, working with Risk stakeholders to meet business needs. Design innovative, fault-tolerant systems for large-scale More ❯

positively impact the world around us. Your role and responsibilities We are seeking talented individuals for Security Delivery Consultant , Automation (Application Integration & Runtime) Delivery Consultant and Delivery Consultant IBM Data Fabric Security Delivery Consultant Requirements Gathering : Collaborate with clients to gather business requirements, identify pain points, and define project scope. Solution Design : Design and architect security solutions as part … of the wider team, that meet client needs Implementation and Configuration : Help implement and configure Security solutions; including identify and access management, endpoint, mobile and data security Testing and Quality Assurance : Conduct thorough testing and quality assurance to ensure the solution meets client requirements and is free from defects. Training and Knowledge Transfer : Provide training and knowledge transfer to … Cloud Pak for Integration, IBM API Connect, IBM App Connect Enterprise, IBM webMethods family, IBM Event Automation, IBM DataPower Gateway Windows or Linux/Unix skills. Delivery Consultant, IBM Data Fabric Requirements Gathering : Collaborate with clients to gather business requirements, identify pain points, and define project scope. Implementation and Configuration : Help implement and configure Data Fabric solutions, including More ❯

public health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This role … offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health impact. Key Responsibilities: Ensure … data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and data sharing requirements Ensure efficient, performant More ❯

role if you are: A curious problem solver who challenges the status quo A collaborator who values teamwork and knowledge-sharing Excited by the intersection of technology, creativity and data Experienced in Agile methodologies and consulting (a plus) Role responsibilities Strategic Advisory & Client Engagement: C-Suite Consultation: Act as a primary point of contact and trusted advisor for C … analysis, and potential impact on customer lifetime value, operational efficiency, and revenue growth. Thought Leadership: Stay abreast of industry trends, emerging technologies, and best practices in martech, CX, and data governance, positioning yourself and the agency as thought leaders. Martech Platform & Ecosystem Expertise: Platform Evaluation & Selection: Lead the evaluation, selection, and recommendation of martech platforms (e.g., CDPs, Marketing Automation … CRM, DMPs, Analytics, Personalization Engines, CMS) based on client needs, budget, and strategic objectives. Architecture Design: Advise on optimal martech architecture, ensuring seamless integration between platforms, data flow, and scalability. Data Strategy & Governance: Develop and advise on robust data strategies, including data schemas, data ingestion, data quality, privacy, security (GDPR, CCPA, etc.), and More ❯

solutions through an agile framework. Our Technology team is responsible for: Software Development Infrastructure DevOps and Automation Service Delivery Project Management Brief Role Objective: As a member of the Data Development team, you will be responsible for developing ways to consolidate, analyse, and present our data to support the operations and future growth of our business. In this … role you will be involved in a wide variety of high-profile business facing initiatives from developing data extracts and PowerBI reports to optimising the data warehouse to deliver data more quickly to the business each day. You will work with the Lead Data Engineer and other members of the Data Engineering team to deliver … our new strategic enterprise data platform based on Snowflake and DBT, while also maintaining our legacy data platform. Key Responsibilities: Data warehouse design and implementation working towards the creation of a single source of truth. Development of data ingestion/transformation pipelines using Fivetran, DBT and Gitlab. Creation of management information dashboards. Work with business More ❯

career progression, sustainability, or volunteering, you'll find like-minded people driving change at Howden. Role: Quality Assurance Engineer Objective: Ensure the quality, reliability, and governance of the Group Data Platform , covering data engineering, platform engineering, and data governance processes . Summary of the Role Howden Group Services is expanding its Group Data Platform and seeks … a Quality Assurance Engineer to test, validate, and improve data pipelines, infrastructure, and governance processes. The ideal candidate will have experience in data testing, automation frameworks, and cloud-based data platforms , ensuring high-quality standards for data pipelines, storage, and platform components . This role requires a detail-oriented professional with a strong technical background in … data assurance and test automation . You will work alongside data engineers, platform engineers, and governance teams to ensure data accuracy, reliability, and compliance . Responsibilities Support the execution of the quality assurance strategy for the Group Data Platform , ensuring the reliability of data pipelines, infrastructure, and governance processes . Develop and execute test cases More ❯

Engineering: Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … work towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide alerting, monitoring More ❯

Lead Data Engineer (AWS Snowflake Python) London/WFH to £110k Are you a technologist Data Engineer with strong technical leadership skills? You could be progressing your career in an impactful, hands-on Lead Data Engineer role at a growing technology company as they expand their UK presence. As a Lead Data Engineer you'll take … code quality and test coverage. You'll plan and manage the team's Sprints, collaborating closely with product and engineering management to deliver solutions across a range of complex data sources and data integrations, including Data Warehouses/Data Lakes, Data Marts, data ingestion and record matching and merging. Location/WFH: You … be able to work from home most of the time, meeting up with colleagues in the London office once or twice a week. About you: You're an experienced Data Engineer with advanced AWS and Snowflake experience You have strong experience of building Data Lakes, Data Warehouse and/or Data Marts You have experience of More ❯

Team: Kore Intelligence Platform engineering Two Circles is a leading data-driven sports agency helping rights holders build stronger, more valuable relationships with their audiences. We blend sports expertise, data science, and technology to help sports organisations grow direct relationships with their fans, increase revenue, and enhance their partner propositions. With a passionate, high-performing team of … Role Overview We're looking for a Technical Product Manager to work on the KORE Intelligence platform. You'll be joining a team responsible for a core suite of data products that transforms fragmented fan data into meaningful, actionable insights. You'll take ownership of backend-heavy capabilities that allow our clients to unify, understand, and activate their … audience data . This includes managing data ingestion frameworks, segmentation infrastructure, and the tooling used by internal teams to deliver commercial outcomes at scale. You'll work closely with external vendors, internal engineering and data teams, and cross-functional stakeholders to to build secure, scalable, and highly performant systems that support campaigns, personalization, reporting, and partner More ❯