26 to 50 of 385 Data Ingestion Jobs in England

Job Description Job Title: QA Tester – ETL Testing (Informatica) & Azure Data Engineering Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or Microsoft Fabric) and a strong understanding … of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL/data pipeline testing using … Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data reconciliation. Write and execute complex SQL queries to validate data transformations, aggregations, and business rules in Azure SQL Database and other relational platforms. Test data flows and integrations More ❯

Join to apply for the Azure Data Engineer - SC Cleared role at ShareForce . This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their … data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose solutions. Help clients realise the potential … of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences Design and develop end-to-end data solutions leveraging Azure services for batch, real More ❯

Job Description I'm looking for a hands-on, highly skilled Data Solutions Architect to join a global Data & AI Consultancy in London. You will split your time between the London office, your home and client site, depending on requirements. This exciting role is perfect for an experienced Data Engineer who's progressed to an architectural level … and is ready to lead the design and delivery of innovative data solutions for a diverse range of clients. In this role, you'll be responsible for guiding technical teams in the development of end-to-end data solutions that address complex business challenges, using both on-premises and cloud-based technologies (Azure, AWS, or GCP). You … ll design scalable data architectures, including data lakes, lakehouses, and warehouses, leveraging tools such as Databricks, Snowflake, and Azure Synapse. The ideal candidate will have a deep technical background in data engineering and a passion for leading the development of best-in-class data solutions. You'll enjoy providing strategic advice to clients, ensuring solutions are More ❯

Continue with Google Continue with Google Continue with Google Continue with Google Direct message the job poster from Mastek Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or … Microsoft Fabric) and a strong understanding of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL …/data pipeline testing using Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data reconciliation. Write and execute complex SQL queries to validate data transformations, aggregations, and business rules in Azure SQL Database and other relational platforms. More ❯

Greggs Newcastle Upon Tyne, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Azure Data Engineer role at Greggs Greggs Newcastle Upon Tyne, England, United Kingdom Join to apply for the Senior Azure Data Engineer role at Greggs This range is provided by Greggs. Your actual pay will be … based on your skills and experience — talk with your recruiter to learn more. Base pay range We have a fantastic opportunity to join the growing Data Platform team at Greggs as a Senior Azure Data Platform Engineer. You will be part of the team responsible for ensuring high quality data is sourced and curated in our Azure … cloud platform and to ensure that this is a foundation for growth for all data, analytic and AI services. Your involvement will span the entire data lifecycle: from orchestrating data ingestion into our Azure Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process More ❯

on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from La Fosse As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information … are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

technology enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the business. We … care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services that ingest data from … source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led by a product manager, an engineering manager More ❯

London – Senior Data Engineer, Consultant Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI-powered solutions. Since 2006, we’ve pioneered the use of AI and data science applied to unified marketing performance, measurement and holistic business optimization aligned with sustainability goals. Our goal: Combine high-impact AI and data science solutions for sustainable business performance. At Ekimetrics, we help companies seize their data opportunities by creating new data and analytics capabilities and deploying data science solutions that power-up their revenue strategy and improve their business operations. Key figures about Ekimetrics 400+ data science experts globally 1000+ diverse projects for more than 350+ clients … offices: Paris, Hong Kong, London, and New York UK data company of the year 2023 Voted Great Place to Work 2023 Microsoft’s sustainability partner Voted as a leader in “Marketing Measurement and Optimization” by Forrester wave 2023 About the Role We have an exciting opportunity for a Senior backend engineer to join our London team! You will be More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

and improving in everything they do. We support our clients with incubation services, offering ready-made capabilities supported by smart, execution-focused practitioners. The Role Are you passionate about data and transforming raw information into valuable insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. … This role suits someone who enjoys working with advanced technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're excited about unlocking the full potential of data for organizations, we want to hear from you. Proven experience in data engineering, with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with … Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming, especially for data manipulation and engineering. A genuine interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and More ❯

and innovating in everything they do. We support clients with incubation services, offering out-of-the-box capabilities backed by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role suits someone who enjoys working with advanced technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you are excited about helping organizations unlock their data's full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or … Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication More ❯

Job summary We are seeking 3 Data Engineers to join our defence & security client on a contract basis. Key skills required for this role DV cleared, Data Engineer, ETL, Elastic Stack, Apache NiFi Important DV Cleared - Data Engineer - ELK & NiFi - Outside IR35 Location: Worcester Duration: 6 months initial contract Security: Active DV clearance required In this role … you will help design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. These positions are onsite in Worcester and require active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack and Apache NiFi. Implement data ingestion, transformation … and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

Direct message the job poster from Selby Jennings Consultant | Data & Analytics | Selby Jennings Our client is redefining electronic trading by developing high-performance, AI-powered solutions that enable smarter, faster decision-making in dynamic markets. Our client is looking for a Senior Data Engineer to be a part of a forward-thinking team in London, working at the … intersection of AI and trading technology. You'll collaborate with leading researchers, data scientists, and engineers to build scalable data infrastructure that supports advanced analytics and machine learning. This is a greenfield opportunity with full ownership from design to deployment, allowing you to shape systems that directly impact trading and AI capabilities. In this role, you'll architect … and maintain robust data pipelines for ingesting, transforming, and storing large volumes of structured and unstructured data, including time-series datasets. You'll automate ETL processes, implement validation frameworks, and ensure high data quality and system reliability. You'll also support AI model development by optimising data retrieval, integrating scalable APIs, and working with vector databases More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

teammates who drive continual improvement and innovation, supporting clients towards self-sufficiency with out-of-the-box capabilities and expert practitioners. The Role Are you passionate about transforming raw data into meaningful insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role is ideal for … someone enthusiastic about working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're eager to help organizations unlock their data’s potential, we want to hear from you. Proven experience in data engineering, with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or … a strong willingness to learn. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science, with a desire to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities for a consultancy environment. Experience in data modeling More ❯

self-sufficiency and growth. We support our clients with incubation services and out-of-the-box capabilities, backed by smart, execution-focused practitioners. The Role Are you passionate about data and transforming raw information into insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role … is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you’re excited about unlocking data’s full potential for organizations, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with … Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities More ❯

improve and innovate in everything they do, helping clients become self-sufficient through out-of-the-box capabilities supported by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you’re excited about helping organizations unlock their data’s full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science with a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. More ❯

across the organization, continuously improving and innovating. We support client-side incubation with out-of-the-box capabilities, backed by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw information into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our … dynamic team. This role suits someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're excited about helping organizations unlock their data's full potential, we’d love to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory … or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … mentor, and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (eg, deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … and grow an AI/ML team as we scale beyond our seed round. Key Responsibilities 1. Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (eg, neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud … availability inference. 2. Strategic Leadership Develop a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. Identify and evaluate opportunities for AI-driven competitive advantages (eg, proprietary data, unique model architectures, transfer/few-shot learning). Collaborate with business stakeholders to translate big problems into technically feasible AI solutions. 3. Data & Infrastructure Oversee the creation More ❯

high-ambiguity environment. • Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). • Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. • Collaborate closely with product, design, and DevOps to integrate AI features into our platform. • Continuously evaluate new research, open-source tools … and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities 1. Architecture & Hands-On Development • Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. • Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. • Productionize models in cloud … availability inference. 2. Strategic Leadership • Develop a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. • Identify and evaluate opportunities for AI-driven competitive advantages (e.g., proprietary data, unique model architectures, transfer/few-shot learning). • Collaborate with business stakeholders to translate “big problems” into technically feasible AI solutions. 3. Data & Infrastructure • Oversee the creation More ❯