51 to 75 of 587 Data Ingestion Jobs in the UK

and innovating in everything they do. We support clients with incubation services, offering out-of-the-box capabilities backed by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role suits someone who enjoys working with advanced technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you are excited about helping organizations unlock their data's full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or … Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Role: Data Engineer Location: Belfast Duration: Long Term Contract Opportunity - Rolling Contract Rate: Market Rates - Inside IR35 Job Description : Fujitsu's Decision Intelligence practice in the UK helps organisations bridge the gap between data and insights, empowering businesses to make smarter decisions, optimise operations, and drive innovation. From AI-powered analytics to data governance and security, we … comprehensive suite of services to help our Public and Private Sector customers unlock the full potential of their data. Job Summary : We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies … Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services. Data Transformation and Cleaning: Transform and clean raw data to ensure data quality More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company's reporting and … analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. You’ll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear documentation. Collaborate with Power BI developers and business analysts More ❯

We are looking for an experienced Senior Data Engineer to join one of our client's team. Role and Responsibilities: Design, develop, and maintain scalable data pipelines using Python, PySpark and Databricks. Implement data orchestration workflows using Airflow or similar tools. Manage and optimize data storage solutions on Azure Cloud. Develop and maintain containerized microservices using … Docker. Collaborate with cross-functional teams to ensure data quality and integrity. Support the setup of blockchains. Build tools to acquire data from blockchains and perform analysis on the data using Databricks. Support production infrastructure, including monitoring and automation using tools like Datadog. Participate in agile development practices, contributing to planning exercises and working in cross-functional … groups. Skills and Qualifications: Bachelor's or Master's degree in Computer Science, Data Science, or a related field. Advanced Python knowledge for data processing and scripting. Proven experience with Spark and SQL for data engineering and analysis. Experience with data orchestration tools like Airflow. Hands-on experience with one or more cloud services (Azure, AWS More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

Job Summary Job Description What is the opportunity? We have an exciting opportunity for a Data Engineer to join the team in our London/Newcastle offices. The successful candidate will work closely with business and technology teams across Wealth Management Europe (WME) to support the ongoing maintenance and evolution of the Data Lakehouse platform, focusing on the … ingestion and modelling of new data, and the evolution of the platform itself utilising new technologies to improve performance and accuracy of the data. What will you do? Responsible for the development and ongoing maintenance of the Data Lakehouse platform infrastructure using the Microsoft Azure technology stack, including Databricks and Data Factory. Manage data pipelines … consisting of a series of stages through which data flows (for example, from data sources or endpoints of acquisition to integration to consumption for specific use cases). These data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases. Good understanding of SQL and PySpark to create new More ❯

Direct message the job poster from Selby Jennings Consultant | Data & Analytics | Selby Jennings Our client is redefining electronic trading by developing high-performance, AI-powered solutions that enable smarter, faster decision-making in dynamic markets. Our client is looking for a Senior Data Engineer to be a part of a forward-thinking team in London, working at the … intersection of AI and trading technology. You'll collaborate with leading researchers, data scientists, and engineers to build scalable data infrastructure that supports advanced analytics and machine learning. This is a greenfield opportunity with full ownership from design to deployment, allowing you to shape systems that directly impact trading and AI capabilities. In this role, you'll architect … and maintain robust data pipelines for ingesting, transforming, and storing large volumes of structured and unstructured data, including time-series datasets. You'll automate ETL processes, implement validation frameworks, and ensure high data quality and system reliability. You'll also support AI model development by optimising data retrieval, integrating scalable APIs, and working with vector databases More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

Data Analyst, Power BI | Investment Management - Trading Platform | London, Hybrid | up to £100k + Bonus, Benefits Data Analyst, Power BI | Investment Management - Trading Platform | London, Hybrid | up to £100k + Bonus, Benefits 2 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered … Google Continue with Google Direct message the job poster from VirtueTech Recruitment Group Senior Recruitment Consultant at VirtueTech Recruitment A leading global financial services firm is seeking a talented Data Analyst to join their enterprise Data team, with a specific focus on supporting the Compliance business stream. This role offers the chance to be at the forefront of … a data-driven transformation within a dynamic and rapidly growing organisation. The business provides market access, trading, and infrastructure services across major global markets, with a strong presence in commodities, energy, and financial products. The technology function is central to its operations, delivering innovative data solutions and infrastructure across global teams. This opportunity offers great career progression development More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

teammates who drive continual improvement and innovation, supporting clients towards self-sufficiency with out-of-the-box capabilities and expert practitioners. The Role Are you passionate about transforming raw data into meaningful insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role is ideal for … someone enthusiastic about working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're eager to help organizations unlock their data’s potential, we want to hear from you. Proven experience in data engineering, with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or … a strong willingness to learn. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science, with a desire to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities for a consultancy environment. Experience in data modeling More ❯

self-sufficiency and growth. We support our clients with incubation services and out-of-the-box capabilities, backed by smart, execution-focused practitioners. The Role Are you passionate about data and transforming raw information into insights? We seek a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our dynamic team. This role … is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you’re excited about unlocking data’s full potential for organizations, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with … Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a desire to expand skills into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication and teamwork abilities More ❯

improve and innovate in everything they do, helping clients become self-sufficient through out-of-the-box capabilities supported by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you’re excited about helping organizations unlock their data’s full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science with a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. More ❯

across the organization, continuously improving and innovating. We support client-side incubation with out-of-the-box capabilities, backed by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw information into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join our … dynamic team. This role suits someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you're excited about helping organizations unlock their data's full potential, we’d love to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory … or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science and a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. Excellent communication More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … mentor, and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯

of the top 10 Investment Banks, leading Asset Managers, Hedge Funds and Law Firms. The Opportunity The Analytics team is a critical engine driving 9fin's mission, and our data platform sits at its core. We are strong believers in building robust, reliable data foundations to empower data-driven decisions across the entire business. The Analytics Engineering … team is responsible for designing, building, and maintaining our central data warehouse, creating the foundational data models that underpin analytics, reporting, and operational excellence across various departments, including Product, Finance, Operations, and more. We are seeking a skilled Analytics Engineer to join us and elevate 9fin's data capabilities. In this role, you will focus on building … and optimizing the core data warehouse, ensuring data quality, accessibility, and performance for a wide range of internal stakeholders. You will be instrumental in creating a trusted and well-governed data environment that enables informed decision-making at all levels of the organization. This is an opportunity to shape the very foundation of how 9fin leverages data More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (eg, deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … and grow an AI/ML team as we scale beyond our seed round. Key Responsibilities 1. Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (eg, neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud … availability inference. 2. Strategic Leadership Develop a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. Identify and evaluate opportunities for AI-driven competitive advantages (eg, proprietary data, unique model architectures, transfer/few-shot learning). Collaborate with business stakeholders to translate big problems into technically feasible AI solutions. 3. Data & Infrastructure Oversee the creation More ❯

high-ambiguity environment. • Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). • Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. • Collaborate closely with product, design, and DevOps to integrate AI features into our platform. • Continuously evaluate new research, open-source tools … and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities 1. Architecture & Hands-On Development • Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. • Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. • Productionize models in cloud … availability inference. 2. Strategic Leadership • Develop a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. • Identify and evaluate opportunities for AI-driven competitive advantages (e.g., proprietary data, unique model architectures, transfer/few-shot learning). • Collaborate with business stakeholders to translate “big problems” into technically feasible AI solutions. 3. Data & Infrastructure • Oversee the creation More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

among the first 25 applicants Direct message the job poster from Methods Location: London, hybrid working. Can be onsite one day a week Methods are seeking a SC cleared Data Engineer in London, responsible for designing, building, and maintaining scalable data pipelines and infrastructure. The ideal candidate will have expertise in Microsoft Fabric, Azure, Python, and C#. Key … Responsibilities: - Design, develop, and optimize data pipelines using Microsoft Fabric and Azure services (eg, Azure Data Factory, Azure Synapse Analytics, Azure Databricks). - Build and maintain scalable, high-performance data architectures to support analytics, reporting, and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. … Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security, and compliance with organizational and regulatory standards. - Monitor and troubleshoot data pipelines, optimizing for performance and cost-efficiency. Key Skills: - Proficiency in Microsoft Fabric More ❯

Social network you want to login/join with: We are on the lookout for a Data Engineer to join a dynamic, forward-thinking company. You’ll will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. The ultimate goal is … to make data accessible so that stakeholders can use it to evaluate and optimise their performance. What you’ll be responsible for: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. … Be an architect making strategic decisions. Partly responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing More ❯