26 to 50 of 206 Data Ingestion Jobs in the UK

such as Mulesoft Expertise in Integration patterns involving files(using FTP, SFTP, MoveIT), MQ, CDC, Message Bus, Hub & Spoke, Pub/Sub Experience in implementation of Security standards for Data in Transit & Rest such as TLS/SSL, Data Encryption Knowledge in MQ & AMQ concepts such as RabbitMQ & Oracle MQ Expertise Knowledge in Data Management workflow & integration … such as Data Lake, ETL , Data Ingestion, Sharding, Data Stream, Data Catalogue, Data Cleansing, Data Analytics, Batch, Scheduling Implementation knowledge on principles such as ACID, SOLID, OWASP Knowledge on UK GDPR, PII, PCI-DSS data standards Implementation of designs related to Batch processing patterns involving Talend, Databricks, Snowflake or similar Experience of … running GDPR related projects involving Data Sourcing, Validations, Integration, Data Disposition, Auditing & Reporting Ability to treat Data as an Asset and Architect & provide Solutions aligned to it • Strong working knowledge in Java 8+ with Clean Architecture, Mockito, Java Spring, Spring Boot, Spring Batch, Apache Camel needs to possess an expert depth and breadth of knowledge regarding multiple More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they’re able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You’ll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

Job Title: Data Quality Analyst Location: London (2 days per week on-site at Liverpool Street) Contract: 6 months (via umbrella) Rate: Competitive Are you passionate about driving data accuracy and integrity in a fast-paced financial services environment? This is a fantastic opportunity to join a leading international bank at the forefront of data-led transformation. … You'll be part of a growing Data Office that is shaping strategy, governance, and innovation across EMEA - making a real impact from day one. The Role As a Data Quality Analyst, you will play a pivotal role in ensuring the accuracy, completeness, and integrity of data across AML and Sanctions screening platforms. You will work closely … with Financial Crime, Data Governance, Technology, and Risk teams to design and embed effective data quality controls, strengthen governance, and support regulatory compliance. This role offers the chance to directly contribute to critical transformation programmes within financial crime compliance. Key Responsibilities Design, build, and monitor Data Quality Rules within Collibra Data Quality (CDQ) for AML and More ❯

Data Engineer - Azure Databricks , Apache Kafka Permanent Basingstoke (Hybrid - x2 PW) Circa £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern … tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want … to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

the private and public sectors. Driven by innovation and quality, they combine strategic thinking with deep technical capability to deliver transformational technology solutions. How youll spend your day Building data pipelines using Azure data factory for data ingestion Looking after the data integration, data conformity, data integrity and ensure the data structures … are designed for future business needs and enhancements Ensure that data transformations are well recorded and follow best practices so that it is easily understood by developers and analysts Work directly with the business to support various projects and solutions Using problem solving skills as challenges arise Process mining to scope and deliver solutions that meet agreed User Stories … clients and with strong communication skills Strong business-to-technology translation skills for identifying ways to apply solutions to help customers improve performance Strong verbal and written communication Azure Data Factory/Data Lakes/Databricks SQL server experience (SSIS, SSMS) Experience with Data Warehouse solutions Desirable but not essential Python is also desirable Understanding of Azure More ❯

Data Analytics Engineer Permanent Basingstoke (Hybrid - x2 PW) Up to £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern tools such … as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make … a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality data More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯