1 to 25 of 42 Permanent Data Ingestion Jobs in the UK excluding London

Job summary Are you looking for a pivotal role, where you can leverage your extensive experience in data engineering and architecture to design and implement robust data solutions that drive business insights and decision-making? We are looking for a Principal Data Engineer to lead a growing team and to own and help deliver our Digital and … Data strategy. Your leadership will be instrumental in setting technical direction and mentoring engineers to optimize our data pipelines and infrastructure. You will collaboratively develop and maintain data models, architecture, and integration strategies so that the organisation can use its data well and safely. You are equally as comfortable in your expert role, designing and delivering … solutions, as you are engaging with business owners and teasing out their user needs, building relationships with other DDaT professions and coaching less experienced data engineers. Main duties of the job You'll be leading the work to design and populate the data architecture for our local cloud environment, ensuring that our future data services can be More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable data pipelines using best-fit technologies. What's in … it for you? - Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering. - Greenfield deployment -- minimal legacy constraints, just innovation. - Critical role -- influence architecture, tooling, and best practices from day one. - Technology-first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be doing - Designing and implementing … high-performance data pipelines for real time and batch processing. - Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools. - Collaborating with cross-functional teams to drive data strategy and governance.- Optimising performance, ensuring scalability, security, and reliability. What we're looking for - Proven experience in data modelling and data More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Risk Reporting Data Engineering Lead Central London/Hybrid Financial Risk Data/Data Analytics/International Banking Base salary: c. £135k + bonus + comprehensive bens. As a tech recruitment partner for this international bank, we're assisting in hiring a Technical Lead for the Risk Reporting team, which involves designing technologies for data warehousing … mining, BI, and reporting. Are You Ready to Lead in a Fast-Paced, Global Environment? The client seeks a Data & Analytics Engineering Lead to head an international team (10-15 members), driving innovation in Risk Reporting. As the organisation evolves with regulations and tech, they need someone with strong technical leadership, a passion for data, and a drive … Main Purpose Lead and develop a high-performing team of 10-15 Engineers delivering robust, scalable risk reporting solutions globally. Key Responsibilities Mentor an international team focused on risk data ingestion, transformation, and reporting. Act as SME in database and reporting solutions, working with Risk stakeholders to meet business needs. Design innovative, fault-tolerant systems for large-scale More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company's reporting and … analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. You'll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear documentation. Collaborate with Power BI developers and business analysts More ❯

Engineering: Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … work towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide alerting, monitoring More ❯

Data Scientist or Junior Data Scientist - Hybrid (Bristol-based 2-3 days a week) Insurance £40,000 - £45,000 (up to £50,000 for exceptional candidates) Strong skills in Python & Pandas with at least 2 years experience in a commercial Data Driven role Are you passionate about data and ready to make a real impact in … world of cyber risk? We're working with a forward-thinking company that's pioneering cyber risk using advanced stochastic techniques, and they're on the lookout for a Data Scientist or Junior Data Scientist to join their growing team. This is a brilliant opportunity for someone with a sharp analytical mind and solid Python skills, who enjoys … building efficient data pipelines and uncovering insights from complex datasets. The Role You'll play a key role in cleaning, enriching, and preparing insurance portfolio data that feeds into cutting-edge risk models. From day one, you'll work closely with modellers, data scientists, and engineering experts to ensure high data quality and process efficiency. The More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Bristol or Manchester … What you'll be doing Developing and maintaining Data Pipelines for extraction, transformation and loading processes Assembling large, complex data sets that meet user and business requirements Collaborating with data scientists and intelligence analysts, to support and deliver against their requirements Identifying and implementing process improvements to enhance data delivery and scalability Build and maintain collaboration More ❯

Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the … data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement … processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data, Databricks and dbt Manage and optimize data storage solutions such as Amazon S3, Redshift, RDS, and DynamoDB. Implement and manage infrastructure-as-code (IaC) using tools like Terraform or AWS CloudFormation. Monitor and optimize More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing … and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion … transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Platform More ❯

Data Engineer – Financial Services | Strong Kafka/Streaming Focus- Liverpool/Hybrid – Up to £75K (DOE) Our client, an innovative and rapidly expanding Financial Services organization, is seeking a Data Engineer to join their highly technical data team. This is a unique opportunity to be part of a forward-thinking company where data is central to … strategic decision-making. We’re looking for someone who brings hands-on experience in streaming data architectures, particularly with Apache Kafka and Confluent Cloud, and is eager to shape the future of scalable, real-time data pipelines. You’ll work closely with both the core Data Engineering team and the Data Science function, bridging the gap … between model development and production-grade data infrastructure. What You’ll Do: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Confluent Cloud. Architect and implement robust, scalable data ingestion frameworks for batch and streaming use cases. Collaborate with stakeholders to deliver high-quality, reliable datasets to live analytical platforms and machine More ❯

Data Scientist - Hybrid (Bristol-based) £40,000 - £45,000 (up to £50,000 for exceptional candidates) Hybrid Working | Python & Pandas Are you passionate about data and ready to make a real impact in the world of cyber risk? We're working with a forward-thinking company that's pioneering cyber risk modelling using advanced stochastic techniques, and they … re on the lookout for a skilled Data Scientist to join their growing team. This is a brilliant opportunity for someone with a sharp analytical mind and solid Python skills, who enjoys building efficient data pipelines and uncovering insights from complex datasets. The Role You'll play a key role in cleaning, enriching, and preparing insurance portfolio data that feeds into cutting-edge risk models. From day one, you'll work closely with modellers, data scientists, and engineering experts to ensure high data quality and process efficiency. The work you do will directly influence insights into cyber exposure and risk trends. Key Responsibilities Clean, validate, and standardise large insurance datasets using Python (especially Pandas) Develop More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent to … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

Head of Data Engineering Up to £130,000 + 40% Bonus Kent - Hybrid Looking for your next big leadership move in data? I'm hiring for a Head of Data Engineering at a top-tier financial services group that's serious about becoming a data-first organisation. This is a high-impact leadership role with full … ownership of data engineering strategy, delivery, team building, and technical direction. You'll be leading the evolution of a world-class data function-building scalable ETL pipelines, shaping cloud-first architectures, and ensuring data quality and governance are at the core of everything the business delivers. Why This Role Stands Out Salary up to £130,000 + … bonus Flexible/remote-first culture (UK-based) Strategic visibility-reporting directly to the Chief Data Officer Autonomy to build and shape a modern data engineering function from the ground up Strong backing from senior leadership for data transformation across the business The Role You'll be responsible for leading and growing a high-performing team of More ❯

Insight Investment are looking for a are looking for a Data Platform Architect to join our growing team building our strategic data platform as we look to adopt best in class data governance and democratise data around the business. The successful candidate will play a pivotal role in shaping and executing our data strategy, leveraging … our data assets to the full, elevating our decision-making, streamlining processes, and drive innovation within our organisation. You will be part of the long-standing Data Platform team using an Agile approach to deliver solutions on top of our Cloud Platform, starting with snowflake as a foundational component we will look to integrate other technologies and grow … a learning culture, providing opportunities for growth and innovation while maintaining high standards of professionalism and integrity. Role Responsibilities Define and evolve the architectural vision for the Snowflake centric Data Platform, ensuring scalability, resilience, and alignment with enterprise data strategy. Oversee and manage the integration of Snowflake with a cloud platform. This includes using various available services or More ❯

Data Engineer: Migrations Salary: competitive depending upon experience + benefits Where the job is based: (home-based, working with Kerv office/customer site visits as required) UK HQ, Seven House, 18 High Street, Longbridge, B31 2UQ Who we are: Dive into a world where technology meets innovation. At Kerv Digital, we're not just another tech company. We … re the problem solvers, the magicians who transform complex challenges into seamless digital experiences. Utilising a powerful blend of Power Platform, DevSecOps, Data experiences, and Software Engineering, we create business solutions that truly resonate with our clients driving extreme value! With our roots planted in Birmingham and branches spreading across the globe from London to Bangalore, we're a … with a global multi-discipline team and be guided by the industry's most forward-thinking architects. Who we are looking for: You are excited by helping customers with data plumbing problems, getting from A to B; but still an engineer at heart, working to best practise in-mind. You learn fast and love to build. Cloud experience is More ❯