1 to 25 of 53 Data Ingestion Jobs in the UK excluding London

Job title: Lead Data Engineer Client: Hyper Scaling AI/FinTech Startup Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead … Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you … will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data more »

are high-performing and scalable Leverage Azure services to create and manage cloud-based applications (SQL DB, App Services, Azure FrontDoor, SignalR) Create efficient data ingestion and indexing pipelines using Elasticsearch Design, develop, and maintain efficient, reusable, and reliable C# code Implement necessary infrastructural changes for successful application more »

Job title: Data Engineer Client: Elite Quantitative Trading Firm Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL … processes from a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly tech driven fintech, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where … you will work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and maintain real-time data processing systems. Keep more »

driving the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our journey towards … becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what really matters for the decision more »

BI Developer/Data Engineer required for a Global Software provider, offering cloud based solutions. Joining a Data Warehouse (DW) and Business Intelligence (BI) team to support a range of growth. The role will be to support the BAU activities which includes the ingestion of multiple data sources to the main DW and the preparation of datasets for reporting requests. Primary types of data will be financial, CRM, telephony & support desk, with others as the need arises. The work is diverse, every report is different, every acquisition uses different source systems with different processes & terminologies. … Resulting in a need to be creative, inventive and reactive to how different data sources are managed and prepared etc. Main Responsibilities Data ingestion from multiple sources. Excel/FlatFile (csv/txt) Web (JSON/XML) SQL Databases Direct Integrations Support testing of existing & new dataset more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. About you We … know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing data streams into actionable … use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms and see the value in transforming data into insights. You more »

is a prominent player within the Lloyd’s (Insurance) Market Syndicate, embarking on a complex transformation and distribution programme they are looking for a Data Architect to play an integral role in data architecture, integration/data life cycle management. You must have experience in: · Knowledge of … Data and Cloud platform technologies utilised by the Lloyd’s (Insurance) Market. · Proven track record of successful delivery of greenfield data initiatives. · Substantial experience of designing and optimising data models using cloud technologies. · Proven track record of successful delivery of MS Azure cloud technology initiatives. Knowledge in … Blueprint Two (B2P). Strong experience in data modelling, data ingestion and data governance (BI) · Gravitas and presence to provide confidence to key insurance business and technology stakeholders. · Excellent communicator, both written and verbally. · Strong organisation skills. · Experience in greenfield warehouse projects. more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure … Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

framework. Core java and Spring framework hands on experience is must. Strong understanding of database design and feature engineering to support huge volume of data on premises and external cloud. Should have an experience as “Data and Cloud Architect”. Should be able to design the large-scale … cloud native applications. Must have got hands on experience in Google Cloud. Setup reliable data ingestion pipelines for new data sources and integrate them effectively with existing data sets. Hands on experience in at least one programming language. Writing POCs and defining strategic platforms for “Future … experience in Spring framework Working experience in Google Cloud tools. Like for example – Looker Studio Experience in performance optimizations of applications which processes large data (TB scale more »

their field for over two decades. Building upon their continued success, they are launching the search for an Analytics Engineer within a 10-strong Data team to help support the development of their BI reporting and Data Platform. This will be a business-facing role, with a …/50 split between BI reporting/analysis and data ingestion, and would suit someone with a couple years experience across Python , ETL, AWS and any BI tool (PowerBI, Tableau, Qlik, QuickSight, or GoodData - it's more about the transferable skills!). This is an ideal role for more »

re proud to be one of the largest personal insurers in the UK. Role Description We have a fantastic opportunity for a Senior Geospatial Data Scientist to join our fast Growing and hugely successful Data Science team, made up of over 50 talented and diverse Data Engineers … striving to work with the best talent and technologies in order to stay at the forefront to beat the best. As a Senior Geospatial Data Scientist, you will lead the development of geospatial solutions to solve complex problems across business functions, leveraging your expertise in geospatial data analysis … geospatial datasets. Develop predictive machine learning models, evaluate model performance, iterate model improvements to enhance accuracy. Assist in the design and implementation of scalable data processing pipelines for geospatial data ingestion, processing & storage. Stay up to date with the latest advancements in geospatial analytics, machine learning & data more »

re proud to be one of the largest personal insurers in the UK. Role Description We have a fantastic opportunity for a Senior Geospatial Data Scientist to join our fast Growing and hugely successful Data Science team, made up of over 50 talented and diverse Data Engineers … striving to work with the best talent and technologies in order to stay at the forefront to beat the best. As a Senior Geospatial Data Scientist, you will lead the development of geospatial solutions to solve complex problems across business functions, leveraging your expertise in geospatial data analysis … geospatial datasets. Develop predictive machine learning models, evaluate model performance, iterate model improvements to enhance accuracy. Assist in the design and implementation of scalable data processing pipelines for geospatial data ingestion, processing & storage. Stay up to date with the latest advancements in geospatial analytics, machine learning & data more »

Principal Data Engineer - Northwest £70,000 to £75,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team across … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect, as it more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

and support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … focus will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Team Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure and more »

Mid-Level and Senior Data Scientist Roles - Hybrid/Bristol Location: Hybrid/Bristol - 2 days in office per week min. About Our Client: Our client is a leading organisation in the risk industry, specialising in cyber risk assessment and management. They are at the forefront of innovation, using … test. With unique perks like dog-friendly offices, team meals and enrichment days, their team thrives on a cooperative and inventive spirit. Mid-Level Data Scientist: Location: Hybrid/Bristol Salary: £50,000 - £60,000 per annum Contract Type: Permanent Key Responsibilities: Seeking an Engineer with a curious mindset … and an understanding of bespoke data transformation, without the need for the crutch of Cloud Platforms at all times… Develop, enhance, and manage intricate data ingestion pipelines. Integrate advanced machine learning elements into data pipelines. Implement data quality metrics and dashboards for monitoring. Collaborate with more »

benefits Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role … requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: Identify opportunities for … automation and process improvement. Mentor and guide data engineers. Establish coding standards and best practices. Implement and document data integrity and quality checks. Optimize queries. Facilitate collaboration within the data engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data Architect more »