Data Ingestion Jobs in the UK

26 to 50 of 73 Data Ingestion Jobs in the UK

Senior Manager Data & AI

London Area, United Kingdom
Stealth iT Recruitment
Senior Manager Data & AI Consultant £100,000 per annum with additional Bonuses Candidates must be eligible for SC Clearance Flexible working! An overview of the role: You will be joining our rapidly growing Data & AI Strategy team, where we are at the forefront of designing and building winning … strategies and operating models to transform how organizations across all industries and sectors leverage data & AI. We’re building a successful team of experts across the data & AI lifecycle, and we’re looking for talented people to strengthen our position as consulting leaders in data & AI strategy … leadership roles within our practice, enabling you to gain experience and hone your skills before taking them onto clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »
Posted:

Data Architect

London Area, United Kingdom
Lawrence Harvey
Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy … the office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial services client is required Desirable: Data more »
Posted:

Principal Data Engineer

Preston, Lancashire, North West, United Kingdom
Viqu Limited
Principal Data Engineer - Northwest £70,000 to £75,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team across … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data Architect, as it more »
Employment Type: Permanent
Salary: £70,000
Posted:

Quantitative Data Engineer

London Area, United Kingdom
Algo Capital Group
Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Solirius Consulting
of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »
Posted:

Senior Principal Consultant - Data Architect

London Area, United Kingdom
Genpact
we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant, Data Architect/Data Engineer! In this role, you will … play a pivotal role in designing and implementing robust data solutions. Your technical expertise and leadership will drive the success of our big data initiatives. Good level of experience is required. Responsibilities: Build robust, high-performance, and adaptable solutions for modern platforms (GCP Big Query,Relational, OLAP) Finance … data modelling extensive experience desired as the data lead. Talend/Informatica transformation logic experience is required Technical thought leadership on architecture, data modeling, and Big Data strategy Expertise in technical principles, vision, and standards for data warehouse. Scalability to handle increasing data demands more »
Posted:

Data Engineer

Derby, England, United Kingdom
Mirai Talent
Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or London, the … to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of more »
Posted:

Data Engineer (python and azure) - Remote - £500 per day - Inside IR35

Nationwide, United Kingdom
Hybrid / WFH Options
Exalto Consulting
Data engineer - Python - Azure - Inside IR35 - £500 per day - 6 months Exalto Consulting are currently recruiting for a contract Data Engineer for a client, 100% remote working inside IR35 paying £500 per day, initially 6 months Skills required for the role: Big data experience Data inventory … and data familiarisation Efficient data ingestion and ingestion pipelines Data cleaning and transformation Databricks (ideally with Unity Catalog) Python and PySpark CI/CD (ideally with Azure Devops) Unit testing (PyTest) If you have the above experience and are looking for a new contract role … please send your CV for immediate consideration as our client are looking to hire ASAP Data engineer - Python - Azure - Inside IR35 - £500 per day - 6 months more »
Employment Type: Contract
Rate: £500 - £510/day £500 per day
Posted:

Data & AI Strategy Senior Manager

England, United Kingdom
Hybrid / WFH Options
Stealth iT Recruitment
to £100,000 dependent on experience, plus bonus and other benefits. An overview of the role: We're seeking talented individuals to join a Data & AI Strategy team of a consultancy that we're supporting, where you'll design and build strategies and operating models to transform organizations across … all industries through data & AI. All Managers and Senior Managers work as trusted advisors with senior clients, leading teams of consultants and technical specialists on large and complex projects. We're looking for candidates with consulting experience in sectors such as Transport, Energy, Utilities, Government, Defence, Consumer Products & Retail … the opportunity to take on leadership roles within the consultancy practice, honing your skills before taking them to clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »
Posted:

Data Engineer

City of London, Cordwainer, United Kingdom
Xpertise Recruitment
Azure Data Engineer. Contract. Remote Python/PyTest/Azure/Databricks Notebooks Our client, a leading consultancy are looking to bring in an Azure Data Engineer to support their data transformation and wondered if you could be open to a chat? If so, please find more … contract, Location: Remote with very occasional travel to any of their offices across the UK (Scotland, Manchester, Midlands, London, Bristol + others) Experience required: Data inventory and data familiarisation Efficient data ingestion and ingestion pipelines Data cleaning and transformation Databricks (ideally with Unity Catalog more »
Employment Type: Contract
Rate: £500 - £501/day
Posted:

Data Engineer

London Area, United Kingdom
Gloo
Data Engineer £80,000-£95,000 London, Hybrid Permanent I am seeking an experienced Data Engineer who is passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines across diverse sources, enhancing the quality … of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Design robust data processing and indexing pipelines handling large amounts of data across several … modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Requirements: Strong programming more »
Posted:

Head of Data (D2C)

London Area, United Kingdom
TalentCo
We are excited to be working with a Direct-to-Consumer VC-backed startup looking to hire an exceptional Head of Data into their London office. Having raised a substantial Series B funding round from top investors, they’re now keen to bring in an experienced Head of Data to lead and develop their growing data team. You will report directly to the VP Engineering, playing a key role in introducing structure and rigour to how the company uses its data and creating a data-driven culture throughout the organisation. You will inherit a small … but-mighty team of 5 including data engineers, analytics engineers and a software engineer, and mentoring and developing your direct reports will be a key aspect of this role. You will tackle a broad range of problems, from developing cutting edge data product solutions to maintaining and building more »
Posted:

Data Platform Engineer - London/Hybrid - £70,000 FTC

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and implementation of … a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are serious about the way … that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Develop and maintain the organisation Azure data warehouse infrastructure Create robust data more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Founding Data Engineer

London Area, United Kingdom
Gameface Associates Ltd
Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »
Posted:

Data Engineer

Manchester, England, United Kingdom
Hybrid / WFH Options
be:technology
Data Engineer – Manchester - £40,000 – Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »
Posted:

Data Engineer - Fixed Term Contract

Greater London, England, United Kingdom
LexisNexis Intellectual Property Solutions
Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business more »
Posted:

Software Engineer (Data)

London Area, United Kingdom
Gloo
Software Engineer (Data) £110,000-£120,000 London, Hybrid (2x days) Permanent role I am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines … across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Design robust data processing and … indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling. Ensure the secure handling of data through end-to-end encryption, data isolation, and more »
Posted:

Senior DataOps Engineer

Runcorn, England, United Kingdom
PHOENIX Medical Supplies Ltd
Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 and extensive benefits package Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »
Posted:

Data Scientist

London Area, United Kingdom
Morgan McKinley
Exciting opportunity to work with a Big4 Tech company as a Data Scientist, based in London! 12 months contract Key Qualifications: • Postgraduate degree (MS or PhD) in a quantitative field of study including economics, statistics, applied mathematics, data science, business, or a related discipline. • 5-7 years professional … experience developing advanced Tableau data visualizations, dashboards and reporting. • Programming skills in SQL and Python required to develop and maintain custom ETL processes. • Skills in exploratory data analysis and familiarity with advanced quantitative analysis. • Experience reporting on web analytics in Adobe, or other web analytics tools. • Comfortable using … modern data technologies. Familiarity with database modelling and data warehousing principles (Snowflake preferred). • Knowledge of the digital advertising industry, the mobile app economy or related field. • Familiarity with automated data ingestion processes including APIs. • Ability to partner effectively with data science and engineering stakeholders more »
Posted:

Solution Architect

England, United Kingdom
Hybrid / WFH Options
Parser
minded subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our client … navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency, and compliance … of the data architecture while spearheading the migration from legacy systems to modern solutions. What you'll bring to us: At least 5 years of experience in a similar role, with 10 years in software engineering and solution architecture. Extensive knowledge of database structure systems, data mining, data more »
Posted:

Data Architect

United Kingdom
Chaptr Ltd
Data Architect - AWS Digital Consultancy £650-£700 per day (outside IR35) UK remote This is an exciting opportunity to join a digital consultancy that operate throughout Europe, predominately working with technology led businesses to build new products and platforms. They're about to embark on a project for a … customer in the automotive/EV industry and so are looking for a Data Architect to help lead on the design and build of a customer data platform. The platform will sit on AWS and they plan on using Snowflake as the data warehouse however you'll … however there will be the occasional requirement to meet with the team in London. What you'll do: Plan architecture and build infrastructure for data ingestion, processing, analytics, visualisations and business intelligence systems. Integrate AI/Machine learning inference as part of a data platform. Data more »
Posted:

Lead Data Engineer - Financial Services

London Area, United Kingdom
Sterlings
A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross … functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties … include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming more »
Posted:

Data Platform Engineer @ IMU Biosciences (UK, Sweden)

United Kingdom
IMU Biosciences
Data Platform Engineer @ IMU Biosciences Our immune system plays a vital role in maintaining our health and wellbeing. Understanding how it works has led to the development of some of the most innovative and exciting therapies currently revolutionizing medicine. Our mission is to understand the immune system at a … of disease, and the identification of more effective methods of targeting the immune system with tailored treatments. We’re looking for dynamic and talented Data Platform Developers to join our growing engineering team. As part of the team you will continuously unlock new complexity and implement solutions for these. … You will play a crucial role in the evolution of our high-throughput immunophenotyping and data analytics platform, and influence its future direction to maintain and expand our market fit. At times, you will embed in multidisciplinary teams, where you'll provide your expertise with those from other fields more »
Posted:

Lead Data Engineer - Hybrid Working - Up to £160,000 + Bonus

United Kingdom
Hybrid / WFH Options
Hunter Bond
Job title: Lead Data Engineer Client: Elite Quant Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead Data Engineer … cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored … data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor's Degree in Computer Science, Engineering (or other related more »
Posted:

Data Engineer - Hybrid Working - Up to £1500 p/d

United Kingdom
Hybrid / WFH Options
Hunter Bond
Job title: Data Engineer Client: Elite Fintech Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes from … a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly tech driven fintech, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will … work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and maintain real-time data processing systems. Keep up with more »
Posted:
Data Ingestion
10th Percentile
£51,000
25th Percentile
£58,750
Median
£75,000
75th Percentile
£86,250
90th Percentile
£105,000