1 to 25 of 72 Data Ingestion Jobs in the UK

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and implementation of … a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are serious about the way … that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Develop and maintain the organisation Azure data warehouse infrastructure Create robust data more »

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and a strong ability to … learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must (working closely with Data Science … Snowflake best practices and new features. This role is perfect for someone who enjoys the challenge of working with Snowflake and is passionate about data engineering. Key responsibilities: Design and build data pipelines in Snowflake. Collaborate with stakeholders, including the Data Science Team, to define data more »

Data Engineer Tech for good - up to £52,000 Hybrid - London My Client is in the tech for good space working to protect children globally. They are looking for a Data Engineer who will report directly to the Head of Data and is responsible for building and … maintaining of the Enterprise Data Platform, including data ingestion pipelines and data models. Responsibilities/skills required: Experience working the entire data lifecycle, building relevant data models that meet business requirements Implement data solutions making sure the data is accessible, accurate and … up-to-date Strong experience with data management, data migration, data ingestion, data transformation, data storage, data quality, data access and security. Implement Data engineering best practices Ensure the performance, monitoring, and maintenance of the Data Platform with appropriate backup more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting agile team with a highly skilled team of Data Engineers from other disciplines to design and develop innovative data-driven solutions Comfortable with more »

benefits Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy … the office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial services client is required Desirable: Data more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data centric … Business which will be critical as the transformation continues. You will be working with an established tech stack and proven experience of supporting traditional data warehouses is core to the role. You will be part of a small and highly skilled team and you will need to be passionate … best in class solutions to our global user base. Key Responsibilities To be successful in the role you will be expected to: Support the Data Team Lead in continuously delivering changes to existing system Develop, modify, implement, and support software components. Determine root cause for data/software more »

Data Engineer Asset Management/Data Ingestion/Data Migration Contract (Inside IR35) Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of … the year here with 2024. The role will require you to have: 5+ years data engineering background working on cloud architecture Must have specific experience with cloud technologies and an innovative view of whats on the market regarding new technologies Power BI or another similar technology would be an more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after our … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum … Strategy: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. Be an architect making strategic decisions. Partly responsible for accessing, validating, and more »

Senior Manager Data & AI Consultant £100,000 per annum with additional Bonuses Candidates must be eligible for SC Clearance Flexible working! An overview of the role: You will be joining our rapidly growing Data & AI Strategy team, where we are at the forefront of designing and building winning … strategies and operating models to transform how organizations across all industries and sectors leverage data & AI. We’re building a successful team of experts across the data & AI lifecycle, and we’re looking for talented people to strengthen our position as consulting leaders in data & AI strategy … leadership roles within our practice, enabling you to gain experience and hone your skills before taking them onto clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the digital … age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/Architect, you will … play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities: Architect end-to-end data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »

to change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role is designed … those who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology … steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain data pipelines that fuel more »

Senior Data Engineer - Investment Firm - London - Up to £150k base + bonus About Us: We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we are … seeking a talented Senior Data Engineer to join our dynamic team. Role Overview: As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You will work closely with … various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions. Key Responsibilities: Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers. Utilise Python and Java (both preferred more »

Founding Data Engineer Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or related areas. Please only apply if you have specific/relatable experience. You should also be fine to … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »

I’m seeking a UK BASED Mid to Senior-level data engineer to bolster my client's data products and tooling team. In this role, you'll collaborate across departments to design and implement data solutions that empower their ratings analysts and enhance their internal processes. Mid … Senior AWS Data Engineer Salary: £60 - £80K + Plus bonus Can be worked from the London office or Remotely Key Responsibilities: Design and build robust data pipelines for climate offset-related data ingestion and processing. Maintain analytical data models in their data warehouse. Integrate … data pipeline outputs into their business processes and products. Develop data tools and automations to improve efficiency across the organization. Ideal Candidate will possess: Highly collaborative with a problem-solving mindset. Minimum 2 years of experience in building production ELT/ETL pipelines using Python and SQL. AWS more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are … individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: At Aviva, data serves as the lifeblood that propels our organizations forward, and we are no exception. As a Principal Data Engineer within our esteemed Data more »

Data Architect - AWS Digital Consultancy £650-£700 per day (outside IR35) UK remote This is an exciting opportunity to join a digital consultancy that operate throughout Europe, predominately working with technology led businesses to build new products and platforms. They're about to embark on a project for a … customer in the automotive/EV industry and so are looking for a Data Architect to help lead on the design and build of a customer data platform. The platform will sit on AWS and they plan on using Snowflake as the data warehouse however you'll … however there will be the occasional requirement to meet with the team in London. What you'll do: Plan architecture and build infrastructure for data ingestion, processing, analytics, visualisations and business intelligence systems. Integrate AI/Machine learning inference as part of a data platform. Data more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross … functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties … include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming more »

TwentyAI are supporting a lead commodity trading house with a hire needed in their London office. They are looking for a talented Data Engineer to work a number of greenfield initiatives as part of a trade monitoring department. This is an exciting opportunity to work within a fast-paced … and strategy of this team and play a leading role in the growth of the team. The role: Work on designing, implementing & continuously evolving data platform's including pipeline & repository Carry out data ingestion, curation, preparation and access required for systematic alpha ideas exploration, analytics & reporting Management … and ongoing development of an enterprise data platform built on Azure Development of new data products and services for commercial and operational teams Tech Stack Python and Pyspark SQL Pipelines, Big Data, Data architectures App Services, Functions, Cosmos DB, Databricks, Synpase and associated tools automation, PyTest more »

purpose of making the world a better and safer place. Element, a well-established organization that touches billions of lives, is searching for a Data Scientist in London (hybrid) to help build a startup within their organization. You will design and train performant models from scratch and create a … drive our product's analytics engine. Operating in an Agile setting, you will be part of a cross functional team, collaborating closely with other Data Scientists, Data Engineers, Software Engineers, Product Owners and UX/UI Designers, to innovate and drive our product to new heights. Core Responsibilities … learning models & design robust analytics engines for high-end digital products Create repeatable, interpretable, dynamic and scalable models that are seamlessly incorporated into analytic data products Document code, results, and details of the approaches in a systematic way to promote knowledge sharing and code re-use Collaborate with other more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To … help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase … of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and more »

Lead Data Engineer London salary circa £58,000, National salary circa £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are … passionate, energetic individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: Data is the life blood of any modern organisation and Aviva is no different. Our Data Engineering team sits within Aviva Quantum our global more »

Data Engineer 📍 Bristol, UK (Hybrid, 3 days/week in office) 💰 £38-45k dependent on experience 🚀 About us Digital i is where tech and TV collide! We’re a TV analytics company based in Bristol UK, specialising in unravelling unique insights from viewing data for both video … winning project redefining audience measurement on a global scale. Now, with big expansion plans on the horizon, we're on the hunt for a Data Engineer to help shape the next era of video on demand analytics. 💼 About the role We’re looking for a Data Engineer to … team to help develop the next generation of our industry-leading video on demand analytics platform. Your mission? Dive deep into the world of data pipelines, crafting and refining the systems that transform raw viewing data into actionable insights. Picture this: cleaning, analysing, and orchestrating meticulous quality checks more »

Technical Lead ETL Tester -Job Location -London Contract 300 - 400 a day OUTSIDE ) Software Quality Assurance experience which includes Data Warehouse Testing· 2) In-depth knowledge of Data warehouse concepts 3) Extensive exposure to Back-end/ETL Testing with good level SQL skills is required 4) Ability … to evaluate Business requirements and determine the types of testing that must be conducted (i.e., data validation, regression, etc.) 5) Should have strong Test Process orientation and familiarity with Test Scenario identification and Test Data preparation techniques and knowledge of Test Documents to be prepared i.e. Requirement Traceability … to have experience in using or have knowledge of ETL tools 10) Good to have exposure to creation of an automation framework to validate data 11) Should be detail oriented with an analytical mind set 12) Should be able to contribute individually or even coordinate with a team more »