1 to 25 of 37 Data Ingestion Jobs in London

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after our … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum … Strategy: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. Be an architect making strategic decisions. Partly responsible for accessing, validating, and more »

Data Engineer Tech for good - up to £52,000 Hybrid - London My Client is in the tech for good space working to protect children globally. They are looking for a Data Engineer who will report directly to the Head of Data and is responsible for building and … maintaining of the Enterprise Data Platform, including data ingestion pipelines and data models. Responsibilities/skills required: Experience working the entire data lifecycle, building relevant data models that meet business requirements Implement data solutions making sure the data is accessible, accurate and … up-to-date Strong experience with data management, data migration, data ingestion, data transformation, data storage, data quality, data access and security. Implement Data engineering best practices Ensure the performance, monitoring, and maintenance of the Data Platform with appropriate backup more »

Contract/Permanent Opportunity Azure Cloud Data Architect Hybrid (London 2x per Week) Must have Active Security Clearance Job responsibilities Architecture of solutions Architecting Enterprise Data Platform on Cloud particularly on Azure to support regulatory financial institution Designing Functional Architectures for Service Quality Designing and maintaining Non-Functional … Requirements, e.g., Capacity planning, availability, performance, housekeeping, monitoring and foundational capabilities of the Enterprise Data Platform Designing the application solution delivery and good understanding of Cloud Infrastructure solutions Leading technical teams as appropriate in data and analytics delivery implementation and support Performing technical assessment and evaluation of Cloud … Services and other Cloud SaaS/IaaS/PaaS solutions Documenting solution architecture Cloud Data Platform capabilities, Use Cases, Applications, including integrations Collaborate with Cloud Security and Cloud Infrastructure offices Maintaining documentation Other Azure Cloud data Architect activities Assist in deploying data solutions and applications. Assist in more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting agile team with a highly skilled team of Data Engineers from other disciplines to design and develop innovative data-driven solutions Comfortable with more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. Our … team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication to … and commercial decisions are driven by this innovative collection of art market data. Role overview We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value … for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data engineering pipelines to eliminate manual stages. Develop … a comprehensive understanding of the organisation's data structures and metrics, advocating changes for product development. Educate and embed new data techniques into the business through role modelling, training, and experiment design oversight. Craft data engineering strategies to build a scalable data architecture and feature-rich more »

Would you be interested in a data engineering role at a fast-paced AI (LLM) start-up comprised of Meta, Google, AWS, and Microsoft alumni? You can expect to: Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Design … robust data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Manage cloud orchestration and data infrastructure, applying your expertise with … various data processing and indexing tools to ensure scalability and reliability. Work closely with the team to integrate search infrastructure that meets the needs of large language models and retrieval systems. Your first 3 months will include: You have a strong grasp infrastructure, architecture, performance concerns, SDLC and practices. more »

Senior Manager Data & AI Consultant £100,000 per annum with additional Bonuses Candidates must be eligible for SC Clearance Flexible working! An overview of the role: You will be joining our rapidly growing Data & AI Strategy team, where we are at the forefront of designing and building winning … strategies and operating models to transform how organizations across all industries and sectors leverage data & AI. We’re building a successful team of experts across the data & AI lifecycle, and we’re looking for talented people to strengthen our position as consulting leaders in data & AI strategy … leadership roles within our practice, enabling you to gain experience and hone your skills before taking them onto clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy … the office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial services client is required Desirable: Data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage … and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team! Your Role: Design, optimize, and maintain robust data pipelines for … complex knowledge-intensive documents. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Implement end-to-end encryption and data isolation for secure data handling. Collaborate with a diverse team to integrate search infrastructure for large language models. … Your First 3 Months: Enhance data ingestion framework, boosting efficiency and scalability. Improve scalability and performance of data infrastructure, setting new benchmarks. Mentor team members and promote best practices in data engineering. What You Bring: Experience building and optimizing search infrastructure in cloud environments. Proficiency in more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data centric … Business which will be critical as the transformation continues. You will be working with an established tech stack and proven experience of supporting traditional data warehouses is core to the role. You will be part of a small and highly skilled team and you will need to be passionate … best in class solutions to our global user base. Key Responsibilities To be successful in the role you will be expected to: Support the Data Team Lead in continuously delivering changes to existing system Develop, modify, implement, and support software components. Determine root cause for data/software more »

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and implementation of … a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are serious about the way … that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Develop and maintain the organisation Azure data warehouse infrastructure Create robust data more »

Senior Data Engineer - Investment Firm - London - Up to £150k base + bonus About Us: We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we are … seeking a talented Senior Data Engineer to join our dynamic team. Role Overview: As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You will work closely with … various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions. Key Responsibilities: Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers. Utilise Python and Java (both preferred more »

Founding Data Engineer Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or related areas. Please only apply if you have specific/relatable experience. You should also be fine to … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »

Software Engineer (Data) £110,000-£120,000 London, Hybrid (2x days) Permanent role I am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines … across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Design robust data processing and … indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling. Ensure the secure handling of data through end-to-end encryption, data isolation, and more »

Exciting opportunity to work with a Big4 Tech company as a Data Scientist, based in London! 12 months contract Key Qualifications: • Postgraduate degree (MS or PhD) in a quantitative field of study including economics, statistics, applied mathematics, data science, business, or a related discipline. • 5-7 years professional … experience developing advanced Tableau data visualizations, dashboards and reporting. • Programming skills in SQL and Python required to develop and maintain custom ETL processes. • Skills in exploratory data analysis and familiarity with advanced quantitative analysis. • Experience reporting on web analytics in Adobe, or other web analytics tools. • Comfortable using … modern data technologies. Familiarity with database modelling and data warehousing principles (Snowflake preferred). • Knowledge of the digital advertising industry, the mobile app economy or related field. • Familiarity with automated data ingestion processes including APIs. • Ability to partner effectively with data science and engineering stakeholders more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are … individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: At Aviva, data serves as the lifeblood that propels our organizations forward, and we are no exception. As a Principal Data Engineer within our esteemed Data more »

Job title: Lead Data Engineer Client: Data Driven Hedge Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead Data … cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored … data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor's Degree in Computer Science, Engineering (or other related more »

basis. Purpose: Supporting the Business and Finance Team you will be integral to establishing, testing and maintaining a comprehensive suite of reports, workflows and data models across all business areas. You will work with internal and external stakeholders to guide data strategy and best practice to ensure solutions … existing Finance reporting via NetSuite, Vantage & Sugar systems. - Suggest and implement ways to improve current Finance reporting processes. - Own and manage the company’s data systems such as Alteryx and Power BI. Manage users and data ingestion and be responsible for the data held and reports … generated. - Drive efficiency by identifying customer profitability and supplier billing queries. - Manage, Transform, and Interpret data, and analyze results using statistical techniques and provide ongoing reports. - Design and implement data analysis, data collection, and other processes that deliver the key objectives of your stakeholders. E.g. improving existing more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross … functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties … include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming more »

TwentyAI are supporting a lead commodity trading house with a hire needed in their London office. They are looking for a talented Data Engineer to work a number of greenfield initiatives as part of a trade monitoring department. This is an exciting opportunity to work within a fast-paced … and strategy of this team and play a leading role in the growth of the team. The role: Work on designing, implementing & continuously evolving data platform's including pipeline & repository Carry out data ingestion, curation, preparation and access required for systematic alpha ideas exploration, analytics & reporting Management … and ongoing development of an enterprise data platform built on Azure Development of new data products and services for commercial and operational teams Tech Stack Python and Pyspark SQL Pipelines, Big Data, Data architectures App Services, Functions, Cosmos DB, Databricks, Synpase and associated tools automation, PyTest more »

purpose of making the world a better and safer place. Element, a well-established organization that touches billions of lives, is searching for a Data Scientist in London (hybrid) to help build a startup within their organization. You will design and train performant models from scratch and create a … drive our product's analytics engine. Operating in an Agile setting, you will be part of a cross functional team, collaborating closely with other Data Scientists, Data Engineers, Software Engineers, Product Owners and UX/UI Designers, to innovate and drive our product to new heights. Core Responsibilities … learning models & design robust analytics engines for high-end digital products Create repeatable, interpretable, dynamic and scalable models that are seamlessly incorporated into analytic data products Document code, results, and details of the approaches in a systematic way to promote knowledge sharing and code re-use Collaborate with other more »