1 to 25 of 37 Data Ingestion Jobs in London

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after our … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum … Strategy: Support designing, developing, implementing, managing and supporting enterprise-level ELT/ELT processes and environment Technical and business processes are used to combine data from multiple sources to provide a unified, single view of the data. Be an architect making strategic decisions. Partly responsible for accessing, validating, and more »

Data Engineer Tech for good - up to £52,000 Hybrid - London My Client is in the tech for good space working to protect children globally. They are looking for a Data Engineer who will report directly to the Head of Data and is responsible for building and … maintaining of the Enterprise Data Platform, including data ingestion pipelines and data models. Responsibilities/skills required: Experience working the entire data lifecycle, building relevant data models that meet business requirements Implement data solutions making sure the data is accessible, accurate and … up-to-date Strong experience with data management, data migration, data ingestion, data transformation, data storage, data quality, data access and security. Implement Data engineering best practices Ensure the performance, monitoring, and maintenance of the Data Platform with appropriate backup more »

Contract/Permanent Opportunity Azure Cloud Data Architect Hybrid (London 2x per Week) Must have Active Security Clearance Job responsibilities Architecture of solutions Architecting Enterprise Data Platform on Cloud particularly on Azure to support regulatory financial institution Designing Functional Architectures for Service Quality Designing and maintaining Non-Functional … Requirements, e.g., Capacity planning, availability, performance, housekeeping, monitoring and foundational capabilities of the Enterprise Data Platform Designing the application solution delivery and good understanding of Cloud Infrastructure solutions Leading technical teams as appropriate in data and analytics delivery implementation and support Performing technical assessment and evaluation of Cloud … Services and other Cloud SaaS/IaaS/PaaS solutions Documenting solution architecture Cloud Data Platform capabilities, Use Cases, Applications, including integrations Collaborate with Cloud Security and Cloud Infrastructure offices Maintaining documentation Other Azure Cloud data Architect activities Assist in deploying data solutions and applications. Assist in more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting agile team with a highly skilled team of Data Engineers from other disciplines to design and develop innovative data-driven solutions Comfortable with more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value … for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data engineering pipelines to eliminate manual stages. Develop … a comprehensive understanding of the organisation's data structures and metrics, advocating changes for product development. Educate and embed new data techniques into the business through role modelling, training, and experiment design oversight. Craft data engineering strategies to build a scalable data architecture and feature-rich more »

Hi Professionals, Greetings From Ampstek!! Hope you are high in your spirits. Please stay safe. Our client is looking for Data Architect to join a high-growth organization. If you are interested share you resume sudhakaran.m@ampstek.com Role: Data Architect Location: London, UK (Hybrid) Duration: Contract Job Description … Scope of work Collecting the requirements/use cases Proposing potential solution options that connects Edge data with existing data architecture (called as UDP but essentially on Azure that consists of Stream Analytics, Data Lake, Ingestion and orchestration layers) Analysing existing solution (Legacy MES) to extract … the data from its complex data model Skills needed Data Architect with an understanding of creating unified namespace data models for plugging in manufacturing data Should be well versed with Edge/IOT architecture (PLC, SCADA, Historian, Sensors) Should have knowledge on connecting with Enterprise more »

Would you be interested in a data engineering role at a fast-paced AI (LLM) start-up comprised of Meta, Google, AWS, and Microsoft alumni? You can expect to: Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Design … robust data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Manage cloud orchestration and data infrastructure, applying your expertise with … various data processing and indexing tools to ensure scalability and reliability. Work closely with the team to integrate search infrastructure that meets the needs of large language models and retrieval systems. Your first 3 months will include: You have a strong grasp infrastructure, architecture, performance concerns, SDLC and practices. more »

Senior Manager Data & AI Consultant £100,000 per annum with additional Bonuses Candidates must be eligible for SC Clearance Flexible working! An overview of the role: You will be joining our rapidly growing Data & AI Strategy team, where we are at the forefront of designing and building winning … strategies and operating models to transform how organizations across all industries and sectors leverage data & AI. We’re building a successful team of experts across the data & AI lifecycle, and we’re looking for talented people to strengthen our position as consulting leaders in data & AI strategy … leadership roles within our practice, enabling you to gain experience and hone your skills before taking them onto clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy … the office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial services client is required Desirable: Data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage … and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team! Your Role: Design, optimize, and maintain robust data pipelines for … complex knowledge-intensive documents. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Implement end-to-end encryption and data isolation for secure data handling. Collaborate with a diverse team to integrate search infrastructure for large language models. … Your First 3 Months: Enhance data ingestion framework, boosting efficiency and scalability. Improve scalability and performance of data infrastructure, setting new benchmarks. Mentor team members and promote best practices in data engineering. What You Bring: Experience building and optimizing search infrastructure in cloud environments. Proficiency in more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data centric … Business which will be critical as the transformation continues. You will be working with an established tech stack and proven experience of supporting traditional data warehouses is core to the role. You will be part of a small and highly skilled team and you will need to be passionate … best in class solutions to our global user base. Key Responsibilities To be successful in the role you will be expected to: Support the Data Team Lead in continuously delivering changes to existing system Develop, modify, implement, and support software components. Determine root cause for data/software more »

Staff Data Engineer Tech - Python, NoSql, Spark, AWS/GCP Salary – Up to £115,000 Location – Hybrid (twice a week on-site) A rapidly expanding AI, data, and research business is looking for a highly skilled Data Engineer to join their growing team focused on delivering high … quality data to their recovery system, LLM’s, and end users. As a Data Engineer, you will be responsible for the design, optimization, and maintenance of robust data pipelines ensuring secure data handling via end-to-end encryption and data isolation. You will oversee cloud … orchestration and data infrastructure using the most relevant and modern data processing tools. Skills required as a Data Engineer: Python NoSql Spark AWS/GCP This a challenging and rewarding position for a self-motivated Data Engineer to join a forward-thinking, mission driven data more »

Senior Data Engineer - Investment Firm - London - Up to £150k base + bonus About Us: We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we are … seeking a talented Senior Data Engineer to join our dynamic team. Role Overview: As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You will work closely with … various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions. Key Responsibilities: Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers. Utilise Python and Java (both preferred more »

Senior Azure Data Engineer - London - £90,000 A global organisation operating within the telecommunications space are looking for a Senior Azure Data Engineer to join their growing IT function. The organisation have invested heavily in their technology stack, with the implementation of Microsoft Fabric being an important project … in the pipeline. The data team aim to deliver a comprehensive and insightful reporting suite using the large datasets they have at their disposal and this role will play a key role in ensuring key stakeholders are able to have insights at their fingertips! In this role you will … be responsible for developing and maintaining the Azure data platform. Over time, the organisation are looking to introduce AI concepts where the data team will take the lead on its implementation. This is a fantastic time to join a growing business, who invest in its people and have more »

Software Engineer (Data) £110,000-£120,000 London, Hybrid (2x days) Permanent role I am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines … across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Design robust data processing and … indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling. Ensure the secure handling of data through end-to-end encryption, data isolation, and more »

Exciting opportunity to work with a Big4 Tech company as a Data Scientist, based in London! 12 months contract Key Qualifications: • Postgraduate degree (MS or PhD) in a quantitative field of study including economics, statistics, applied mathematics, data science, business, or a related discipline. • 5-7 years professional … experience developing advanced Tableau data visualizations, dashboards and reporting. • Programming skills in SQL and Python required to develop and maintain custom ETL processes. • Skills in exploratory data analysis and familiarity with advanced quantitative analysis. • Experience reporting on web analytics in Adobe, or other web analytics tools. • Comfortable using … modern data technologies. Familiarity with database modelling and data warehousing principles (Snowflake preferred). • Knowledge of the digital advertising industry, the mobile app economy or related field. • Familiarity with automated data ingestion processes including APIs. • Ability to partner effectively with data science and engineering stakeholders more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are … individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: At Aviva, data serves as the lifeblood that propels our organizations forward, and we are no exception. As a Principal Data Engineer within our esteemed Data more »

basis. Purpose: Supporting the Business and Finance Team you will be integral to establishing, testing and maintaining a comprehensive suite of reports, workflows and data models across all business areas. You will work with internal and external stakeholders to guide data strategy and best practice to ensure solutions … existing Finance reporting via NetSuite, Vantage & Sugar systems. - Suggest and implement ways to improve current Finance reporting processes. - Own and manage the company’s data systems such as Alteryx and Power BI. Manage users and data ingestion and be responsible for the data held and reports … generated. - Drive efficiency by identifying customer profitability and supplier billing queries. - Manage, Transform, and Interpret data, and analyze results using statistical techniques and provide ongoing reports. - Design and implement data analysis, data collection, and other processes that deliver the key objectives of your stakeholders. E.g. improving existing more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross … functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties … include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming more »

purpose of making the world a better and safer place. Element, a well-established organization that touches billions of lives, is searching for a Data Scientist in London (hybrid) to help build a startup within their organization. You will design and train performant models from scratch and create a … drive our product's analytics engine. Operating in an Agile setting, you will be part of a cross functional team, collaborating closely with other Data Scientists, Data Engineers, Software Engineers, Product Owners and UX/UI Designers, to innovate and drive our product to new heights. Core Responsibilities … learning models & design robust analytics engines for high-end digital products Create repeatable, interpretable, dynamic and scalable models that are seamlessly incorporated into analytic data products Document code, results, and details of the approaches in a systematic way to promote knowledge sharing and code re-use Collaborate with other more »

Data Engineer Asset Management/Data Ingestion/Data Migration Contract (Inside IR35) Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of … the year here with 2024. The role will require you to have: 5+ years data engineering background working on cloud architecture Must have specific experience with cloud technologies and an innovative view of whats on the market regarding new technologies Power BI or another similar technology would be an more »

Lead Data Engineer London salary circa £58,000, National salary circa £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are … passionate, energetic individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: Data is the life blood of any modern organisation and Aviva is no different. Our Data Engineering team sits within Aviva Quantum our global more »