16 of 16 Data Ingestion Jobs in the South East

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

It is only when expertise, highly professional processes and enjoyment of work unite that we can shape the future together. BMW Group Financial Services UK is looking for a Data Analyst. This role is based at the Summit ONE Campus in Farnborough. What awaits you? Analyse data from transactional systems to understand the generation and transformation of data, and its relationship to business processes and models. Develop a detailed understanding of transactional system data at the attribute level to prepare for effective transformation into a structure suitable for analytics. Identify and quantify business stakeholders' requirements which we can convert to re-usable Data Products. Design and implement suitable database schemas to be integrated into our … overall Data Model for the purpose of Self-Serving to our customer "spokes". Help embed Data Quality checks, validations, and alerting mechanisms across all data ingestion processes. Partner closely with our Data Engineering Hub in the integration of ETL processes into the Enterprise Data Model platform, ensuring data integrity and seamless flow. More ❯

Senior Data Engineer - £82,000 - Hybrid & Remote Flexibility No Sponsorship Available Company We are a forward-thinking technology company dedicated to simplifying complex processes through innovative solutions. With a focus on enhancing efficiency and transparency, we strive to deliver outstanding experiences for our customers. Our team operates with a flexible hybrid working model, fostering collaboration and innovation in a … supportive environment. Responsibilities As a Senior Data Engineer, you'll play a pivotal role in advancing our data infrastructure to support our expanding scope and responsibilities. Key responsibilities include: Enhancing the reliability and stability of our data infrastructure. Managing data ingestion pipelines using tools such as Azure Data Factory (ADF) and Python. Ensuring the … quality of raw datasets to empower Data Analysts in creating robust data models. Deploying and managing data tools on Kubernetes (Airflow, Superset, RStudio Connect). Supporting Data Analytics through the management of DBT, DevOps, and deployment rules. You will have the opportunity to work end-to-end, making meaningful contributions within a small, agile team. Experience More ❯

Job Title: Data Engineer (NPPV3 + SC Clearance Required)Location: Hybrid (UK-based)Contract: 3 Months (with potential extension/move to other projects)Rate: £550 per day (Outside IR35)A bout the Role:We are seeking an experienced Data Engineer with NPPV3 + SC clearance to join our dynamic team on a 3-month contract basis. This … role offering the flexibility of working both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and … storage in cloud environments.* Troubleshoot and optimise data workflows for performance and reliability.* Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions. More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

a dynamic self-starter to join their innovative team in the heart of London. If you thrive in a fast-paced environment and want to contribute to cutting-edge data science applications, this is the perfect opportunity for you! About Client: Our client is a leading global payments technology company that enables businesses of all sizes to accept payments … geographies. They handle billions of transactions annually, offering secure, scalable solutions that support innovation in the financial ecosystem. With deep industry expertise, they empower merchants to grow through advanced data insights and reliable infrastructure. What You'll Do : Design, develop, and deploy machine learning models that solve real-world problems. Collaborate with cross-functional teams to improve production systems … and ensure seamless integration of ML models. Drive the ML life cycle from data ingestion to model deployment and monitoring. Implement CI/CD pipelines and leverage DevOps practices to enhance operational efficiency. What You Need : A relevant BSc/MSc degree in a related field with strong industry experience. Proven expertise in ML engineering and MLOps, with More ❯

This is an exciting opportunity for a Power BI Specialist. Based in London, you will use your expertise to create insightful dashboards and reports that support data-driven decision-making. Client Details A £100million turnover company. Description Design, build, and refine dashboards focusing on profit and loss, margin analysis, cost control, and operational KPIs across the Group. Enhance existing … dashboards to integrate with the new Microsoft Data Links repository, replacing scheduled refreshes with live data feeds. Use Power Query (M language) for data ingestion and transformation. Develop advanced DAX measures, including time intelligence calculations, dynamic reporting layers, and calculated tables. Manage the full dashboard development lifecycle, from stakeholder engagement and data modelling to prototyping … business units to gather requirements and shape outputs. Ensure dashboards are user-friendly, commercially relevant, and actionable for both finance and non-finance users. Work alongside internal ERP and data teams (who manage SQL and connectors) to maintain data consistency with Unit4 and Tagetik systems. Provide ad-hoc support for wider reporting and transformation projects, including benchmarking and More ❯

an OFSTED Inspector. Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence More ❯

TECHNICAL PROGRAMME MANAGER - DATA INGESTION (PHARMA/SNOWFLAKE) UP TO £560 PER DAY HYBRID (1/2 DAYS PER WEEK IN SPAIN & GERMANY) 6 MONTHS THE COMPANY: A global data and analytics consultancy are delivering a large-scale data ingestion programme for a leading pharmaceutical client. THE ROLE: As a Technical Programme Manager, your key … responsibilities will include: Leading client engagement and delivery governance for the data ingestion workstream. Acting as the bridge between offshore engineering teams (India) and European stakeholders (Germany/Spain). Overseeing ingestion of 500+ data sets into the client's Snowflake environment. Driving delivery oversight, issue/risk management, and programme direction. YOUR SKILLS AND EXPERIENCE … The successful Technical Programme Manager will have: Strong programme or project management background in data engineering or data platform environments. Experience working with Snowflake, AWS (S3, Glue), DBT, SnapLogic, and PySpark. A background in the pharmaceutical industry. Proven success in managing distributed/offshore teams and client-side stakeholders. Excellent communication and stakeholder management skills, with an assertive More ❯

role that will be based in London. Our client is seeking a detail-oriented and dedicated DAT Developer to support day-to-day client requests within a multi-tenant, data-driven, cloud-based reporting platform. In this role, you’ll gather user requirements, adapt data ingestion methods to meet client needs, investigate data issues, and contribute … work closely with a collaborative team to ensure the system remains scalable and robust. The ideal candidate will have hands-on experience with Microsoft SQL Server development, ETL processes, data modelling, and version control systems. Experience in the financial services industry is a plus. Develop, implement, and optimise database objects to meet client-specific and system-wide requirements. Collaborate … quality support and solutions for clients. Create clear and detailed documentation and reports for both internal and client use. Develop and maintain procedures and scripts for release controls and data migrations. Provide ongoing data management and general product support to clients. Perform quality assurance testing to ensure data integrity and system reliability. About You Minimum of More ❯

Product Owner - Sport Data £42,770 - £64,150 Hybrid - 2 days a week in London, Basingstoke or Bristol Join Our Team at Hawk-Eye Innovations Hi, I'm Dan Payne, Product Director here at Hawk-Eye Innovations, and I'm excited to invite you to join our team as a Product Owner. If you're passionate about creating cutting … will help define and translate user and business requirements into actionable work and be an essential part of enhancing our tracking services, related products and features. Your understanding of data ingestion and delivery technology, product, value and business, as well as experience collaborating with multiple stakeholders and leads, are some of the skills you may expect to use … in this role. Your week might include: Helping drive the future of Hawk-Eye's data delivery services, serving as the voice of the user, client and business goals Working with users as well as external and internal stakeholders to analyse their needs and translate those into product requirements Contributing to the Vision, Roadmap and ROI of the product More ❯

with potential 3-month extensions and permanent option) Day Rate: £500-560pd (Outside IR35) Start Date: Immediate Overview You'll play a pivotal role in ensuring the successful ingestion of 500+ data sets into Snowflake, coordinating sprint-based delivery, managing cross-border teams, and maintaining high-quality communication with senior stakeholders across Data, IT, Compliance, and … Change. Key Responsibilities Oversee phased ingestion of 500+ data sources into the client's Snowflake environment Liaise between offshore engineering teams (based in Bangalore) and EU client stakeholders Monitor delivery timelines, report progress, flag risks, and ensure quality governance Work across multi-disciplinary teams including data, compliance, change, and technology Maintain momentum in delivery while ensuring stakeholder … expectations are managed Support issue identification and help shape future data opportunities within the platform What Success Looks Like Timely and accurate delivery of phased ingestion milestones Strong stakeholder alignment and minimal delivery blockers High-quality programme oversight across offshore/onshore boundaries Ability to push back where necessary and steer project direction assertively Foundation laid for long More ❯

experience in Java and Python, confident working with AWS cloud infrastructure including containerisation (Docker/Kubernetes), architecture, and scaling systems. They will have solid skills in building and managing data ingestion and processing pipelines and be looking to lead a team in an office-based environment in London. This is a fantastic opportunity for an experienced developer to … in London The Person: *Experienced Hands-on Software Developer with strong Java and Python experience*Strong AWS cloud infrastructure and containerisation (Docker/Kubernetes)*Skilled in building and managing data ingestion and processing pipelines (Kafka/Spring Batch)*Looking to lead a team in an office-based role in London. Reference Number: BBBH 254621 To apply for this More ❯