21 of 21 Data Ingestion Jobs in the South East

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North Star vision, and deliver business value … connected, and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution design across … global initiatives, ensuring consistency with enterprise data architecture standards and integration principles. Translate business and information requirements into scalable, secure, and performant data solutions leveraging the enterprise platforms (Azure, Databricks, Power BI, SAP BTP, Salesforce, etc.). Ensure data models, pipelines, and analytics solutions are built with reuse, interoperability, and data quality in mind. Enterprise Alignment More ❯

learning day to day operations, to become a rounded professional. Role During this 2 year apprenticeship, you will be part of a cross-disciplinary team, working closely with other data analysts, product managers, data scientists, data engineers, software engineers, data managers and business partners. You will be part of a team who’s responsibilities include: Bridging … between business and digital organizations Providing actionable, data-driven business and product insights by combining deep statistical skills, data manipulation capabilities and business acumen Maintaining, defining metrics and building dashboards Autonomously executing data analysis, applying existing data & analytics strategies relevant to immediate scope Partnering with data engineers to define and build simple data models … integrating existing tools to automate data ingestion, data manipulation, quality control and data analysis Adhering to and advocating for data analytics best practices Presenting results to peers, stakeholders, and team members Collaborating with stakeholders Training The data analytics apprenticeship will lead to a Level 4 qualification, following an apprenticeship standard aligned with L4 data More ❯

Data Engineer Remote (Occasional Travel to Birmingham) Up to £75,000 + Benefits (12 Months FTC) Are you a hands-on Data Engineer who enjoys building, maintaining, and optimising modern data systems? We're working with a well-established UK business currently going through a major transition period, and they're looking for a Data Engineer … to help ensure their data platforms, models, and pipelines continue to run smoothly during this exciting phase of change. This is a home-based role with occasional travel to Birmingham - ideal for someone who enjoys autonomy, technical variety, and the satisfaction of keeping complex data systems reliable and efficient. Why this role? Work across a modern data stack - from ingestion to visualisation - using Python, SQL, Meltano, and Power BI . Join a small, high-impact team supporting pricing, revenue, and market analytics. Play a key role in maintaining and optimising the business's data warehouse and dynamic pricing model . Gain exposure to Azure cloud , containerisation, and DevOps best practices . Salary up to More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take More ❯

Data Engineer - Azure Databricks , Apache Kafka Permanent Basingstoke (Hybrid - x2 PW) Circa £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern … tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want … to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality More ❯

Lead Data Engineer Hybrid (London/Reading - 1-2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We're partnering with a global leader in marketing data and insights that's seeking … a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. Why this role? Play a key role in building and optimising global data pipelines supporting over 50 consumer panels … worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1-2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with the resources of a world leader and the agility of a More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

Business Intelligence Analyst – Microsoft Fabric (SC Cleared) As part of the build-out of a new data team, our client requires a Business Intelligence Analyst with strong expertise in Microsoft Fabric to design, develop, and deliver a unified analytics interface for stakeholders. The role will consolidate data, dashboards, reports, models, and analytical outputs into a single, user-friendly … Fabric-based experience leveraging Power BI, OneLake, and Fabric’s integrated data engineering and analytics capabilities . The BI Analyst will ensure the solution is visually intuitive, performant, accessible, and aligned with user needs across the organisation. Key Responsibilities Partner with Business Analysts and Product Teams to identify high-impact analytical opportunities and deliver insights using Microsoft Fabric (Power … BI, Data Engineering, Data Factory, Lakehouse) . Conduct exploratory data analysis (EDA) within Fabric to identify patterns, anomalies, and meaningful trends, translating findings into clear visual stories for decision-makers. Work alongside Data Engineers to support data ingestion, transformation, and feature engineering using Fabric’s Data Factory, Lakehouse, and pipelines. Design and develop More ❯

Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind one of the … UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will: Design and build robust data pipelines to … consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. Implement data quality frameworks and validation tests to ensure accuracy More ❯

Head of Data Engineering Our long-standing financial services client is seeking a Head of Data Engineering to lead a high-performing team responsible for delivering a complex data transformation.Looking for a true greenfield challenge? This is your chance to shape a transformation from the ground up, build cutting-edge data solutions, and lead a high … performing team that’s driving change across the business.To succeed in this role, you’ll bring hands-on experience owning and delivering Azure-based data platforms (Databricks, Synapse), alongside strong technical capability in designing and implementing data ingestion pipelines (ETL/ELT) and introducing event-driven architectures (Kafka) to support scalable, real-time solutions.Our client offers a … LTIP , £7.5k car allowance , and a comprehensive benefits package. The role is hybrid , based in Wolverhampton or Chatham . Key Responsibilities Lead, develop, and inspire a high-performing Data Engineering team, setting the vision, priorities, and best practices. Oversee the design, build, and optimisation of data ingestion, processing, and storage pipelines. Embed strong governance, documentation, and lifecycle More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply, email: or call … Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and integrations within Palantir Foundry … ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse data sources, ensuring More ❯

wide array of complex projects across multiple industries. The Role: We are looking for a Software Engineer with a strong foundation in API development and C# to join our data engineering team in a highly regulated industry. In this role, you’ll be instrumental in designing and building scalable, secure software systems that support seamless data movement between … internal systems, third-party platforms, and cloud services. Your core focus will be developing and maintaining APIs and backend services that enable data ingestion, transformation, and delivery across our enterprise architecture. You’ll collaborate with cross-functional teams to ensure data is available where and when it’s needed—reliably, efficiently, and in compliance with strict regulatory … over 5 years of relevant experience, a solid understanding of software system design, and a strong command of C# and modern API development patterns. A background in working with data systems, cloud integrations, and secure, large-scale applications will be highly advantageous. Responsibilities: Design, develop, and maintain scalable APIs and backend services to facilitate data flow between systems. More ❯

Audit Technology Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Audit Technology Product Owner (Technology and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need expertise on the … someone who is confident on the business side with the ability to get the best out of Audit Teams speaking Audit language! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … being said, we need DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

AI Tech Start Up - Junior Data Scientist - Remote Based London £30,000 - £50,000 Robret Half have partnered with an early stage high potential AI focused Tech Start-Up who aree looking for a Junior Data Scientist to join their growing team and help develop advanced machine learning models that predict and prevent equipment failures in large-scale … industrial operations. This is an exciting opportunity to apply data science to real-world engineering challenges , using rich, high-frequency data from complex machinery. Their AI-driven predictive maintenance platform is built on years of operational data and designed to help clients reduce downtime, improve efficiency, and make data-backed maintenance decisions. Delivered via a secure … very early stage which is uniquely positioned for rapid growth! What You'll Do Build, validate, and monitor machine learning models for anomaly detection and failure prediction. Analyze sensor data and operational logs to support predictive maintenance strategies. Develop and maintain data pipelines using tools like Apache Airflow for efficient workflows. Use MLflow for experiment tracking, model versioning More ❯

design, implement, and scale the infrastructure that supports high-performance machine learning and AI-driven research workflows . You will play a critical role in bridging the gap between data science, bioinformatics, and engineering — ensuring seamless, secure, and reproducible deployment of ML models in production and research environments. You’ll collaborate closely with AI Scientists, Data Engineers, and … Terraform, Kubernetes, Docker , and CI/CD toolchains (GitHub Actions, Jenkins, Argo, etc.). Manage scalable cloud-based compute environments (Oracle Cloud, AWS, or GCP) for AI workloads and data processing. Build and maintain feature stores, model registries, and versioning systems to ensure traceability and reproducibility. Implement data ingestion and pre-processing pipelines to support ML and … infrastructure optimization. Monitor model and system performance, implement drift detection, and refine automated retraining pipelines. Contribute to the development of a modular, reusable ML platform architecture supporting multi-modal data (genomic, clinical, imaging, etc.). Essential Skills and Experience Proven experience as an MLOps Engineer, Platform Engineer, or DevOps Engineer supporting ML or data science teams. Strong hands More ❯

transform how clients in nuclear, defence, water and beyond manage critical infrastructure. Work with the Best: Collaborate daily with a vibrant, multi-disciplinary team of consultants including geospatial experts, data scientists and engineers, sharing ideas and driving innovation across the globe. Cutting-Edge Technology: Get hands-on with the full Esri product suite (ArcGIS Pro, Enterprise, AGOL), Microsoft Azure … Learning, thrive in dynamic teams and want to make a real-world impact with geospatial technology, we want to hear from you. The role will involve contributions across Geospatial & Data Engineering, AI & Innovation, and Collaboration & Leadership: Collaborating with Tetra Techs digital solutions teams across the globe. Leverage and fine-tune foundation models and AI/ML techniques to advance … Management Business Unit. Mentor colleagues in best practices and support them in identifying opportunities to apply technology for automation and workflow optimisation. Develop user-friendly tools and analyses, automating data ingestion, transformation, and loading using Python. Build reproducible workflows and apply software engineering best practices, including CI/CD and version control. Design, implement and optimise business Extract More ❯

is a great opportunity for a highly skilled VBA Developer to support a strategic client engagement. We are looking for candidates who can deliver robust, scalable VBA solutions across data automation, Excel integration, and workflow optimisation. Job Requirements Key Responsibilities Design and develop modular, maintainable VBA codebases within Excel and other Microsoft Office applications. Automate data processing tasks … and reporting workflows using advanced VBA scripting. Implement field-level and cross-file data validation checks to ensure data integrity and consistency. Integrate VBA solutions with external data sources (e.g., databases, web services) using OLEDB/ADO. Collaborate with IT and business teams to deploy and maintain solutions in production environments. Manage version control and documentation for … Core VBA Development Advanced proficiency in VBA for Excel, Access, and Outlook. Strong understanding of error handling and debugging techniques. Experience in modular code design for scalability and maintainability. Data Handling & Transformation Expertise in automating bulk data ingestion and transformation within Excel. Familiarity with schema validation, cleansing routines, and dynamic reporting. Experience with rule-based logic and More ❯

Role Title: Salesforce Data Cloud Technical Architect Location: London/Manchester/Leeds/Birmingham Salary: Competitive salary and package dependent on experience Career Level: Associate Manager to Manager Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these services. … global team, you'll be working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. As a Salesforce Data Cloud Technical Architect, you will: Work as part of an integrated Accenture and client team, defining, architecting, designing, delivering and deploying Data Cloud based solutions to our clients … Design and implement end-to-end data architectures across Salesforce Data Cloud and other Salesforce Core Clouds (Sales, Service, Marketing, Commerce), with a strong focus on data ingestion, unification, and scalable target activation. Drive creativity and innovation in solutions to deliver value for clients and Accenture Support pre-sales activities including shaping and presenting solutions, and More ❯

Run, GCS, BigQuery). Infrastructure as Code: Develop and manage cloud infrastructure using Terraform . Monitoring: Implement and monitor production metrics to ensure system health and identify bottlenecks. (Optional) Data & AI Integration: Contribute to data ingestion pipelines and the integration of large language models (LLMs). Must-Have Qualifications Experience: 5+ years in software development, including experience … Database Skills: High proficiency in SQL . Nice-to-Have Skills Direct production experience with FastAPI . Experience with Google Cloud Run and Kubernetes (GKE) . Familiarity with GCP data tools like BigQuery and Google Cloud Storage (GCS) . Experience building complex agentic AI applications (beyond basic RAG or LangChain implementations). How We Evaluate Candidates Our interview process More ❯

Azure Functions, and modern APIs (REST & GraphQL). Creating intuitive, responsive interfaces using ReactJS and React Native . Building secure, scalable integrations with IoT telemetry systems , ensuring real-time data ingestion, storage, and visualisation. Implementing modern DevOps practices, CI/CD pipelines, and observability tools to support high availability and performance. Collaborating directly with stakeholders to define requirements … front-end engineering. Solid understanding of Azure or similar cloud environments. Experience with RESTful and GraphQL APIs . Knowledge of DevOps, CI/CD , and automated testing. Familiarity with data modelling , SQL/NoSQL databases, and secure coding practices. (Desirable) Awareness of IoT concepts such as MQTT, Modbus, or Azure IoT Hub . Above all, youll bring curiosity, creativity More ❯

you: Strong coding and scripting skills (PowerShell, Python, Regex). Proven experience working with APIs (HTTP/S, JSON). Hands-on expertise with Splunk Enterprise Security-including upgrades, data ingestion, and optimisation. Experience with *Proxies administration, Windows (SMB) and Nix (NFS) storage, IIS configuration, and Active Directory/LDAP authentication. Proficiency in managing certificates, applying software updates More ❯