1 to 25 of 28 Permanent Data Ingestion Jobs in the South East

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance … project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain Key Responsibilities Architect and design end to end data solutions on Azure for insurance ...

Data Engineer Remote (Occasional Travel to Birmingham) Up to £75,000 + Benefits (12 Months FTC) Are you a hands-on Data Engineer who enjoys building, maintaining, and optimising modern data systems? We're working with a well-established UK business currently going through a major transition … period, and they're looking for a Data Engineer to help ensure their data platforms, models, and pipelines continue to run smoothly during this exciting phase of change. This is a home-based role with occasional travel to Birmingham - ideal for someone who enjoys autonomy, technical variety ...

Location London Business Area Data Ref # 10047915 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint a complete picture for our clients—around the clock and around the world. In Data, we are responsible … delivering this data, news, and analytics through innovative technology—quickly and accurately. We apply product thinking, domain expertise, and technical insight to continuously improve our data offerings, ensuring they remain reliable, scalable, and fit-for-purpose in a fast-changing landscape. Our Team The Private Deals Data ...

passionate about data quality and ready to shape the future of testing at a world-class institution? Join The Open University as a Test Engineer and play a pivotal role in delivering robust, reliable, and high-performing data solutions that support our strategic goals. About the Role … strategic use of data is fundamental to achieving the Open University’s institutional goals. Reporting to the Director of Data Technology within the CIO Portfolio, this pivotal Test Engineering role will focus on establishing and operating the Data Technology Capability at the Open University. This appointment requires ...

test. • Work with the team in all estimations and planning sessions, defining and creating test criteria. • Design, develop, and maintain automated test frameworks for data pipelines and data lake components. • Validate data ingestion, transformation, and storage processes across AWS services. • Collaborate with data engineers, developers … product teams to define test strategies and acceptance criteria. • Perform data quality checks, schema validations, and integrity testing on large datasets. • Monitor and troubleshoot test failures, data anomalies, and pipeline issues. • Contribute to CI/CD pipelines by integrating automated tests. • Document test plans, test cases ...

Senior Data Engineer | £80,000 | Hybrid & Remote Flexibility No Sponsorship Available I am currently partnering with an innovative technology company that is simplifying complex processes through cutting-edge data solutions. They are seeking a Senior Data Engineer to join their agile, collaborative team, where hybrid working … flexible schedules are the norm. The Role: As a Senior Data Engineer, you will be instrumental in evolving the company's data infrastructure, driving reliability, scalability, and insight. This is an end-to-end hands-on role where you will: Enhance the stability and performance of the data ...

Head of Data Engineering Our long-standing financial services client is seeking a Head of Data Engineering to lead a high-performing team responsible for delivering a complex data transformation.Looking for a true greenfield challenge? This is your chance to shape a transformation from the ground … build cutting-edge data solutions, and lead a high-performing team that’s driving change across the business.To succeed in this role, you’ll bring hands-on experience owning and delivering Azure-based data platforms (Databricks, Synapse), alongside strong technical capability in designing and implementing data ingestion ...

exciting opportunity to design and implement the infrastructure that powers advanced machine learning workflows in a production trading environment. Key Responsibilities: Feature Store & Data Lake: Build scalable infrastructure for time-series feature storage, retrieval, and versioning optimised for ML workloads. MLOps Pipelines: Design end-to-end workflows for data ingestion, feature engineering, model training, backtesting, and deployment. Data Ingestion Layer: Connect raw data streams into structured, queryable formats (Parquet/Delta Lake). Production Serving: Deploy feature computation and model inference with appropriate latency characteristics. Integration: Collaborate with existing data capture and execution ...

Role Summary Are you a hands‐on data engineer/analytics specialist who turns complex and evolving data into trusted business insight? Join Parker Aerospace’s Motion, Power & Sensing Division and help turn data into decisions that power mission‐critical actuators, power systems and sensors for aerospace … opportunity, suited for someone looking to collaborate across functions and influence key initiatives. Your responsibilities Design, build and operate ETL/ELT pipelines and data ingestion flows Author and optimise high‐performance SQL (queries, views, stored procedures) Build, deploy and maintain Power BI data models and reports ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Mainly Remote Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States … skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves ...

Working within our Cyber Data Services team, which is at the core of our Proactive Insurance product offering and CFC's promise to protect our policyholders from existing and emerging cyber security vulnerabilities and threats. You will play a key role in developing the company's competitive advantage … aggregating, presenting, and analysing large datasets. You will contribute to the development of our proprietary data platform and work to solve problems that are key to protecting our policyholders. Your contributions will have a material impact on the business as a whole where you will be expected to play ...

Fabric Consultant Location: Hybrid in London Salary: Up to 90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

defence, water and beyond manage critical infrastructure. Work with the Best: Collaborate daily with a vibrant, multi-disciplinary team of consultants including geospatial experts, data scientists and engineers, sharing ideas and driving innovation across the globe. Cutting-Edge Technology: Get hands-on with the full Esri product suite (ArcGIS … want to make a real-world impact with geospatial technology, we want to hear from you. The role will involve contributions across Geospatial & Data Engineering, AI & Innovation, and Collaboration & Leadership: Collaborating with Tetra Techs digital solutions teams across the globe. Leverage and fine-tune foundation models and AI/ ...

Role Title: Salesforce Data Cloud Technical Architect Location: London/Manchester/Leeds/Birmingham Salary: Competitive salary and package dependent on experience Career Level: Associate Manager to Manager Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology … working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. As a Salesforce Data Cloud Technical Architect, you will: Work as part of an integrated Accenture and client team, defining, architecting, designing, delivering and deploying Data Cloud ...

project plans, dependencies, and risk registers. Escalate complex requests to specialized engineering pods and track to closure. TECHNICAL IMPLEMENTATION & ENABLEMENT Provision and configure research, data, and trading environments (Python, AWS, Airflow, GitHub, Coder, etc.). Coordinate bespoke data ingestion (market, alternative, proprietary) via APIs, direct feeds … SaaS implementation roles, with 5+ years leading people or projects. Familiarity with Python, SQL, Linux, AWS/GCP, CI/CD, containerization, and modern data pipelines. Proven success in client onboarding, requirements gathering and workflow design for front office investment teams. Familiarity with market and alternative data sets ...

Senior AI Engineer In office ~x2 days a week This is a newly created opportunity to join a well-established data organisation that is investing in advanced AI capabilities to enhance data intelligence, automate research processes, and bring new value to their users. The team is building … from the ground up, combining deep software engineering rigour with cutting-edge machine learning and retrieval techniques. You will work at the intersection of data engineering, AI product development, and platform reliability. This role suits someone who enjoys building robust pipelines, working on modern LLM integrations, and applying ...

sustain our cutting edge ground-based software applications and services that support mission-critical operations. You'll also have the opportunity to work on data ingestion, processing and integration with back-end services and hardware systems. You'll partner closely with our product, systems, platform, data … reliable and performance oriented Integrate with existing software, simulators, test equipment, and external systems using well-defined contracts and protocols Implement and maintain data schemas, messaging, and event-driven integrations Establish unit, integration, and end-to-end tests Participate in sprint planning, code reviews, and design reviews; contribute ...

systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure … Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent ...

client, a large UK organisation is undertaking a greenfield implementation of Dynamics 365 Customer Insights Journeys and a new MarTech data environment. This role will lead the end-to-end design and build of a multi-channel customer engagement and insights platform. This is a high-impact position with … IR35. Lead D365 Customer Insights Journeys & MarTech Architect Key Responsibilities: Architect and implement D365 Customer Insights Journeys as the central orchestration platform. Develop a data-driven engagement model using Azure for profiling, segmentation and insight. Enable and integrate multi-channel communications, including: Web Push WhatsApp/RCS (via Twilio ...

Participate in industry events, conferences, and webinars to represent Dash0 and showcase technical excellence. Provide architecture guidance and best practices for observability setup, telemetry data modeling, and OpenTelemetry collector design. Internal Enablement and Thought Leadership Create and maintain reusable demo environments, reference architectures, and POC templates. Mentor peers … systems, and open-source tooling. Hard Skills Deep technical knowledge in Kubernetes, OpenTelemetry, observability pipelines, and distributed tracing. Hands-on experience with instrumentation, telemetry data ingestion, and performance optimization. Strong understanding of modern DevOps, SRE, and platform engineering practices. Familiarity with CRM tools (Salesforce, HubSpot) for collaboration ...

REST & GraphQL). Creating intuitive, responsive interfaces using ReactJS and React Native . Building secure, scalable integrations with IoT telemetry systems , ensuring real-time data ingestion, storage, and visualisation. Implementing modern DevOps practices, CI/CD pipelines, and observability tools to support high availability and performance. Collaborating directly … Azure or similar cloud environments. Experience with RESTful and GraphQL APIs . Knowledge of DevOps, CI/CD , and automated testing. Familiarity with data modelling , SQL/NoSQL databases, and secure coding practices. (Desirable) Awareness of IoT concepts such as MQTT, Modbus, or Azure IoT Hub . Above ...