26 to 39 of 39 Data Ingestion Jobs in London

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Python Data Engineer Azure & PySpark - SC Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high … quality, test-driven code in a cloud environment. What youll do Build and maintain Python/PySpark pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. ...

SageMaker , with GenAI/agentic capabilities embedded into the platform. You will also lead a team of four developers and collaborate closely with data engineering, data science and platform teams. Assignment Details Initial Duration : 6 months (strong likelihood of extension) Location : Hybrid/London Day Rate : £flexible PAYE … GitLab CI/CD Extensive Docker containerisation & runtime experience Strong understanding of AWS SageMaker deployments Experience building developer environments for ML/quant/data-intensive workflows Knowledge of monitoring, logging, reporting and test automation Proven team leadership of small development teams Strong understanding of data ingestion ...

Possess 15 plus years of work experience at a reputable Data & AI services firm. Outstanding written and verbal communication skills, with a flair for compelling storytelling. Analyse complex insurance data to identify trends, patterns, and insights that support strategic business decisions. Design and implement an enterprise-grade Data Vault 2.0 architecture on Snowflake, ensuring scalability, flexibility, and auditability. Lead the end-to-end data architecture design, from data ingestion through transformation to reporting layers. ...

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … test-driven code delivery.Key Responsibilities Develop and maintain data ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data ...

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … test-driven code delivery. Key Responsibilities Develop and maintain data ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental ...

project plans, dependencies, and risk registers. Escalate complex requests to specialized engineering pods and track to closure. TECHNICAL IMPLEMENTATION & ENABLEMENT Provision and configure research, data, and trading environments (Python, AWS, Airflow, GitHub, Coder, etc.). Coordinate bespoke data ingestion (market, alternative, proprietary) via APIs, direct feeds … SaaS implementation roles, with 5+ years leading people or projects. Familiarity with Python, SQL, Linux, AWS/GCP, CI/CD, containerization, and modern data pipelines. Proven success in client onboarding, requirements gathering and workflow design for front office investment teams. Familiarity with market and alternative data sets ...

Senior AI Engineer In office ~x2 days a week This is a newly created opportunity to join a well-established data organisation that is investing in advanced AI capabilities to enhance data intelligence, automate research processes, and bring new value to their users. The team is building … from the ground up, combining deep software engineering rigour with cutting-edge machine learning and retrieval techniques. You will work at the intersection of data engineering, AI product development, and platform reliability. This role suits someone who enjoys building robust pipelines, working on modern LLM integrations, and applying ...

systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure … Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent ...

standards, and source code. Monitor licences, permissions, and security roles. Analyse service logs for security anomalies and manage Microsoft support cases. Ensure compliance with data retention policies and relevant legislation. Promote health, safety, and equal opportunity policies in all duties. Professional Qualifications/Education Degree level or equivalent professional … licensing and SharePoint technologies. PowerShell scripting and Azure DevOps/GitHub experience (desirable). Essential Skills Strong Dynamics 365 experience- Customer Insights - Data & Journey and Dynamics 365 Sales . Knowledge of out-of-the-box CRM configuration and customization. Experience integrating Dynamics 365 with third-party systems using Dataverse ...

standards, and source code. Monitor licences, permissions, and security roles. Analyse service logs for security anomalies and manage Microsoft support cases. Ensure compliance with data retention policies and relevant legislation. Promote health, safety, and equal opportunity policies in all duties. Professional Qualifications/Education Degree level or equivalent professional … licensing and SharePoint technologies. PowerShell scripting and Azure DevOps/GitHub experience (desirable). Essential Skills Strong Dynamics 365 experience, preferably Customer Insights – Data & Journey and Dynamics 365 Sales . Knowledge of out-of-the-box CRM configuration and customization. Experience integrating Dynamics 365 with third-party systems using ...

client, a large UK organisation is undertaking a greenfield implementation of Dynamics 365 Customer Insights Journeys and a new MarTech data environment. This role will lead the end-to-end design and build of a multi-channel customer engagement and insights platform. This is a high-impact position with … IR35. Lead D365 Customer Insights Journeys & MarTech Architect Key Responsibilities: Architect and implement D365 Customer Insights Journeys as the central orchestration platform. Develop a data-driven engagement model using Azure for profiling, segmentation and insight. Enable and integrate multi-channel communications, including: Web Push WhatsApp/RCS (via Twilio ...

Participate in industry events, conferences, and webinars to represent Dash0 and showcase technical excellence. Provide architecture guidance and best practices for observability setup, telemetry data modeling, and OpenTelemetry collector design. Internal Enablement and Thought Leadership Create and maintain reusable demo environments, reference architectures, and POC templates. Mentor peers … systems, and open-source tooling. Hard Skills Deep technical knowledge in Kubernetes, OpenTelemetry, observability pipelines, and distributed tracing. Hands-on experience with instrumentation, telemetry data ingestion, and performance optimization. Strong understanding of modern DevOps, SRE, and platform engineering practices. Familiarity with CRM tools (Salesforce, HubSpot) for collaboration ...

Quantitative Developer – Crypto (C++) | Systematic Trading | DeFi & On-Chain Data I'm currently partnered with a top-tier global quantitative & systematic trading firm that is scaling its Crypto engineering and research group. This is a unique opportunity to join a high-impact quant technology team building the next generation … Crypto desk, you will: Build and enhance the quant technology stack that powers systematic crypto trading. Develop front-office systems across the entire pipeline: data ingestion, risk, live trading, post-trade, and core infrastructure. Work hand-in-hand with traders and quants to deploy, support, and automate ...