126 to 150 of 296 Data Pipeline Jobs in London

Data Analysis & Reporting: Extract, clean, and integrate data from a variety of systems (AWS, procurement systems, etc, Hardware Asset and Software Asset Management) to create accurate and insightful reports. Develop and maintain dashboards and visualisations in Tableau for use by the procurement category manager, stakeholders … executive team. Ensure data quality, accuracy, and consistency across all reports and analyses. AWS Reporting Integration: Utilize AWS reporting tools (such as Athena and Cost Explorer) to extract and manipulate data. Combine AWS data with other financial and procurement datasets to create holistic insights across ...

working with a leading global specialty insurer to recruit a data engineer into a high-profile analytics function supporting underwriting, portfolio management, and risk strategy across international markets. This is a genuinely embedded role within the underwriting business - not a back-office data function. … intersection of data engineering, advanced analytics, and insurance risk , helping to modernise platforms, automate workflows, and deliver best-in-class exposure and catastrophe insights. If you enjoy owning technical solutions end-to-end, influencing senior stakeholders, and working with complex insurance data, this role offers real ...

Role – Data Platform Architect Technology – Snowflake, SQL Server, Power BI, Azure, Confluent Location – London, UK Job Description We are seeking a seasoned Platform Lead to architect and manage enterprise data platforms across cloud and on-prem environments. The role demands deep expertise in Snowflake, SQL Server … Power BI, Azure, and Confluent technologies. You will lead platform strategy, administration, and integration to support scalable analytics and data engineering solutions. Responsibilities include performance optimization, governance, automation, and enabling secure, reliable data flows. This role requires strong leadership, cross-functional collaboration, and hands-on technical ...

Enhanced, willing to undergo STRAP, willing to work in London 5 days a week. Skills: Strong expertise in Python, Docker, Kubernetes and Data Governance, including air-gapped … working experience, managing dependencies and build pipelines without internet access, experience building APIs for data enrichment services, Orchestration and Data Pipeline experience with Prefect or Airflow and K8s or Swarm, experience with Configuration and Automation of business workflow tooling e.g. within Jira; experience with ...

hedge fund, is offering you the chance to join a small, high-impact team responsible for the firm's full suite of market data services, including real-time trading and pricing feeds and historical/licensed datasets for analytics, risk, and reporting. The team is undergoing a full … transformation to modernise and unify market data infrastructure, moving from legacy on-prem systems to AWS. Role Overview: This hands-on engineering role is ideal for a senior C# developer with experience in market data. You will help shape the architecture and direction of the firm ...

Product Analyst – Role Summary New Role: Product Data Analyst (SQL/Experimentation) £400–£500/day Inside IR35 6-Month Contract Hybrid - One day in office per week - Central London Requirements: - SQL and product analytics expert - Python for statistical modelling & data cleaning - A/B testing … experimentation design experience - Looker or Tableau - Understanding of ETL/data flows (GCP/AWS/Azure) - Start ASAP – short interview process. We are seeking a highly analytical and technically strong Product Analyst to support the development and optimisation of a logistics-focused simulation product, as well ...

/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration … Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integr click apply for full job details ...

Lead Data Engineer | Permanent | London (Hybrid) | £90,000 - £110,000 Snowflake * dbt * Fivetran * SQL * Tableau Are you an expert in automated data pipelines and ready to own a next-generation, enterprise data platform? Method Resourcing have partnered exclusively with a market-leading digital … creative technology organisation , backed by a global media network. This is a rare greenfield opportunity to design and deliver a modern data platform from scratch - at genuine enterprise scale. You will own the architecture, tooling, and delivery of a next-generation data stack, building scalable, trusted ...

scale and quality from larger tech organisations. Hands-On Full Stack Skills: Proficiency in React/Typescript and/or Python (RESTful APIs, data pipelines), plus comfort with deploying and maintaining services on modern cloud platforms (GCP preferred, AWS or Azure also fine). Applied AI/ ...

Full stack Data Engineer £45,000 to 65,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Full Stack Data Engineer - London (Hybrid) Up to £65,000 + Bonus | DOE | No Sponsorship Provided We are looking for talented Full Stack Data Engineers to join a fast-growing AI and data consultancy in London. Working across junior to senior levels, this is a hands-on role where you'll combine software engineering, data expertise, and AI to solve complex problems for clients across government, defence, healthcare ...

implementations for optimisation. Month 3: Design and implement a prototype model architecture, achieve quantifiable improvements in model performance metrics, and develop data pipeline components for large-scale training workflows. Month 6: Deploy an optimised foundation model meeting production requirements, implement algorithmic improvements reducing training time and memory … developing and debugging production-level code Desired Skills (Bonus Points): Proven experience in recommender systems, behavioural AI, and/or reinforcement learning. Building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). PhD in Computer Science, Machine Learning ...

Viva Consultant - £500PD Inside IR35 - Remote We're looking for a data professional who can define, design, and deliver a comprehensive analytics strategy for Microsoft Viva. This role goes beyond building reports from a predefined brief - you'll take ownership of Viva analytics end-to-end, partnering with … stakeholders to shape the right questions, define best-practice metrics, and translate data into meaningful insight and action. You'll act as a trusted advisor on how Viva data should be used to measure adoption, engagement, and business impact, while also rolling up your sleeves ...

Strong communication skills to collaborate with technical and military/non-technical stakeholders Experience integrating data from multiple sources into Foundry via Pipeline Builder and custom code Comfortable working on-site within a secure environment and at pace with end-users TO BE CONSIDERED... . Please either … submit your application to our client in conjunction with this vacancy only. KEY SKILLS: PALANTIR/FOUNDARY/DATA ENGINEER/PIPELINE BUILDER/ONTOLOGY/PYTHON/TYPESCRIPT/FULL STACK/DV CLEARED/LONDON/CONTRACT ...

Viva Consultant - £500PD Inside IR35 - Remote We're looking for a data professional who can define, design, and deliver a comprehensive analytics strategy for Microsoft Viva. This role goes beyond building reports from a predefined brief - you'll take ownership of Viva analytics end-to-end, partnering with … stakeholders to shape the right questions, define best-practice metrics, and translate data into meaningful insight and action. You'll act as a trusted advisor on how Viva data should be used to measure adoption, engagement, and business impact, while also rolling up your sleeves ...

Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this … query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting ...

DetailsRole/Job Title:MLOps Tech LeadWork Location:London, UKOffice Requirement (Hybrid):2 days per weekKey Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. All potential candidates should read through … following details of this job with care before making an application. Data Integration: Lead and provide xxuwjjq expertise on Integrate data from various sources, ensuring data consistency, integr... ...

numi is proud to partner with a growing global technology consultancy seeking multiple Mid/Senior/Principal Data Engineers to join their team in London on a hybrid basis. An idea of some of the hires we are making: 8 AWS Data Engineers 1 Cloud … Engineer AWS 2 Data Engineers with Oracle 5 Snowflake Engineers with AWS 2 Data Engineers with Azure This consultancy empowers some of the world's biggest businesses by delivering advanced data, AI, cloud, and digital solutions. They are committed to providing a platform ...

Senior Data Engineer £55,000-100,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent A leading AI and technology consultancy is looking for Senior Data Engineers to join their fast-growing team. This is a unique opportunity to apply your technical … expertise in AI, advanced analytics, and data engineering while shaping how organisations make decisions at scale. About the Role This is a hands-on, client-facing position where you'll lead technical delivery and act as a trusted advisor. You'll design and implement innovative solutions, build complex ...

core SaaS platform components across the stack: Backend: Python, PostgreSQL Frontend: TypeScript, NextJS/NodeJS Ensure smooth integration of AI tools, APIs, and data pipelines to enhance platform intelligence. Champion engineering best practices, including testing, CI/CD, and secure coding standards. Conduct regular code reviews and provide ...

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions. … Responsibilities Design and implement data pipelines on AWS using services such as Glue, Lambda, S3, and Redshift. Develop ETL processes and optimise data workflows for performance and security. Collaborate with analysts and architects to ensure compliance with government security standards. Troubleshoot and resolve issues in complex ...

Analytics Engineer London – Hybrid Up to £70,000 A data-driven business is expanding its analytics capability and is hiring an Analytics Engineer to help modernise its data platform during a period of growth. This role is focused on turning raw data into well … structured, reliable datasets that teams across the business can confidently use. You’ll help shape how data is modelled, surfaced and accessed, working closely with analysts and stakeholders to reduce friction, improve trust in numbers, and support better decision making at scale. The role: Build and maintain core ...

statistical and machine learning models using Azure ML. Optimize model performance and computational efficiency. Ensure that applications run smoothly and handle large-scare data efficiently. Implement and maintain monitoring of model drifts, data-quality alerts, scheduled r-training pipelines. Data Management and Preprocessing: Collect … clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. Work ...

Senior Snowflake Data Engineer - Hybrid - £85k-£100k About the Role I am looking for an experienced Senior Snowflake Data Engineer to join a dynamic team working on cutting-edge data solutions. This is an exciting opportunity to design, build, and optimise high-performance data pipelines using Snowflake, dbt, and modern engineering practices. If you are passionate about data engineering, test-driven development, and cloud technologies, we'd love to hear from you. Key Responsibilities Design, develop, and optimise scalable data pipelines in Snowflake. Build and maintain dbt models ...

Python Developer, Full Stack Engineer, Backend Engineer, Generative AI, LLM, LangChain, RAG, Microservices, CI/CD, GitHub Actions, AWS, GCP, Azure, Vector Databases, Data Pipelines, Applied AI, MLOps ...

develop, and maintain core components of the SaaS platform, including: Backend: Python, PostgreSQL Frontend: TypeScript, NextJS/NodeJS Integrate AI tools, APIs, and data pipelines to enhance platform intelligence. Uphold engineering best practices such as testing, CI/CD, and secure coding standards. Collaborate with the Head ...