676 to 700 of 980 Data Pipeline Jobs in London

Up to 125,000 base + bonus & benefits A leading global consulting and analytics firm is seeking a Databricks Architect to drive architecture and delivery of large-scale data solutions for their commercial insurance clients. This is a senior role, shaping data strategy and modernising platforms that underpin underwriting, claims, and pricing. Key Responsibilities Lead end … to-end architecture and solution design across Databricks and Azure cloud ecosystems. Build scalable lakehouse architectures, advanced analytics, and AI/ML data pipelines. Work closely with insurance stakeholders to translate business needs into technical solutions. Ensure best practices in data governance, security, and regulatory compliance. Provide technical leadership to engineering teams and contribute to architecture … standards. Skills & Experience Proven experience as a Data/Solution Architect with strong expertise in Databricks (Delta Lake, MLflow, Spark) . Deep understanding of commercial insurance processes (underwriting, claims, personal/specialty lines). Strong background in Azure (Synapse, Data Factory, Fabric) or similar cloud data platforms. Knowledge of data governance, integration More ❯

Up to £125,000 base + bonus & benefits A leading global consulting and analytics firm is seeking a Databricks Architect to drive architecture and delivery of large-scale data solutions for their commercial insurance clients. This is a senior role, shaping data strategy and modernising platforms that underpin underwriting, claims, and pricing. Key Responsibilities Lead end … to-end architecture and solution design across Databricks and Azure cloud ecosystems. Build scalable lakehouse architectures, advanced analytics, and AI/ML data pipelines. Work closely with insurance stakeholders to translate business needs into technical solutions. Ensure best practices in data governance, security, and regulatory compliance. Provide technical leadership to engineering teams and contribute to architecture … standards. Skills & Experience Proven experience as a Data/Solution Architect with strong expertise in Databricks (Delta Lake, MLflow, Spark) . Deep understanding of commercial insurance processes (underwriting, claims, personal/specialty lines). Strong background in Azure (Synapse, Data Factory, Fabric) or similar cloud data platforms. Knowledge of data governance, integration More ❯

Up to £125,000 base + bonus & benefits A leading global consulting and analytics firm is seeking a Databricks Architect to drive architecture and delivery of large-scale data solutions for their commercial insurance clients. This is a senior role, shaping data strategy and modernising platforms that underpin underwriting, claims, and pricing. Key Responsibilities Lead end … to-end architecture and solution design across Databricks and Azure cloud ecosystems. Build scalable lakehouse architectures, advanced analytics, and AI/ML data pipelines. Work closely with insurance stakeholders to translate business needs into technical solutions. Ensure best practices in data governance, security, and regulatory compliance. Provide technical leadership to engineering teams and contribute to architecture … standards. Skills & Experience Proven experience as a Data/Solution Architect with strong expertise in Databricks (Delta Lake, MLflow, Spark) . Deep understanding of commercial insurance processes (underwriting, claims, personal/specialty lines). Strong background in Azure (Synapse, Data Factory, Fabric) or similar cloud data platforms. Knowledge of data governance, integration More ❯

minimum two days per week) Type: Full time, Permanent SC Eligibility Required Joining Our Mission Shape the future. Make an impact. At QuantSpark, pioneering the strategic application of data, analytics, and AI is at the heart of our work. We empower businesses and government to thrive, not just for profits, but for measurable human and societal benefit. This … Driving technological transformation and efficiency across verticals. The Role In this role, you'll be responsible for designing, developing, and maintaining scalable AI systems using machine learning and data-driven approaches. You'll integrate ML models into production-ready AI solutions while collaborating closely with data scientists, software engineers, and product teams. Monitor and optimise model … version control and scalable code design. You bring practical experience designing, training, and evaluating machine learning models, including deep learning and statistical optimisation. You are proficient in developing data pipelines for large, complex datasets using Python, SQL, NoSQL, and big data tools, preferably on AWS or Azure. You have hands-on experience with LLM operations and More ❯

AI Tech Start Up - Junior Data Scientist - Remote Based London £30,000 - £50,000 Robret Half have partnered with an early stage high potential AI focused Tech Start-Up who aree looking for a Junior Data Scientist to join their growing team and help develop advanced machine learning models that predict and prevent equipment failures in … large-scale industrial operations. This is an exciting opportunity to apply data science to real-world engineering challenges , using rich, high-frequency data from complex machinery. Their AI-driven predictive maintenance platform is built on years of operational data and designed to help clients reduce downtime, improve efficiency, and make data-backed … early stage which is uniquely positioned for rapid growth! What You'll Do Build, validate, and monitor machine learning models for anomaly detection and failure prediction. Analyze sensor data and operational logs to support predictive maintenance strategies. Develop and maintain data pipelines using tools like Apache Airflow for efficient workflows. Use MLflow for experiment tracking, model More ❯

product, scale the platform, and push the limits of cloud security tech. Youll join a world-class team solving complex engineering challenges - from distributed systems and large-scale data pipelines to real-time detection and automation. Every line of code you write will have real impact. Theyre after someone who: Has solid OOP experience (Python, Java, Go, or More ❯

product, scale the platform, and push the limits of cloud security tech. Youll join a world-class team solving complex engineering challenges - from distributed systems and large-scale data pipelines to real-time detection and automation. Every line of code you write will have real impact. Theyre after someone who: Has solid OOP experience (Python, Java, Go, or More ❯

Role Title: ETRM Data Modeler Work mode: Hybrid, 3 days WFO Contract duration: 12 Months Location: London Key Accountabilities: Knowledge and experience in global energy markets with the ability to identify and prioritize fundamental and quantitative analysis/modelling that provides commercial insights to the trading organization. Strong communication skills with the ability to communicate analytics to necessary … Excellent problem-solving skills. Experience using a coding language to develop models and analytical tools. Experience manipulating and analyzing large, complex datasets. Desirable Experience & Skills Practical knowledge of data engineering practices (designing and building robust data pipelines) Knowledge of python and core libraries applicable to data science (e.g., pandas, numpy, statsmodel More ❯

enterprise-scale systems. Role & Responsibilities: Lead the design and delivery of enterprise applications and reporting systems Develop tools for dashboards, analytics, and operational monitoring Build and maintain APIs, data pipelines, and automation for business processes Implement scalable solutions to improve operational efficiency and data quality Enhance and integrate commercial off-the-shelf (COTS) platforms where required … automation, and Agile delivery Knowledge of compliance, regulatory reporting, and enterprise operational processes Proven experience delivering complex software solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS platforms Package: £85,000 15% non-contributory pension Hybrid working (3 days per week) Performance-based bonus scheme Comprehensive benefits More ❯

enterprise-scale systems. Role & Responsibilities: Lead the design and delivery of enterprise applications and reporting systems Develop tools for dashboards, analytics, and operational monitoring Build and maintain APIs, data pipelines, and automation for business processes Implement scalable solutions to improve operational efficiency and data quality Enhance and integrate commercial off-the-shelf (COTS) platforms where required … automation, and Agile delivery Knowledge of compliance, regulatory reporting, and enterprise operational processes Proven experience delivering complex software solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS platforms Package: £85,000 15% non-contributory pension Hybrid working (3 days per week) Performance-based bonus scheme Comprehensive benefits More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

Multiple Data Engineers/Scientists/Engineers Needed Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. Salary: 55,000 100,000 + Bonus + Equity Options Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well-funded tech … start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly with plans to grow by 40 heads this year and this is your chance to be a part of something big from the ground up. We are … working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies Ideal Candidate: Already More ❯

Multiple Data Engineers/Scientists/Engineers Needed 📍 Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. 💸 Salary: £55,000 – £100,000 + Bonus + Equity Options 🛡️ Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well-funded tech … start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly – with plans to grow by 40 heads this year – and this is your chance to be a part of something big from the ground up. We are … working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . 🔧 Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies ✅ Ideal Candidate: Already More ❯

Multiple Data Engineers/Scientists/Engineers Needed 📍 Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. 💸 Salary: £55,000 – £100,000 + Bonus + Equity Options 🛡️ Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well-funded tech … start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly – with plans to grow by 40 heads this year – and this is your chance to be a part of something big from the ground up. We are … working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . 🔧 Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies ✅ Ideal Candidate: Already More ❯

Multiple Data Engineers/Scientists/Engineers Needed Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. Salary: £55,000 £100,000 + Bonus + Equity Options Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well … funded tech start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly with plans to grow by 40 heads this year and this is your chance to be a part of something big from the ground up. … We are working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies Ideal More ❯

Job Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the continued growth of a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting-edge … data science with powerful location intelligence, they help major organisations make smarter, faster decisions. Backed by top-tier investors and growing fast, this is your chance to shape the future of PropTech from the inside. The Role Requirements: As a Senior Data Scientist, you’ll develop, deploy, and optimise data science solutions that sit … at the heart of the company’s product offerings. You’ll play a critical role in shaping how data-driven insights fuel smarter decisions across the business. What you’ll be doing: Spotting opportunities to apply data science and ML to solve meaningful product challenges Designing and building data pipelines to support experimentation and More ❯

Job Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the continued growth of a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting-edge … data science with powerful location intelligence, they help major organisations make smarter, faster decisions. Backed by top-tier investors and growing fast, this is your chance to shape the future of PropTech from the inside. The Role Requirements: As a Senior Data Scientist, you’ll develop, deploy, and optimise data science solutions that sit … at the heart of the company’s product offerings. You’ll play a critical role in shaping how data-driven insights fuel smarter decisions across the business. What you’ll be doing: Spotting opportunities to apply data science and ML to solve meaningful product challenges Designing and building data pipelines to support experimentation and More ❯

Job Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the continued growth of a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting-edge … data science with powerful location intelligence, they help major organisations make smarter, faster decisions. Backed by top-tier investors and growing fast, this is your chance to shape the future of PropTech from the inside. The Role Requirements: As a Senior Data Scientist, you’ll develop, deploy, and optimise data science solutions that sit … at the heart of the company’s product offerings. You’ll play a critical role in shaping how data-driven insights fuel smarter decisions across the business. What you’ll be doing: Spotting opportunities to apply data science and ML to solve meaningful product challenges Designing and building data pipelines to support experimentation and More ❯

Job Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the continued growth of a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting-edge … data science with powerful location intelligence, they help major organisations make smarter, faster decisions. Backed by top-tier investors and growing fast, this is your chance to shape the future of PropTech from the inside. The Role Requirements: As a Senior Data Scientist, you’ll develop, deploy, and optimise data science solutions that sit … at the heart of the company’s product offerings. You’ll play a critical role in shaping how data-driven insights fuel smarter decisions across the business. What you’ll be doing: Spotting opportunities to apply data science and ML to solve meaningful product challenges Designing and building data pipelines to support experimentation and More ❯

hands-on role to deliver applications working with other staff and partners. Collaborate with cross-functional teams to design, develop, and implement scalable and reliable cloud applications. Utilize data science and analytics to enhance application functionality and performance. Work with the data team to create and deploy machine learning models and AI-driven solutions for real … development/integration. Familiarity with enterprise architecture design and delivery (Azure, GitHub, etc). Proven experience in building cloud applications using Microsoft Azure/cloud. Strong interest in data science and analytics. Excellent problem-solving skills and attention to detail. Knowledge of effective business analysis - ability to gather, document, and analyse business requirements effectively and the experience creating … solve Preferred Qualifications: Experience in manufacturing, retail or hospitality industries. Knowledge of other programming languages and frameworks. Interest and experience with AI solution engineering Interest and experience of data analytics and data pipelines. BENEFITS BAKED IN Free food and drink when working 50% off food and drink when not working 25 days holiday + Bank holiday More ❯

Senior Software Engineer (Data-Centric) Manchester or South London (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

Senior Software Engineer (Data-Centric) Manchester or South London (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯