Data Pipeline Jobs in London

626 to 650 of 980 Data Pipeline Jobs in London

Front Office Python Developer | *Metals Trading Desk* | £950/Day Inside IR35 | 6 months rolling | Hybrid 2 days London

london (city of london), south east england, united kingdom
Hybrid / WFH Options
VirtueTech Recruitment Group
physical trading teams. The role will focus on building and improving a modern metals trading analytics & visualisation platform. You’ll deliver production-grade Python systems, dashboards, automation and data pipelines that provide traders and risk teams with fast, reliable insights to support trading and risk decision-making. 📍 6 month rolling contract (strong likelihood of multi-year renewals) 💸 Rate … services and ETL pipelines for trading analytics. Build and enhance dashboards and visualisations (Grafana or equivalent) for traders and risk teams. Implement analytics, aggregation and automation to improve data quality, latency and reporting. Work closely with traders, risk, and data engineers to translate business requirements into reliable software. Contribute to deployment, CI/CD, containerisation and … services. Help maintain documentation, tests and runbooks for production systems. Technical/professional skills (essential) Strong production Python experience (3+ years at senior level). Proven experience with data engineering/ETL and time-series or market data. Experience building dashboards/visualisations — Grafana highly preferable . Solid SQL skills and working knowledge of databases (Postgres, TimescaleDB or More ❯
Posted:

Head of Data Engineering & Architecture

London Area, United Kingdom
Hybrid / WFH Options
Fynity
Head of Data Engineering & Architecture Security Clearance: SC Required | Remote (with occasional travel) | Initial Term: 3 Months Are you a data leader who thrives on turning complex challenges into elegant, scalable solutions? We’re looking for a Head of Data Engineering & Architecture to lead delivery across multiple high-impact programmes for a major public … sector organisation . In this role, you’ll define and execute the data engineering strategy, oversee technical delivery across multiple streams, and drive innovation in data platforms, architecture, and analytics. What You’ll Do Lead the design and delivery of enterprise data platforms, ensuring technical excellence and alignment with business goals Oversee teams across … Data Engineering, Architecture, Analytics, and Science Champion innovation and continuous improvement across all data delivery streams Collaborate with senior stakeholders to deliver impactful, data-driven outcomes Shape the roadmap for scalable, secure, and high-performing data ecosystems Technical Expertise This role extends beyond any single tech stack — you’ll be empowered to More ❯
Posted:

Head of Data Engineering & Architecture

City of London, London, United Kingdom
Hybrid / WFH Options
Fynity
Head of Data Engineering & Architecture Security Clearance: SC Required | Remote (with occasional travel) | Initial Term: 3 Months Are you a data leader who thrives on turning complex challenges into elegant, scalable solutions? We’re looking for a Head of Data Engineering & Architecture to lead delivery across multiple high-impact programmes for a major public … sector organisation . In this role, you’ll define and execute the data engineering strategy, oversee technical delivery across multiple streams, and drive innovation in data platforms, architecture, and analytics. What You’ll Do Lead the design and delivery of enterprise data platforms, ensuring technical excellence and alignment with business goals Oversee teams across … Data Engineering, Architecture, Analytics, and Science Champion innovation and continuous improvement across all data delivery streams Collaborate with senior stakeholders to deliver impactful, data-driven outcomes Shape the roadmap for scalable, secure, and high-performing data ecosystems Technical Expertise This role extends beyond any single tech stack — you’ll be empowered to More ❯
Posted:

Data Engineer (Technology Analyst) | Macro Hedge Fund

City Of London, England, United Kingdom
Selby Jennings
A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … s technology infrastructure as it scales. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯
Posted:

Data Engineer (Technology Analyst) | Macro Hedge Fund

london, south east england, united kingdom
Selby Jennings
A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … s technology infrastructure as it scales. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯
Posted:

Data Engineer (Technology Analyst) | Macro Hedge Fund

london (city of london), south east england, united kingdom
Selby Jennings
A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … s technology infrastructure as it scales. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯
Posted:

Data Engineer (Technology Analyst) Macro Hedge Fund

London, United Kingdom
A fast-growing macro hedge fund is seeking a technically sharp and curious individual to join a high-impact team at the intersection of technology, data, and investment operations. Operating in a fast-paced, high-performance environment, the fund values autonomy, initiative, and smart problem-solving. This is a unique opportunity to work across all areas of the … find out, and make your application. About the Role This is a broad, hands-on position where you'll work directly with investment and operational teams to streamline data flows, automate processes, and enhance system efficiency. From day one, you'll be given real ownership of projects that span infrastructure, reporting, and tooling-making a tangible impact on … the fund's performance and scalability. Key Responsibilities Build and maintain robust data pipelines and automations using Python, SQL, and Excel/VBA Integrate external data feeds and APIs into internal systems and databases Develop dashboards and reporting tools to support trading, risk, and operations Manage infrastructure hosted on Microsoft Azure, including VMs and storage Use More ❯
Posted:

Python Developer - Remote Work (Permanent)

London, United Kingdom
Hybrid / WFH Options
Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our clients data infrastructure … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯
Posted:

Analyst, Security

London, United Kingdom
be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … challenges that affect national infrastructure and security at scale. &##Build and maintain scalable data pipelines within Palantir Foundry or Gotham &##Ingest, transform, and integrate both structured and unstructured sensitive data sources &##Enable secure access control, data modelling, and operational logic within highly classified environments &##Collaborate with multidisciplinary teams of analysts, engineers, and delivery experts … data-driven solutions &##Contribute to a long-term agile delivery roadmap for mission-critical national programmes &##Proven hands-on experience in Palantir Foundry or Gotham deployment, configuration, pipeline development Strong background in data engineering , analytics , or data architecture Coding experience in Python, SQL , or similar You'll be part of a trusted, delivery More ❯
Posted:

Senior Front Office Data Analytics Engineer

London Area, United Kingdom
NP Group
Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯
Posted:

Senior Front Office Data Analytics Engineer

City of London, London, United Kingdom
NP Group
Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯
Posted:

Senior Front Office Data Analytics Engineer

london, south east england, united kingdom
NP Group
Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯
Posted:

Senior Front Office Data Analytics Engineer

london (city of london), south east england, united kingdom
NP Group
Senior Data and Analytics Engineer - Front Office/FI London Excellent package plus bonus/benefits Overview You will work directly with the Front Office investment and trading teams to build, enhance, and support data and analytics infrastructure that powers research, trading, and portfolio decision-making. This is a hands-on, high-impact role at the … trading environment). Offer deep expertise in Python, with strong software engineering practices (version control, testing, CI/CD). Have a proven track record of building robust data pipelines in cloud-native environments (preferably AWS). Experience with Docker and container-based deployments. Strong knowledge of Snowflake and NoSQL databases (especially MongoDB). Solid understanding of financial … markets and instruments particularly Fixed Income (or may consider with an exposure to credit, rates, equities, options, etc. Experience with market data providers (Bloomberg, Refinitiv, etc.) would be useful Any familiarity with tools such as Airflow, prefect, or other orchestration frameworks would be advantageous. Experience building internal tools or dashboards using Dash, Streamlit, or similar web-based data More ❯
Posted:

Business Analyst – Data Insight & Impact

London Area, United Kingdom
Hybrid / WFH Options
RedCat Digital
Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … contract (minimum) with hybrid working 3 days per week in the London office, 2 days remote . ** MUST HAVE ** 1: Within your experience and clearly on your CV: Data Insight, what impact did you make. 2: We are looking for someone who can display on their CV that has analysed data they have pulled and can … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data More ❯
Posted:

Business Analyst – Data Insight & Impact

City of London, London, United Kingdom
Hybrid / WFH Options
RedCat Digital
Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … contract (minimum) with hybrid working 3 days per week in the London office, 2 days remote . ** MUST HAVE ** 1: Within your experience and clearly on your CV: Data Insight, what impact did you make. 2: We are looking for someone who can display on their CV that has analysed data they have pulled and can … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data More ❯
Posted:

Artificial Intelligence Engineer

London, UK
Hybrid / WFH Options
Intellect Group
for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯
Posted:

Artificial Intelligence Engineer

City of London, Greater London, UK
Hybrid / WFH Options
Intellect Group
for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯
Posted:

Artificial Intelligence Engineer

london, south east england, united kingdom
Hybrid / WFH Options
Intellect Group
for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯
Posted:

Artificial Intelligence Engineer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Intellect Group
for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯
Posted:

Lead Software Engineer, back end (L5/6)

London, United Kingdom
Hybrid / WFH Options
The Hub/Danske Bank
problem that you're solving, and you will have the opportunity to shape the direction of the product. You will evaluate your own work, leveraging our data pipeline and frameworks that we have established to understand the impact your features have on our commercial objectives and pivoting where necessary. You will consider the long-term direction of More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Databricks Engineer

London Area, United Kingdom
Capgemini
us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance … and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of More ❯
Posted:

Databricks Engineer

City of London, London, United Kingdom
Capgemini
us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance … and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of More ❯
Posted:

Palantir Engineers Shape the Future of National Security - London/Reading/Thames Valley

City of London, Greater London, UK
Areti Group | B Corp
be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. Were seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world challenges … Be Doing Youll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, youll: Build and maintain scalable data pipelines within Palantir Foundry or Gotham Ingest, transform, and integrate both structured and unstructured sensitive data sources Enable secure access control, data modelling, and operational … interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: Proven hands-on experience in Palantir Foundry or Gotham deployment, configuration, pipeline development Strong background in data engineering , analytics , or data architecture Coding experience in Python, SQL , or similar Experience delivering in secure , high-stakes, or classified More ❯
Employment Type: Part-time
Posted:

Palantir Engineers – Shape the Future of National Security - London/Reading/Thames Valley

london, south east england, united kingdom
Areti Group | B Corp™
be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational … interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands-on experience in Palantir Foundry or Gotham – deployment, configuration, pipeline development ✅ Strong background in data engineering , analytics , or data architecture ✅ Coding experience in Python, SQL , or similar ✅ Experience delivering in secure , high-stakes, or classified More ❯
Posted:

Palantir Engineers – Shape the Future of National Security - London/Reading/Thames Valley

london (city of london), south east england, united kingdom
Areti Group | B Corp™
be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational … interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands-on experience in Palantir Foundry or Gotham – deployment, configuration, pipeline development ✅ Strong background in data engineering , analytics , or data architecture ✅ Coding experience in Python, SQL , or similar ✅ Experience delivering in secure , high-stakes, or classified More ❯
Posted:
Data Pipeline
London
10th Percentile
£46,000
25th Percentile
£61,250
Median
£80,000
75th Percentile
£97,500
90th Percentile
£122,500