1,076 to 1,100 of 1,160 Data Pipeline Jobs in the UK

act as a quantitative overlay on global equity trading operations. The engineering team's goal is to continually improve the entire ecosystem-spanning data, research, trading, and post-trade analytics. As a Principal Engineer, you will own end-to-end delivery of new features and projects, engaging in … other engineering teams to build a robust and scalable CRB platform. Responsibilities: Platform Development: Enhance and maintain the CRB ecosystem, including research tools, data pipelines, trading frameworks, back-testing infrastructure, and post-trade analysis systems. End-to-End Project Ownership: Collaborate with stakeholders to define requirements, design solutions … Optimization: Identify and fix performance bottlenecks in multi-threaded systems, ensuring high availability and low latency. Technical Exploration: Investigate emerging technologies-particularly in data analysis and machine learning-and adapt them to evolving platform needs. Ideal Candidate Background: Experience: 7+ years of professional software development with exposure to More ❯

act as a quantitative overlay on global equity trading operations. The engineering team's goal is to continually improve the entire ecosystem-spanning data, research, trading, and post-trade analytics. As a Principal Engineer, you will own end-to-end delivery of new features and projects, engaging in … other engineering teams to build a robust and scalable CRB platform. Responsibilities: Platform Development: Enhance and maintain the CRB ecosystem, including research tools, data pipelines, trading frameworks, back-testing infrastructure, and post-trade analysis systems. End-to-End Project Ownership: Collaborate with stakeholders to define requirements, design solutions … Optimization: Identify and fix performance bottlenecks in multi-threaded systems, ensuring high availability and low latency. Technical Exploration: Investigate emerging technologies-particularly in data analysis and machine learning-and adapt them to evolving platform needs. Ideal Candidate Background: Experience: 7+ years of professional software development with exposure to More ❯

of contact for clients; build trusted relationships and identify additional consulting opportunities. Solution Architecture: Design scalable, secure, and cost-effective Databricks architectures and data pipelines, often integrated with Azure, AWS, or GCP environments. Practice Development: Help define best practices, reusable frameworks, internal assets, and accelerators around Databricks usage. … Team Management: Mentor junior consultants and data engineers, lead small project teams, and help recruit top talent as we grow. Technical Delivery: Provide hands-on support with Databricks notebooks, Delta Lake, Spark optimization, MLflow integration, and related areas when necessary. Business Development Support: Partner with sales and leadership More ❯

of contact for clients; build trusted relationships and identify additional consulting opportunities. Solution Architecture: Design scalable, secure, and cost-effective Databricks architectures and data pipelines, often integrated with Azure, AWS, or GCP environments. Practice Development: Help define best practices, reusable frameworks, internal assets, and accelerators around Databricks usage. … Team Management: Mentor junior consultants and data engineers, lead small project teams, and help recruit top talent as we grow. Technical Delivery: Provide hands-on support with Databricks notebooks, Delta Lake, Spark optimization, MLflow integration, and related areas when necessary. Business Development Support: Partner with sales and leadership More ❯

eDV Infrastructure Engineer Are you interested in building scalable, secure cloud infrastructure? Do you thrive on developing efficient data pipelines and optimising data storage solutions? If so, keep reading... A industry leading technology company is seeking an Infrastructure Engineer to join their team. This role offers … client. Salary - £50,000 Location - Cheltenham Key Responsibilities: Design, implement, and maintain scalable AWS infrastructure using Infrastructure as Code principles Develop and optimise data pipelines using technologies such as Spark, Python, and Java Collaborate with software engineers to align infrastructure with application needs Monitor and troubleshoot data More ❯

Full Stack Engineer (Data Team - Mid or Senior Level) PolyAI automates customer service through lifelike voice assistants that let customers lead a conversation. Our voice assistants make it possible for businesses to deliver outstanding customer service that rivals their human agents. Our customers, which include the world's … one Mid level and one Senior level Full Stack Engineer with a strong backend focus to join our team and help shape our data processing pipelines and cutting-edge low-code platform. This role offers the opportunity to work end-to-end, from design to implementation, on creating … years experience. Proven Expertise in Python and SQL: Extensive experience building backend systems, with a strong understanding of REST APIs. Experience with designing data schemas, building and maintaining data pipelines/ETLs (familiarity with event-driven processing is a plus). Agile Practitioner: Familiarity with Agile More ❯

regulatory reporting requirements (FRTB IMA). Contribute to both end-of-day and real-time risk and P&L calculations. Build and maintain data pipelines for market data and pricing support. Work across teams to ensure alignment and deliver on business objectives. Key Skills: Python Equities … of pricing models and stochastic processes. Familiarity with risk measures such as VaR, P&L forecasting, and sensitivities. Desirable: Experience working with large data sets and distributed systems. Knowledge of Equity Derivatives and their pricing mechanisms. Advanced Excel skills and familiarity with CI/CD workflows. Degree in More ❯

regulatory reporting requirements (FRTB IMA). Contribute to both end-of-day and real-time risk and P&L calculations. Build and maintain data pipelines for market data and pricing support. Work across teams to ensure alignment and deliver on business objectives. Key Skills: Python Equities … of pricing models and stochastic processes. Familiarity with risk measures such as VaR, P&L forecasting, and sensitivities. Desirable: Experience working with large data sets and distributed systems. Knowledge of Equity Derivatives and their pricing mechanisms. Advanced Excel skills and familiarity with CI/CD workflows. Degree in More ❯

regulatory reporting requirements (FRTB IMA). Contribute to both end-of-day and real-time risk and P&L calculations. Build and maintain data pipelines for market data and pricing support. Work across teams to ensure alignment and deliver on business objectives. Key Skills: C++/… of pricing models and stochastic processes. Familiarity with risk measures such as VaR, P&L forecasting, and sensitivities. Desirable: Experience working with large data sets and distributed systems. Knowledge of Equity Derivatives and their pricing mechanisms. Advanced Excel skills and familiarity with CI/CD workflows. Degree in More ❯

regulatory reporting requirements (FRTB IMA). Contribute to both end-of-day and real-time risk and P&L calculations. Build and maintain data pipelines for market data and pricing support. Work across teams to ensure alignment and deliver on business objectives. Key Skills: C++/… of pricing models and stochastic processes. Familiarity with risk measures such as VaR, P&L forecasting, and sensitivities. Desirable: Experience working with large data sets and distributed systems. Knowledge of Equity Derivatives and their pricing mechanisms. Advanced Excel skills and familiarity with CI/CD workflows. Degree in More ❯

Software Developer - Customer Intelligence - Hybrid Nice to meet you! We're a leader in data and AI. Through our software and services, we inspire customers around the world to transform data into intelligence - and questions into answers. We're also a debt-free multi-billion-dollar … future, and how we can best support our customers both internal and external by leveraging the latest in Generative AI within our solutions. Data pipelines, orchestration and additional manipulation of data will fall within your scope of influence. You will contribute to various solutions driven by … high-quality, testable, and scalable software solutions within established timelines while adhering to CI360 best practices and processes. Ensure solutions meet the highest data security guidelines and are consistent with R&D standards. Develop multi-tenancy solutions that support multiple services and scale seamlessly. Expand knowledge of CI360 More ❯

to workflows to integrations Set up and manage the cloud infrastructure using AWS, Docker containerisation, and Infrastructure-as-Code with Terraform Build robust data integration infrastructure to connect the platform with various customer systems (TMS, RMS, etc.) and external APIs Implement the workflow orchestration layer to ensure reliable … building end-to-end platform solutions that integrate workflow orchestration systems (like Airflow, Temporal, AWS Step Functions) with real-world business processes and data pipelines Strong background in integration engineering and data modelling Exceptional Python skills for building APIs, services, and data processing pipelines More ❯

to workflows to integrations Set up and manage the cloud infrastructure using AWS, Docker containerisation, and Infrastructure-as-Code with Terraform Build robust data integration infrastructure to connect the platform with various customer systems (TMS, RMS, etc.) and external APIs Implement the workflow orchestration layer to ensure reliable … building end-to-end platform solutions that integrate workflow orchestration systems (like Airflow, Temporal, AWS Step Functions) with real-world business processes and data pipelines Strong background in integration engineering and data modelling Exceptional Python skills for building APIs, services, and data processing pipelines More ❯

Snowflake Data Engineer -£60,000 - £80,000 - Leeds Overview: We are seeking a Snowflake Data Engineer to help drive forward a fascinating greenfield project aiming to reinvent and build out a data platform from scratch. This is a demanding but rewarding project to be … part of a team of data experts in order to develop the capabilities of a global organisation and drive their continued growth. Working on this project will give you experience and expertise that will present limitless opportunities. You will develop and oversee Snowflake-based data pipelines … and implement effective solutions. You will optimise performance to ensure scalability and reliability and contribute to the establishment, growth and efficiency of the data platform. Requirements: Proven Snowflake experience Strong experience working within a cloud-based environment Ability to take initiative Strong stakeholder skills More ❯

TypeScript, React, and GraphQL to create intuitive interfaces for complex biological workflows. Build backend services that communicate with our hardware systems and ensure data integrity throughout the cell manufacturing process. If you've worked on microservices you already understand many of the challenges we face! Collaborate across disciplines … time. Leverage tooling and automated testing to deliver quality software at speed. Contribute to the core architecture of our systems, improving database performance, data integrity, API design, and distributed system reliability. Your experience with software resilience will help us build systems that gracefully handle unexpected scenarios. Must-have … synchronization, you already have relevant experience. Experience working with databases (PostgreSQL and Prisma or similar ORM experience ideal). Experience working with complex data and creating intuitive interfaces to manage it. Ability to work effectively in cross-functional teams. Strong communication skills and customer empathy. At least one More ❯

teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point … following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point … following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point … following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

innovation, and a willingness to challenge consensus. We are seeking a Senior Software Engineer to join our Unified Platform (UP) team. UP consolidates data and technologies into a comprehensive solution, accelerating time to market. Within UP, the Treasury team is responsible for building systems that efficiently allocate capital … work alone but prefer working as a team. You are passionate about providing business impact through technology. You are comfortable leading large, complex data projects end-to-end. You thrive on innovation and constantly seek new, creative solutions to existing problems. You care more about learning and problem … best solution. What you will be working on: You'll be helping DRW manage capital efficiently by developing and maintaining simple and robust data pipelines written mostly in Ruby, Python, and Clojure that perform complex analysis on firm and market data. You will architect and maintain highly resilient More ❯

to solve: creating a new GCP environment with a single-tenant approach developing a custom K8s operator to control compute resources for their data pipelines evolving their agent product which collects data from on-prem security tools You’ll succeed here if you have experience with More ❯

to solve: creating a new GCP environment with a single-tenant approach developing a custom K8s operator to control compute resources for their data pipelines evolving their agent product which collects data from on-prem security tools You’ll succeed here if you have experience with More ❯

seeking a Quantitative Analyst to join their central quant team. In this role, you'll support the quant team with research, programming, and data analysis in Python and SQL. Contribute to developing quantitative models, optimising portfolios, and enhancing data pipelines. Ideal candidates have 1-2 years … support quantitative models and investment decisions. Conduct research and statistical analysis for analysts and PMs. Develop portfolio optimisation tools and analytical models. Enhance data pipelines and automate processes. Qualifications: 1-2 years' experience in investment management. Bachelor's or Master's degree in a STEM discipline. Proficiency in More ❯

seeking a Quantitative Analyst to join their central quant team. In this role, you'll support the quant team with research, programming, and data analysis in Python and SQL. Contribute to developing quantitative models, optimising portfolios, and enhancing data pipelines. Ideal candidates have 1-2 years … support quantitative models and investment decisions. Conduct research and statistical analysis for analysts and PMs. Develop portfolio optimisation tools and analytical models. Enhance data pipelines and automate processes. Qualifications: 1-2 years' experience in investment management. Bachelor's or Master's degree in a STEM discipline. Proficiency in More ❯

and Xray Have deep knowledge on event driven systems using frameworks like Active MQ, Kafka, AWS Kinesis Have a working experience of AWS data pipelines, Glue, S3 and Glacier storage, file transfer solutions like Data Sync. If you are interested in this position and would like More ❯

NLP team, you'll own long-term projects to design and implement ML solutions for the Assisted Creation project, including building and recommending data pipelines. You'll work closely with the Product Manager to align with product needs, giving you the opportunity to shape its direction. Key Responsibilities … Include: Developing ML models, data pipelines, and evaluation frameworks, ensuring solutions are ready for deployment. Measuring the impact of your work using our data infrastructure and iterating as needed. Breaking down challenges into iterative, deliverable steps. What You'll Bring: A relevant PhD or an MSc More ❯