1,001 to 1,025 of 1,246 Data Pipeline Jobs in the UK

secure, scalable, and compliant with internal governance. Act as a technical liaison, collaborating with third-party vendors to support their integration and master data management implementations. You will be able to define clear technical specifications and ensure work is delivered to a high standard. Work closely with architects … data engineers, and technical owners to ensure integrations align with enterprise architecture principles. Share knowledge with and mentor existing team members to strengthen integration capabilities within the development team. Implement all aspects of the integration lifecycle: secure design, development, error logging, debugging, monitoring, scalability, and testing. Develop Azure … based integration solutions using Logic Apps, Service Bus, Function Apps, API Management, and Data Factory. Build robust data pipelines and ETL solutions that support business processes and reporting needs. Conduct code reviews on other people's solutions to ensure quality, security, and maintainability. CANDIDATE PROFILE/ More ❯

secure, scalable, and compliant with internal governance. Act as a technical liaison, collaborating with third-party vendors to support their integration and master data management implementations. You will be able to define clear technical specifications and ensure work is delivered to a high standard. Work closely with architects … data engineers, and technical owners to ensure integrations align with enterprise architecture principles. Share knowledge with and mentor existing team members to strengthen integration capabilities within the development team. Implement all aspects of the integration lifecycle: secure design, development, error logging, debugging, monitoring, scalability, and testing. Develop Azure … based integration solutions using Logic Apps, Service Bus, Function Apps, API Management, and Data Factory. Build robust data pipelines and ETL solutions that support business processes and reporting needs. Conduct code reviews on other people's solutions to ensure quality, security, and maintainability. CANDIDATE PROFILE/ More ❯

than-real-time simulations to drive innovation in logistics, robotics, and beyond. You'll collaborate with a highly skilled team of engineers and data scientists to develop scalable ML models and deploy them into production environments using modern MLOps practices. If you're excited about solving real-world … dynamic environments. Implement and improve MLOps pipelines to support continuous training, deployment, monitoring, and scaling of machine learning models in production. Collaborate with data engineers and software developers to ensure seamless integration of machine learning models with existing infrastructure and data pipelines. Stay up to date … solutions (AWS, GCP, or Azure) to deploy and manage machine learning workloads in a scalable manner. Qualifications: Master's degree or Ph.D. in Data Science, Computer Science, Mathematics, or a related field. 4+ years of hands-on experience designing and deploying machine learning models in production, with a More ❯

users (trade entry, exchange interfaces, STP, etc) Designing new bespoke views Customising Trading System user interface using ClassEvents (C#.NET) Modifying the Trading System data model directly in the SQLServer database Enhancing test automation and ability to unit test custom code Developing customised applications (APIs, loaders, reports, data pipelines, BI tools) Quickly acquiring new technical skills (Azure IaaS/PaaS, Crystal Reports, Python, Azure Databricks, Azure Data Factory, Power BI, etc.) Requirements of the Senior Developer (ETRM) Proven experience within trading environments (hedge funds, investment banks, trading houses, asset managers, fintechs, trading vendors eg More ❯

users (trade entry, exchange interfaces, STP, etc) Designing new bespoke views Customising Trading System user interface using ClassEvents (C#.NET) Modifying the Trading System data model directly in the SQLServer database Enhancing test automation and ability to unit test custom code Developing customised applications (APIs, loaders, reports, data pipelines, BI tools) Quickly acquiring new technical skills (Azure IaaS/PaaS, Crystal Reports, Python, Azure Databricks, Azure Data Factory, Power BI, etc.) Requirements of the Senior Developer (ETRM) Proven experience within trading environments (hedge funds, investment banks, trading houses, asset managers, fintechs, trading vendors eg More ❯

Distinguished Engineer - AI & Data Science Department: Engineering Employment Type: Full Time Location: Glasgow Description Encompass enables fast, accurate identity validation and verification of corporate customers, and a gold standard approach to KYC. Our award-winning corporate digital identity (CDI) platform incorporates real-time data and documents … from authoritative global public data sources and private customer information, to create and maintain digital risk profiles. Utilizing the expertise of a global transformation team of KYC and banking industry experts, as well as strategic data, technology and consulting partnerships, enables seamless integration of Encompass into … the challenge. About the role We are seeking a visionary and technically hands-on Distinguished Engineer to define and execute our AI and data science strategy. You'll work at the intersection of AI research and product engineering to build intelligent, trustworthy systems that transform how financial institutions More ❯

G-Research, working on a wide range of projects. As a key member of the GenAI Engineering team, you will collaborate with researchers, data scientists and business stakeholders to design, develop and deploy AI applications that drive innovation and efficiency throughout the organisation. Key responsibilities of the role … include: Developing end-to-end AI applications, from data pre-processing to model deployment Collaborating with research teams to translate state-of-the-art AI techniques into practical solutions Optimising AI models for performance, scalability and efficiency Integrating AI solutions with existing systems and data pipelines … solutions Desirable skills: Experience with cloud platforms, such as AWS, GCP and Azure, and containerisation technologies, such as Docker and Kubernetes Experience with data pre-processing, feature engineering and model evaluation techniques Familiarity with reinforcement learning algorithms and applications Knowledge of software engineering best practices, including version control More ❯

What You’ll Do Design, build, and maintain scalable ML platforms for model development, experimentation, and production workflows. Automate ML infrastructure deployment, including data pipelines, model training, validation, and deployment. Manage the full ML lifecycle , from model versioning to deployment, monitoring, and retraining. Optimise large language model (LLM … operations , ensuring efficient fine-tuning, deployment, and performance monitoring. Collaborate closely with data scientists and engineers to develop and deploy ML models at scale. Optimise performance for inference and training across GPUs and cloud-based architectures. Ensure security and compliance for ML platforms handling sensitive data. Evaluate and … infrastructure issues . Ability to work in a fast-paced, high-growth environment with a product-oriented mindset . Bonus: Experience with big data tools (Spark, Kafka) and feature stores . Why Join Us? Work on cutting-edge AI and ML infrastructure supporting generative AI products. Be part More ❯

What You’ll Do Design, build, and maintain scalable ML platforms for model development, experimentation, and production workflows. Automate ML infrastructure deployment, including data pipelines, model training, validation, and deployment. Manage the full ML lifecycle , from model versioning to deployment, monitoring, and retraining. Optimise large language model (LLM … operations , ensuring efficient fine-tuning, deployment, and performance monitoring. Collaborate closely with data scientists and engineers to develop and deploy ML models at scale. Optimise performance for inference and training across GPUs and cloud-based architectures. Ensure security and compliance for ML platforms handling sensitive data. Evaluate and … infrastructure issues . Ability to work in a fast-paced, high-growth environment with a product-oriented mindset . Bonus: Experience with big data tools (Spark, Kafka) and feature stores . Why Join Us? Work on cutting-edge AI and ML infrastructure supporting generative AI products. Be part More ❯

stakeholders to gather requirements and drive projects from inception to deployment. Your expertise in object-oriented software engineering, quantitative modelling, cloud computing, and data analysis will be essential in enhancing the models that underpin our cashflow and pricing engines. You will also conduct ad-hoc analysis and scenario … with analysts to gather requirements, design tests, and scope new projects Create and maintain technical documentation Explore and clean datasets for modeling, optimizing data pipelines Identify and streamline inefficient processes Prepare and present visual materials to communicate software design and model logic to non-technical stakeholders Skills, Knowledge … and Expertise A degree in a highly numerate subject is essential At least 2 years of Python development experience, including scientific computing and data science libraries (NumPy, pandas, SciPy, PySpark) Strong understanding of object-oriented design principles for usability and maintainability Experience with Git in a version-controlled More ❯

stakeholders to gather requirements and drive projects from inception to deployment. Your expertise in object-oriented software engineering, quantitative modelling, cloud computing, and data analysis will be essential in enhancing the models that underpin our cashflow and pricing engines. You will also conduct ad-hoc analysis and scenario … with analysts to gather requirements, design tests, and scope new projects Create and maintain technical documentation Explore and clean datasets for modeling, optimizing data pipelines Identify and streamline inefficient processes Prepare and present visual materials to communicate software design and model logic to non-technical stakeholders Skills, Knowledge … and Expertise A degree in a highly numerate subject is essential At least 2 years of Python development experience, including scientific computing and data science libraries (NumPy, pandas, SciPy, PySpark) Strong understanding of object-oriented design principles for usability and maintainability Experience with Git in a version-controlled More ❯

Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock - from around the world. In Data, we are responsible for delivering this data, news and analytics through … platform of choice for the distribution of their content. As part of the team, you will be responsible for ensuring delivery of quality data for the Mutual Funds and ETP product. We are focused on finding opportunities to improve our coverage, completeness, timeliness, and accuracy for the facets … Technical Account Management team is responsible for the maintenance and calibre of the facets of the funds dataset including pricing and dividends, reference data, corporate actions, documents, and regulatory data. As a Technical Account Manager, your responsibility will be to develop subject matter expertise in your market, build More ❯

SENIOR DATA PLATFORM ENGINEER LONDON/SEMI-REMOTE £85,000 THE COMPANY Ready to embark on a new challenge? This forward-thinking telecommunications company empowers its members through smarter digital services—and this role plays a critical part in shaping the systems that make that possible. THE ROLE … As a Senior Data Platform Engineer, you will play a key role in designing and scaling high-impact, real-time data pipelines that fuel everything from machine learning to marketing automation. Working within a specialized Data Platform team, your work will directly support low … involved in the following: Developing microservices in Java using Spring Boot , built for speed, scale, and reliability Building and optimizing real-time streaming data pipelines using Kafka Enhancing experimentation frameworks to drive faster, data-informed product decisions Scaling infrastructure within AWS and working with cloud-native More ❯

together. About The Role As an AI Engineer, you'll use Generative AI to enhance operations, power client-facing products, and strengthen our data-driven culture. Owning the full AI lifecycle, you'll take ideas from proof of concept to deployment and continuous evaluation. Our AI initiatives span … categorization, summarization, data analysis, automated content generation, and rich media analysis - leveraging both existing AI/ML tools (LLMs, RAG, embeddings, agentic workflows) and custom solutions. You'll collaborate across teams to build practical, scalable AI solutions - where precision matters. With a "you build it, you run it … of concepts to validate feasibility and demonstrate real-world value. Explore, collect, clean, and prepare datasets for prompt engineering, model training and evaluation (Data Engineering). Design and create robust data pipelines (Data Engineering). Develop, test and iterate prompts to optimise performance across More ❯

KDB+ Data Engineer with around 5+ years of post-graduate experience sought to join a market-leading Quantitative Hedge Fund. You will join a 5-strong Data Engineering team covering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack … and modern systems, across on-premises and cloud infrastructure with technologies and tooling such as Python, KDB+, Snowflake, SQL and interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset, and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate … revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets that enhance their strategies. They are a lean team owning end-to-end delivery from initial design through to operational support in production. More ❯

KDB+ Data Engineer with around 5+ years of post-graduate experience sought to join a market-leading Quantitative Hedge Fund. You will join a 5-strong Data Engineering team covering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack … and modern systems, across on-premises and cloud infrastructure with technologies and tooling such as Python, KDB+, Snowflake, SQL and interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset, and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate … revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets that enhance their strategies. They are a lean team owning end-to-end delivery from initial design through to operational support in production. More ❯

Our client, a leading financial services organisation, is looking for a Data Solutions Manager to lead a small team of experienced data engineers. You will be joining a fast growing team who are responsible for delivering, improving and maintaining robust data pipelines within an … ambitious data architecture. Our client has already fully transitioned to cloud, there is a mature platform in place, and you will be joining a high performing, proactive, and collaborative team. To be successful in this role, you will need the following experience: Strong hands-on data engineering experience Previous experience managing and mentoring data engineering teams Significant experience working with Snowflake, Azure, Data Factory and Azure DevOps Strong communication and stakeholder management skills This role is almost fully remote, with quarterly workshop visits to the clients office in the South More ❯

including institutional VC funds and C-level executives of global technology companies. In this role, you will: Design and develop a highly-scalable data platform capable of ingesting and processing hundreds of terabytes of training data. Design and develop methodologies and metrics to better understand the underlying quality … structure and distribution of training data. Architect training data validation, integrity and safety mechanisms for state-of-the-art ML models. Be given a high degree of autonomy and ownership over your work. Co-hire your future colleagues. Work closely with the founding team and contribute towards best … the company. What we are looking for: Back-end development: At least 2–3 years of industry experience in back-end engineering developing data platforms or large-scale extract-transform-load (ETL) pipelines. Programming languages: Proficiency in Python for data pipelines, distributed systems and micro-services. More ❯

including institutional VC funds and C-level executives of global technology companies. In this role, you will: Design and develop a highly-scalable data platform capable of ingesting and processing hundreds of terabytes of training data. Design and develop methodologies and metrics to better understand the underlying quality … structure and distribution of training data. Architect training data validation, integrity and safety mechanisms for state-of-the-art ML models. Be given a high degree of autonomy and ownership over your work. Co-hire your future colleagues. Work closely with the founding team and contribute towards best … the company. What we are looking for: Back-end development: At least 2–3 years of industry experience in back-end engineering developing data platforms or large-scale extract-transform-load (ETL) pipelines. Programming languages: Proficiency in Python for data pipelines, distributed systems and micro-services. More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the Data … centricity. This role requires demonstrating thought leadership, technical proficiency, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. The role involves transitioning to a product-based model to develop digital capabilities. Responsibilities include developing and maintaining robust data pipelines and storage solutions to support analytics and machine learning initiatives. You will report to the Director of Data Engineering Solutions and collaborate globally with engineering teams across core products. Key Responsibilities: Technical Leadership: Provide leadership to data and DevOps engineers. Collaborate on designing More ❯

are RAPP - world leaders in activating growth with precision and empathy at scale. As a global, next-generation precision marketing agency we leverage data, creativity, technology, and empathy to foster client growth. We champion individuality in the marketing solutions we create, and in our workplace. We fight for … to the individual's needs, beliefs, behaviours, and aspirations. We foster an inclusive workplace that emphasizes personal well-being. Role Are you a data scientist eager to broaden your impact across the full stack of data science? Do you enjoy fast-paced environments, wearing multiple hats … and turning ideas into production-ready solutions? At RAPP, we're looking for a Data Scientist with a growth mindset, a generalist toolkit, and an appetite to grow within a world-class marketing agency. You'll work alongside senior data scientists, engineers, strategists, and creatives to More ❯

high-impact role requiring deep technical knowledge, strong product leadership, and a proven track record of delivering AI/ML solutions in complex, data-rich environments. You'll work closely with other product teams and cross-functional partners, to conceptualize and deliver AI capabilities that transform how product … Experience with natural language processing (NLP) techniques, large language models, or other AI methods for text-based and structured data. Strong understanding of data pipelines, data modeling, and MLOps. Experience in working on complex collaborative products that are architected as modular and extensible platforms or at … impact. Experience in mentoring and coaching junior colleagues, as well as leading across the company through indirect influence. Educational background in computer science, data science, or related practice. What's in it for you? Be part of building the world's first and best Product Management Platform that More ❯

We are seeking an experienced Kafka Real-Time Architect to design and implement scalable, high-performance real-time data processing systems leveraging Apache Kafka. In this role, you will be responsible for architecting and managing Kafka clusters, ensuring system scalability and availability, and integrating Kafka with various data processing platforms. This position requires a deep understanding of Kafka and related technologies, along with a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are … robust, highly available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster Management: Configure, deploy, and maintain highly available Kafka clusters, ensuring scalability and fault tolerance across distributed environments. Manage configurations, optimize cluster performance, and troubleshoot issues to maintain smooth operations. Integration & Data More ❯

Data & Document Automation Developer (Remote - £50K+) Location: Remote (with occasional travel) Salary: £50,000+ (DOE) Job Type: Full-Time, Permanent Are you a detail-oriented developer with a passion for automation and data processing? We’re looking for a Data & Document Automation Developer to … driving innovation in automated communication solutions. You'll work across dynamic projects using a blend of proprietary tech and industry tools to automate data workflows, support client delivery, and build internal systems. If you’re looking for a role where you can make a tangible impact and grow … within a stable, collaborative environment—this is it. 🔧 What You’ll Be Doing Creating and maintaining automated data pipelines using our proprietary ADPS (Automated Data Processing System). Supporting clients, account managers, and sales teams by querying transactional data and delivering accurate, timely solutions. More ❯

across teams, ensuring smooth and efficient project execution. Operational Excellence & Risk Management Identify and mitigate technical risks and obstacles, ensuring that the product development pipeline runs smoothly and efficiently. Ensure the security, performance, and scalability of products through proactive monitoring and improvements. Ensure adherence to high coding standards, software … hands-on experience in modern software development technologies (e.g., Java, Python, microservices, cloud platforms like AWS, Azure, etc.). Expertise in software architecture, data architecture, and system design, with an ability to lead and influence technical decision-making. Drive innovation toward building high-scalable, real-time data pipelines and data distribution solutions. Experience with enterprise integration patterns, including event-driven architectures and messaging systems. Leadership & Collaboration Comfortable acting as the primary interface with senior leaders, stakeholders, and executives, driving consensus across competing objectives. Exceptional leadership, communication, and interpersonal skills, with the ability to More ❯