901 to 925 of 1,236 Data Pipeline Jobs in the UK

of new Trading desks across both the Systematic HFT and Discretionary businesses they're now looking to hire an experienced Software Engineer/Data Engineer to work closely with Trading, Quant Research, and parallel Technology teams. This is a fast-paced, collaborative and innovative environment, suited to individuals … both autonomously and as part of a vibrant rapidly expanding group. Your focus will be the design, building and implementation of advanced Big Data solutions, to enable the capture, ingestion, storage, and provision of Terabyte sized Alternate Datasets. Tools you'll create include ETL/ELT Data Pipelines and Frameworks APIs Data Store Candidate's suitable for this role, will ideally have 3-8 yrs' of blended Data Engineering and Software Engineering skills, include ETL/ELT pipelines for High throughput (and Low Latency Data) Expert Python skills including More ❯

of new Trading desks across both the Systematic HFT and Discretionary businesses they're now looking to hire an experienced Software Engineer/Data Engineer to work closely with Trading, Quant Research, and parallel Technology teams. This is a fast-paced, collaborative and innovative environment, suited to individuals … both autonomously and as part of a vibrant rapidly expanding group. Your focus will be the design, building and implementation of advanced Big Data solutions, to enable the capture, ingestion, storage, and provision of Terabyte sized Alternate Datasets. Tools you'll create include ETL/ELT Data Pipelines and Frameworks APIs Data Store Candidate's suitable for this role, will ideally have 3-8 yrs' of blended Data Engineering and Software Engineering skills, include ETL/ELT pipelines for High throughput (and Low Latency Data) Expert Python skills including More ❯

combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II Role description: Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're … partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Data Engineer II Responsibilities: Independently execute projects through design, implementation, automation, and maintenance of large-scale enterprise ETL processes for a global client base. Develop … repeatable and scalable code that processes client data in an automated and efficient manner to ensure data availability in the platform is as real-time as possible. Act as an expert data resource within the team. Manage the process of data delivery More ❯

We're looking for experienced Data Engineers to help design and deliver a Remediation Data Hub for a major financial services client. This is an exciting opportunity to work on a high-impact program focused on regulatory redress and data integrity. Location: UK-based … Remote - with ad-hoc and expensed client visits) Tech Stack: Oracle Snowflake Informatica PL/SQL PySpark Power BI Build scalable, auditable data pipelines for ingestion, transformation, and downstream use. Work across multiple platforms (Oracle, Snowflake, Informatica). Collaborate with architects, analysts, and stakeholders to align data solutions with business and regulatory requirements. Develop data models and logic for segmentation, audit trails, and reporting. Support code reviews, testing, and documentation. Proficient in SQL, PL/SQL, or PySpark. Experienced with Oracle, Snowflake, and/or Informatica. Background in financial services, ideally with remediation More ❯

global technical platform that supports these different processes and drives forward long-term solutions to enhance Group capabilities. We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of coding … relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth. This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical … and Airflow; Experience in Kubernetes, Docker, Django, Spark and related monitoring tools for DevOps a big plus (e.g. Grafana, Prometheus); Experience with dbt for pipeline modeling also beneficial; Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them; Able to quickly understand More ❯

sponsorship or visa) 📍 Location: [Manchester – Hybrid 3 days in the office/Home working] 💷 Salary: £75,000 - £100,000 base (dependent on experience) Data Scientist - (Senior AI/ML Engineer) – Behavioural Biometrics/Data Science – Early Equity Opportunity Our client uses behavioural biometric interactions and advanced … growth plans on the horizon, this is the ideal time to get in early and make a defining impact. We’re seeking a Data Scientist/Senior AI/ML Engineer with a data science foundation , strong academic background (MSc/PhD preferred), and a proven … track record of building and deploying real-world AI systems from research to production. The Opportunity - Data Scientist - Senior AI/ML Engineer: As a senior member of this growing team, you’ll help architect and scale intelligent systems that analyse complex behavioural data (e.g. sensor More ❯

meets meaning. We’ve evolved from a kinetic energy pioneer into a next-generation AI-powered engagement platform that transforms footfall into energy, data, and dynamic experiences. Our mission? To revolutionise how people connect with the spaces around them - through intelligent, sustainable, and interactive technology. That’s where … management role. You'll already understand and be in a position to architect complex integrated environments that connect hardware (kinetic and solar floors), data collection modules, cloud infrastructure, and customer-facing digital experiences while adding new technologies such as AI, Digital Twin and more working with our in … lead the charge on building our smart infrastructure ecosystem - from IoT devices on the ground, through to digital twins, edge computing, and cloud data pipelines that drive actionable insight for our clients. Responsibilities Technology Vision & Strategy Own and evolve the company’s technology roadmap to support the next More ❯

meets meaning. We’ve evolved from a kinetic energy pioneer into a next-generation AI-powered engagement platform that transforms footfall into energy, data, and dynamic experiences. Our mission? To revolutionise how people connect with the spaces around them - through intelligent, sustainable, and interactive technology. That’s where … management role. You'll already understand and be in a position to architect complex integrated environments that connect hardware (kinetic and solar floors), data collection modules, cloud infrastructure, and customer-facing digital experiences while adding new technologies such as AI, Digital Twin and more working with our in … lead the charge on building our smart infrastructure ecosystem - from IoT devices on the ground, through to digital twins, edge computing, and cloud data pipelines that drive actionable insight for our clients. Responsibilities Technology Vision & Strategy Own and evolve the company’s technology roadmap to support the next More ❯

closely with internal teams to influence product features, particularly those focused on web standards (e.g., geolocation permissions). Partner Management: Identify and build a pipeline of new and existing partners suited to support varied technical feature rollouts. Stakeholder Collaboration: Work with cross-functional teams (sales, product, engineering) across regions … or solution engineering roles. Technical Knowledge: Strong grasp of JavaScript, HTML, CSS for web consulting. Familiarity with SQL for partner and data pipeline management. Ability to read, understand, and troubleshoot code (full-time coding not required). Consulting Background: Experience in client-facing roles, ideally with a More ❯

cyber reinsurance. Key Responsibilities Develop and optimise NLP models for tasks like information retrieval, summarisation, and other domain-specific applications. Work closely with data scientists, engineers, and domain experts to understand business needs and deliver AI-driven solutions. Stay up to date with the latest NLP technologies, including … semantic search and generative AI, and apply them to improve existing models. Build and maintain scalable data pipelines for processing both structured and unstructured data efficiently. Evaluate and fine-tune machine learning models to ensure optimal performance. Ensure models and data pipelines adhere to … their applications. Experience handling large-scale datasets and using distributed computing frameworks like Databricks or Spark. Background in insurance or cybersecurity. Understanding of data privacy regulations such as GDPR and CCPA. Salary & Benefits £40,000 - £60,000 depending on experience. Benefits include: 5% pension. 28 days holiday + More ❯

will be responsible for shaping and executing our technical strategy, leading a high-performing engineering team, and driving product development across software engineering, data engineering, and AI. This role is critical to ensuring that RegNav AI builds scalable, secure, and intelligent solutions that power the next generation of … regulatory navigation. Responsibilities: Owning the tech stack and architecture – Design and implement a scalable, AI-powered SaaS platform Leading AI & Data Science integration - Work with ML engineers and Applied AI engineers to build intelligent automation, predictive models, and NLP-driven insights Leading and growing the engineering team - Direct … decisions - To ensure scalability, security, and performance Defining systems and processes - To successfully execute the product roadmap Establishing best practices - for software development, data infrastructure, and AI/ML implementation Overseeing operational aspects of software development process - to ensure effective workflows across developers Moving fast and shipping high More ❯

Osterley/Hybrid Duration: 12 Months We are seeking a highly skilled and experienced Back-End Developer with advanced expertise in Go (Golang), data analytics, and cloud-based backend services. This individual will play a key role in building scalable APIs, processing data pipelines, and supporting … services using Go (Golang). Design and implement RESTful APIs and GraphQL endpoints to support front-end applications. Process and optimize large-scale data pipelines for real-time analytics and reporting. Write clean, maintainable, and efficient code that adheres to best practices and coding standards. Utilize AWS cloud … services for scalable and secure backend application deployment. Ensure robust data storage and management using PostgreSQL and other database solutions. Implement authentication, authorization, and security best practices in backend services. Improve CI/CD pipelines for automated deployments and infrastructure management. Architecture and Performance Lead performance optimization initiatives More ❯

Osterley/Hybrid Duration: 12 Months We are seeking a highly skilled and experienced Back-End Developer with advanced expertise in Go (Golang), data analytics, and cloud-based backend services. This individual will play a key role in building scalable APIs, processing data pipelines, and supporting … services using Go (Golang). Design and implement RESTful APIs and GraphQL endpoints to support front-end applications. Process and optimize large-scale data pipelines for real-time analytics and reporting. Write clean, maintainable, and efficient code that adheres to best practices and coding standards. Utilize AWS cloud … services for scalable and secure backend application deployment. Ensure robust data storage and management using PostgreSQL and other database solutions. Implement authentication, authorization, and security best practices in backend services. Improve CI/CD pipelines for automated deployments and infrastructure management. Architecture and Performance Lead performance optimization initiatives More ❯

data to personalize interactions in a compliant manner, at scale (20m consumers and growing 10% MoM) Built out a data pipeline capable of handling millions of events daily Enabled the use of multiple LLMs for a single interaction, optimized for the best performance while reducing More ❯

data to personalize interactions in a compliant manner, at scale (20m consumers and growing 10% MoM) Built out a data pipeline capable of handling millions of events daily Enabled the use of multiple LLMs for a single interaction, optimized for the best performance while reducing More ❯

We are hiring a Staff Software Engineer to join our Data Team. This is a crucial … position that will enable us to achieve project deliverables this year. You'll support our Genetic Data Squad, looking at withdrawals, supporting pipeline development and maintenance to support our imputed releases. If you're looking for a new challenge, have experience working with genetic data … about human health and diseases. So future generations can live in good health for longer. Essential Duties and Responsibilities: Responsible for several interacting data pipelines/flows, ensuring these meet the user, business and technical requirements that have been prioritised. Leading hands-on development of new features, including More ❯

We are hiring a Staff Software Engineer to join our Data Team. This is a crucial … position that will enable us to achieve project deliverables this year. You'll support our Genetic Data Squad, looking at withdrawals, supporting pipeline development and maintenance to support our imputed releases. If you're looking for a new challenge, have experience working with genetic data … about human health and diseases. So future generations can live in good health for longer. Essential Duties and Responsibilities: Responsible for several interacting data pipelines/flows, ensuring these meet the user, business and technical requirements that have been prioritised. Leading hands-on development of new features, including More ❯

in at least one key area of the software development stack, including but not limited to: frontend engineering, backend architecture design, data pipeline management, or distributed systems. Experience working in cross-functional teams and building integrations across diverse product stacks. Additional or Preferred Qualifications Demonstrated full-stack … collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team. Responsibilities Collaborate cross-functionally with product, data, and clinical teams to align on technical priorities and clarify scopes. Work independently across a wide range of the stack, integrating backend data More ❯

growing tech team working on an exciting new platform. This is an opportunity to work with cutting-edge search technologies and large-scale data processing while contributing to a product that makes a real impact. Your Role As a Senior Java Developer, you’ll play a key role … in designing, building, and maintaining a robust data platform that powers our core products. You’ll collaborate with cross-functional teams to create highly performant and scalable solutions. Key Responsibilities: Deliver high-quality, well-structured code using Agile and TDD practices Develop new features across the full stack … front-end to Java-based backend services Build and optimize search solutions using technologies like Apache Lucene, Solr, or OpenSearch Design and implement data pipelines in collaboration with Data Engineers Work with cloud technologies (Azure, AWS, or GCP) for scalable data processing Conduct code More ❯

create modern systems by using Microsoft Fabric Act as a consultant, understanding the client requirements and deliver the best solutions. Building and optimising data pipelines. Debugging issues Keep costs under control Skills Microsoft Fabric - Lakehouse and warehouse models Azure Tools (Data Factory, Synapse, SQL) Python experience … for programming Databases, SQL and NoSQL (CosmosDB, KQL) Data Modelling: Kimball frameworks and 3NF Nice To Have Databricks Power BI AI/ML Azure Infrastructure DevOps Certifications Microsfot certified: fabric Analytics Engineer Associate DP-203 Azure data Engineering AZ-305 Azure Solutions Architect. If this sounds More ❯

experienced in the defence sector to join a new UK based client! Skills- Broad AI skills GenAI Machine Learning LLMs NLPs TensorFlow Terraform Data pipelines/ETL tools Details- 6-month contract (likely to extend) Outside IR35 Fully remote If interested, please apply and I'll be in More ❯

to innovation provide ample opportunities for professional growth and progression. Our Python Developer will enjoy working on a backend code base including algorithms, data pipelines, APIs and ML models. Apply now for immediate consideration for this exceptional Python Developer opportunity! Understanding Recruitment is acting as an employment agency More ❯

and production support when needed. Key Requirements Solid experience working with Openlink Endur, including configuration and customisation. Familiarity with downstream system integration and data pipelines around Endur. Strong knowledge of OpenJVS and SQL. Exposure to or experience with Java development. Experience with Linux, Git, RabbitMQ, FIX messaging, and More ❯

and production support when needed. Key Requirements Solid experience working with Openlink Endur, including configuration and customisation. Familiarity with downstream system integration and data pipelines around Endur. Strong knowledge of OpenJVS and SQL. Exposure to or experience with Java development. Experience with Linux, Git, RabbitMQ, FIX messaging, and More ❯

existing tools. Enhancing automation for scaling infrastructure. Playing a key role in diversifying and scaling platform. Evaluating options to replace existing real-time data pipeline. Providing platform support to engineering. AppTek.ai provides AI-powered speech and language solutions including ASR, NMT, NLP/U, LLMs, and TTS, serving … diverse industries globally. Education Requirements: BS in a field related to Computational Linguistics, Computer/Data Science. Experience Requirements: 2+ years of industry experience (desirable for Site Reliability Engineer role). Other Requirements: Strong knowledge of Linux. Strong knowledge of AWS. Docker. Scripting languages (Bash, Python). Familiarity … to monitor the platform. Respond to incidents, troubleshoot, investigate root causes. Conduct post-incident investigation and report. QED.ai provides AI-driven solutions for data scarcity in health and agriculture, offering tools for data digitization, geospatial mapping, and spectroscopy. Travel to exotic places around the world. Ask More ❯