876 to 900 of 1,317 Data Pipeline Jobs in England

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity to work with complex data engineering challenges while … teams to design and build operational and reporting pipelines across regions Maintain critical data pipelines supporting trading, forecasting, risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational dashboards Work with international teams … team members Requirements For Data Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design scalable solutions Quick understanding of new domain areas and data visualization Team player with project ownership mindset Passion More ❯

Iambic Therapeutics. You will be a key player in applyingadvanced software engineering skills to build technologies that support our drugdiscovery efforts. Your key responsibilities include development of training data workflows for the training of machine-learning (ML) models and scalable deployment of machine-learning technologies, and creation, testing and maintenance of software systems.This role is remote, with preference … Iambic platform has demonstrated delivery of new drug candidates to human clinical trials with unprecedented speed and across multiple target classes and mechanisms of action. Iambic is advancing a pipeline of potential best-in-class and first-in-class clinical assets, both internally and in partnership, to address urgent unmet patient need. Learn more about the Iambic team, platform … pipeline, and partnerships at iambic.ai . MISSION & CORE VALUES Our mission is to deliver better medicines through innovations in AI-based discovery technologies. The culture and work at Iambic Therapeutics are profoundly strengthened by the diversity of our people and our differences in background, culture, national origin, religion, sexual orientation, and life experiences. We are committed to building an More ❯

We are searching for a Senior Azure Integration Developerto lead the development of scalable, secure integration and data solutions within a modern Azure environment. Our client is modernising its technology platforms to support data-driven decision-making and improved service delivery. This role will focus on connecting systems, building APIs, and developing automated data … the Azure ecosystem. Responsibilities - Build and maintain secure integration solutions using Azure services - Develop APIs and microservices in .NET and C# - Create and manage Azure Synapse pipelines and data flows - Lead code reviews and ensure adherence to development standards - Strong experience with .NET, C#, Web APIs, and Azure integration services - Proficiency in Azure Synapse, Data Factory More ❯

errors and issues in order of severity, providing timely and effective solutions. This role requires some on-call responsibilities Manage Re-Training Pipelines: Take ownership of the re-training pipeline for deployed ML models, ensuring they are continuously updated and optimized for performance Optimize Performance and Efficiency: Identify opportunities to enhance model performance, reduce computational costs, and minimize latency. … CD pipelines for deploying machine learning models Excellent written documentation skills to document code, architectures, and experiments Experience with ML model monitoring systems Experience with ML training and data pipelines and working with distributed systems Proficiency with modern deep learning libraries and frameworks (PyTorch, Lightning, Ray) Preferred Qualifications Experience owning a product from development through monitoring and incident More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you'll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you'll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you'll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the Data and Analytics role within Mars's Global Pet … achieve growth, profitability, and customer centricity. This role requires demonstrating thought leadership, technical proficiency, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. The role involves transitioning to a product-based model to develop digital capabilities. Responsibilities include developing and maintaining robust data pipelines and storage solutions … to support analytics and machine learning initiatives. You will report to the Director of Data Engineering Solutions and collaborate globally with engineering teams across core products. Key Responsibilities: Technical Leadership: Provide leadership to data and DevOps engineers. Collaborate on designing and evolving scalable data platforms. Promote best practices and foster a high-performance culture. More ❯

implementing, and maintaining robust security architectures for AI-powered applications and infrastructure. You will play a critical role in identifying and mitigating security risks associated with AI, ensuring data privacy, and promoting ethical AI practices. This role requires a deep understanding of both traditional security principles and the unique challenges posed by AI technologies. What you'll be … doing: AI Security Architecture: Design and implement secure architectures for AI/ML models, data pipelines, and related infrastructure. Develop security policies and procedures specific to AI systems. Evaluate and select security tools and technologies for AI environments. Risk Assessment and Management: Conduct thorough risk assessments to identify vulnerabilities and threats specific to AI systems. Develop and implement … risk mitigation strategies for AI-related security issues, including adversarial attacks, data poisoning, and model bias. Monitor and report on AI security risks and compliance. Data Security and Privacy: Ensure the security and privacy of sensitive data used in AI applications. Implement data security controls and encryption techniques for AI datasets. Ensure More ❯

stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯

stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯

stores, and ops teams to see your code in action. What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯

Development, deploy and maintain AI systems and services in the healthcare domain to find more untreated patients London Technical share this Pangaea Data (Pangaea) is a South San Francisco and London based business founded by Dr Vibhor Gupta and Prof Yike Guo (Director Data Science Institute at Imperial College London; Provost, Hong Kong University of Science … include industry veterans from healthcare and the life sciences, including Lord David Prior (former chairman, NHS England) and Mr. Andy Palmer (former CIO, Novartis). The Role Pangaea Data is looking for talented engineers to join its technical team and focus on the development, deployment, and maintenance of AI systems and services in the healthcare domain. The ideal … background and experience in deploying AI-based solutions. Key Responsibilities Technical Responsibilities : Design and develop backend systems that integrate healthcare AI/LLM modules for tasks such as data extraction, summarization or decision support. Design and implement systems that integrate with the client side such as Web UI or EHR system. Implement and maintain CI/CD pipelines More ❯

will play a key role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Role Overview: Develop ETL processes to extract and normalise capacity data from infrastructure … sources. Automate data ingestion and processing into SQL Server databases. Normalising raw infrastructure and monitoring data into structured formats suitable for graphing and trending Collaborate with DBAs and technical teams to ensure transparency and supportability. Build data flows that support capacity reporting and trending, using modern technologies. Skills & Experience Required: 3+ years' experience in … ETL/data processing roles. Proficiency with ETL tools, SQL Server, RESTful APIs. Experience working with infrastructure data (e.g., Nutanix, VMware, Dell EMC desirable). Scripting experience in Python, SQL (T-SQL), Excel VBA. Knowledge of data optimisation, large datasets, JSON/XML formats. Experience of setting up SQL DTSS and Control/M More ❯

powering our marketing technology and performance efforts. As a Junior MarTech Analyst, you will be embedded within the acquisition and performance marketing teams, working closely with Marketing Managers, Data Engineers, and MarTech Operations leads. You'll collaborate with cross-functional partners wider data teams to connect, segment, and optimise data flows that drive our … advertising platforms. This role offers a great opportunity to develop your technical skills, particularly in SQL and data engineering, while contributing directly to marketing growth and innovation. You'll have the autonomy to support and improve our marketing data infrastructure, helping the team make data-driven decisions that fuel Trainline's success. As a … Trainline, you will As a Junior MarTech Analyst, you will work closely with the MarTech Operations Lead and performance marketing teams to support the connection and management of data pipelines between our data platforms and advertising channels. You'll collaborate with stakeholders to: Connect and configure customer, route, and pricing data from our data More ❯

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

with a willingness to work on both pre-training and post-training (fine-tuning, alignment, optimization) processes. Collaborate closely with US researchers teams to build, optimize, and maintain data sets and scalable training and data pipelines for LLMs. Build and maintain documentation for infrastructure components and systems Design and implement systems for reproducibility and traceability in … data preparation Develop and maintain documentation and codebases. Stay current with advancements in machine learning, NLP, and AI, and bring them to future projects This is a truly unique opportunity to work with some of the brightest minds in the industry on a ground-breaking project, for a confidential discussion please apply with an up to date CV. More ❯

to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement … solutions for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with More ❯

to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement … solutions for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with More ❯

partners. Continuing to support and complement Ripple's Payments, Custody and Stablecoin business units WHAT YOU'LL DO: Design and build scalable, low-latency microservices and event-driven data pipelines to support high-throughput trading systems. Champion data engineering best practices including schema evolution, data contracts, and data quality across event streams. … Collaborate with cross-functional teams to model, publish, and maintain high-quality data products aligned with enterprise standards. Implement CI/CD pipelines, automated testing, infrastructure-as-code, and monitoring solutions to ensure operational excellence. Lead end-to-end software development efforts-from gathering requirements to deployment and production support. Contribute to engineering excellence through mentoring, code reviews … proficiency in Java or similar languages (Golang, Scala, etc.). Proven track record building large-scale, low-latency distributed systems in trading or financial environments. Deep understanding of data streaming, order management systems, and modern persistence technologies (e.g., Aurora, DynamoDB). Experience working in front-office trading environments, ideally with exposure to FX and/or crypto trading More ❯

Huddersfield (Hybrid Remote) Package: £35,000-£40,000 + Share Scheme, 25 days holiday, 35-hour working week. Are you a Software Engineer with a passion for geospatial data, problem-solving, and the North of England? A fast-growing, mission-driven start-up is on the hunt for a driven Geospatial Software Engineer to join its small but … the region. If you're ready to make a real impact, this could be the perfect move. What You’ll Be Doing: Designing and developing mapping tools and data pipelines to support large-scale geospatial analysis across the North of England Collaborating with technical stakeholders at public authorities and vehicle manufacturers to understand and translate complex needs into … elegant, usable software Building responsive, interactive web applications using React JS and Node JS Working with Python (Django or Flask), SQL , and Google Cloud Platform (GCP) to handle data-heavy processes Creating and editing geospatial data using GIS tools such as Google Earth Pro , including drawing and manipulating polygons Operating in a hybrid setup – working from More ❯

to a better life, enabled by economic prosperity that lifts society up. That's why we empower British businesses and government to harness the power of AI and data analytics, so they can create value for people, not just profits. By working with brave and ambitious organisations who share our vision, we're building a future where everyone … and AI. We supercharge high-value, complex processes to drive operational efficiency and profitability. As markets face greater disruption, QuantSpark empowers companies in realising their competitive advantage through data, strategic insight, and AI. Why Join QuantSpark? At QuantSpark, we believe in creating value for people-not just profits-through the power of data-driven insights and … software development, with a strong background in developing web applications. Familiarity with relevant technologies, including Python (Flask or Django) for backend and React.js for frontend development. Advanced in data pipelining and schema design, with demonstrable experience designing and implementing robust, performant data pipelines from a variety of sources such as databases, APIs, SFTP, etc. Experience building More ❯

and outcomes at scale. With tools for work order management, compliance, inspections, and field service coordination, we help our partners streamline operations, deliver essential services faster, and make data-driven decisions with confidence. Today, millions of homes are managed through Plentific-and we're just getting started. We're a team of curious minds and problem solvers, united … sits at the centre of everything we do at Plentific and is constantly tackling challenging problems, such as online payments, quoting, invoicing, booking, search/scoring algorithms, ETL, data pipelines, in-app messaging, real-time notifications and fraud prevention. Our backend engineers mostly work with Python and Django on an increasingly more service-oriented architecture. The rest of … with product owners, engineering managers, user interface designers and other software engineers to write technical documents that identify software project requirements Design, build and maintain APIs, microservices and data pipelines Write well-formulated, testable and readable code using appropriate software design patterns Design, normalise and optimise relational databases Write complex SQL queries to get data from More ❯

Technical Account Manager - Mutual Funds Location London Business Area Data Ref # Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock - from around the world. In Data, we are responsible for delivering this data … to ensure Bloomberg is the platform of choice for the distribution of their content. As part of the team, you will be responsible for ensuring delivery of quality data for the Mutual Funds and ETP product. We are focused on finding opportunities to improve our coverage, completeness, timeliness, and accuracy for the facets of funds' data. Our Technical … Account Management team is responsible for the maintenance and calibre of the facets of the funds dataset including pricing and dividends, reference data, corporate actions, documents, and regulatory data. As a Technical Account Manager, your responsibility will be to develop subject matter expertise in your market, build and strengthen Bloomberg's relationships with fund houses, custodians, administrators, exchanges More ❯