101 to 123 of 123 Data Pipeline Jobs in the South East

Introduce and manage observability, monitoring, and evaluation frameworks for ML and AI services. Enable auto-evaluation of prompts and models against domain-specific requirements. Build Python-based microservices, data pipelines, and serverless functions. Collaborate with stakeholders to translate data and AI requirements into scalable solutions. Essential Experience & Skills 5+ years' engineering experience, with at least … years in ML Ops, Data Engineering, or AI infrastructure. Strong Python engineering skills (Pandas, Numpy, Jupyter, FastAPI, SQLAlchemy). Expertise in AWS services (certification desirable). Proven experience deploying and supporting LLMs in production. Strong understanding of LLM fine-tuning (PyTorch, TensorFlow, Hugging Face Trainer, etc.). Experience with ML tooling (e.g. SageMaker, LangChain/LangSmith, MLflow, Dataiku … in Generative AI trends and best practices. Desired Skills Experience with chatbots and conversational AI (voice or text). Familiarity with Terraform, Helm, Kubernetes, or Postgres. Exposure to Data Science, NLP, Explainable AI (XAI). Real-world delivery of Generative AI solutions, especially LLM-driven applications. *Rates depend on experience and client requirements More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

to step into a broader architectural remit. You will play a key role in shaping cloud strategies, modernising legacy systems, and enabling advanced technologies such as generative AI, data analytics, and cloud-native applications. Key Responsibilities Design and implement scalable, secure, and high-performing AWS solutions. Lead cloud migration and modernisation initiatives, including mainframe transformation. Collaborate with cross … functional teams including data scientists, engineers, and developers. Provide technical leadership and guidance on AWS best practices and architecture patterns. Optimise cloud infrastructure for performance, cost, and security. Support the deployment of AI/ML models and data pipelines in production environments. Stay current with emerging AWS services and recommend improvements to cloud environments. Required Skills … and architecture. Ideal for cloud engineers or AWS consultants with deep service-level understanding. Desirable Experience Background in infrastructure or networking. Exposure to generative AI, AWS Contact Center, data and analytics, or mainframe modernisation. Multi-cloud or hybrid cloud experience (e.g. Azure, GCP). Understanding of interoperability across cloud platforms and on-prem environments. Additional Information Candidates must More ❯

major national programme. This is a fantastic opportunity to take ownership of building and leading a team delivering cutting-edge digital infrastructure that will transform how vital scientific data is accessed and shared across the UK and beyond. The role As Lead Developer, you'll provide senior technical direction and hands-on expertise in designing and implementing scalable … digital infrastructure programme. Provide hands-on technical input, writing high-quality code and driving architecture decisions. Design and implement secure, scalable backend systems and cloud infrastructure. Build robust data pipelines to manage and mobilise large-scale datasets. Collaborate with external suppliers, partners, and stakeholders to align delivery. What we're looking for: At least 5 years of experience More ❯

major national programme. This is a fantastic opportunity to take ownership of building and leading a team delivering cutting-edge digital infrastructure that will transform how vital scientific data is accessed and shared across the UK and beyond. The role As Lead Developer, you'll provide senior technical direction and hands-on expertise in designing and implementing scalable … digital infrastructure programme. Provide hands-on technical input, writing high-quality code and driving architecture decisions. Design and implement secure, scalable backend systems and cloud infrastructure. Build robust data pipelines to manage and mobilise large-scale datasets. Collaborate with external suppliers, partners, and stakeholders to align delivery. What we're looking for: At least 5 years of experience More ❯

rebalancing logic Attribution and decomposition analytics Build robust APIs using FastAPI or Flask Collaborate directly with business users to gather requirements and iterate quickly Implement testing, versioning, and data validation processes Ensure integration with internal data sources and reporting tools Required Skills 5+ years of Python development experience, ideally in financial services or commodities Strong proficiency … in Pandas , NumPy , and time-series data manipulation Proven experience with FastAPI or Flask Familiarity with large datasets and real-time data pipelines Excellent debugging, profiling, and performance optimization skills Strong communication skills and ability to work with non-technical stakeholders Preferred Skills Experience with commodities indices or structured products Knowledge of market data More ❯

Why Join? Here, your work means more: Make an impact by shaping AI security frameworks for innovative enterprise projects. Be part of challenging, future-defining programmes in AI, data, and cloud security. Collaborate with industry experts and multidisciplinary teams , while driving standards in one of the most rapidly evolving technology landscapes. The Role As an AI Security Architect … will: Define and implement AI/ML security strategies, standards, and guidelines . Design and own enterprise security architecture for AI/ML systems, CI/CD, and data pipelines. Conduct security risk assessments and threat modelling for AI/ML workloads. Support testing of AI/ML models, including trustworthiness, fairness, bias, and adversarial attack detection. Collaborate … with data scientists, engineers, and stakeholders to embed security controls in AI/ML pipelines. Enforce robust access control, authentication, and encryption standards . Stay ahead of emerging AI security threats, regulations, and frameworks . Provide advisory guidance to cross-functional teams during AI/ML system design and deployment. Contribute to regulatory compliance efforts (EU AI Act More ❯

Build and maintain high-quality front-end features using React , enabling users to visualize and interact with complex scientific data. Integrate AI/ML components with backend services, data pipelines, and cloud infrastructure. Ensure robust software practices including automated testing, documentation, and continuous deployment. Collaborate with designers (e.g. using Figma ) to turn prototypes into engaging user experiences. Work … closely with data engineers and other technical teams to develop end-to-end solutions. Monitor and iterate on key performance metrics for tools and services. What We're Looking For Experience in frontend development (React). Python skills, ideally with frameworks like FastAPI . Solid experience with cloud platforms (Google Cloud preferred), including deployment and infrastructure. Proficiency in … to work directly with designers and convert UI/UX designs into functional applications. Desirable experience: Experience with Docker and multi-container architectures. Background in biological or scientific data (e.g. genomics, proteomics). Knowledge of agent-based frameworks like LangGraph, PydanticAI, or AutoGen. Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in More ❯

Role Senior DevOps/Cloud Engineer Own AWS infrastructure, data pipelines, and web apps Location London/Remote Start and duration Start ASAP, full time Duration TBD, long term Context Company is building a new commodities trading desk A Technical Director has just been onboarded for this project You will be the Director’s right hand and senior … TypeScript. EKS, ECR, VPC, IAM, Aurora PostgreSQL Kubernetes. EKS and k3s. kubectl, Helm, Lens, k9s Docker. arm64 and amd64 images. Alpine and Ubuntu Python. Advanced. Building tools and data grabbers. Jinja. Conda and pip envs TypeScript and JavaScript. Advanced. Node.js and React SQL. Strong. PostgreSQL, PL/pgSQL, indexing, partitioning. pg_partman Git-first workflow. GitHub Actions for … CI and data jobs Apache Superset. Operate on AWS, tune, extend, and read source as needed Charts. ECharts or similar for static analytics Networking. WireGuard site-to-site and client VPNs Linux. Power user and admin skills Key responsibilities Maintain and improve AWS infra with CDK and Projen. Enforce code quality and security. Manage access Run and secure More ❯

We are a high-growth scale-up building a cloud SaaS platform that enables industrial and energy clients to manage fleets of autonomous systems and turn vast inspection data into actionable intelligence. Our platform is becoming the mission control for critical infrastructure monitoring, combining dashboards, anomaly detection, rules/alerts, and predictive analytics into one solution. Already working … and architecture of a SaaS platform Deliver across backend (Java) and frontend (Angular) systems Build secure, scalable cloud infrastructure (AWS) Implement APIs, authentication (SSO/LDAP), and secure data pipelines Develop dashboards and data visualisations to transform complex datasets into actionable insights Partner with leadership to define the technical vision and roadmap Scale into a leadership … SaaS products Hands-on expertise with Java (backend) and Angular (frontend) Skilled in AWS cloud services Solid understanding of APIs, authentication, and security protocols (SSO, LDAP) Experience with data visualisation and analytics platforms Proven ability to design and deliver scalable, secure architectures Entrepreneurial mindset: comfortable working in fast-paced, scale-up environments Nice-to-Haves Knowledge of machine More ❯

We are a high-growth scale-up building a cloud SaaS platform that enables industrial and energy clients to manage fleets of autonomous systems and turn vast inspection data into actionable intelligence. Our platform is becoming the “mission control” for critical infrastructure monitoring, combining dashboards, anomaly detection, rules/alerts, and predictive analytics into one solution. Already working … and architecture of a SaaS platform Deliver across backend (Java) and frontend (Angular) systems Build secure, scalable cloud infrastructure (AWS) Implement APIs, authentication (SSO/LDAP), and secure data pipelines Develop dashboards and data visualisations to transform complex datasets into actionable insights Partner with leadership to define the technical vision and roadmap Scale into a leadership … SaaS products Hands-on expertise with Java (backend) and Angular (frontend) Skilled in AWS cloud services Solid understanding of APIs, authentication, and security protocols (SSO, LDAP) Experience with data visualisation and analytics platforms Proven ability to design and deliver scalable, secure architectures Entrepreneurial mindset: comfortable working in fast-paced, scale-up environments Nice-to-Haves Knowledge of machine More ❯

and minimal disruption. Act as the primary Braze expert , providing hands-on technical leadership across configuration, integrations, and feature deployment. Conduct rigorous UAT and QA testing for migrated data and campaigns, ensuring compliance, deliverability, and performance. Partner with CRM, Data, and Engineering teams to validate SDK integrations and align data schemas. Own and refine … Build and maintain high-quality, scalable templates in Braze (HTML, CSS, Liquid). Support the delivery of a new global contact strategy leveraging Braze's advanced functionality. Ensure data pipelines and integrations remain stable, compliant, and fit for purpose. Skills & Experience Required Extensive, hands-on experience with Braze (non-negotiable). Proven track record of leading a CRM … migration into Braze . Strong technical expertise across SQL, APIs, SDKs, data modelling, and ETLs. Demonstrated ability to conduct QA and UAT with precision and attention to detail. Ability to build and maintain CRM templates (HTML, CSS, Liquid). Experience with warehouse-driven CRM (e.g. Databricks, Hightouch). End-to-end ownership of CRM campaign delivery. More ❯

of real-world cyber threats. As a Senior Backend Engineer , you’ll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assets—helping global security teams uncover exposures before attackers do. What you’ll be doing: Designing and building backend services and data pipelines powering … a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally What they’re looking for: 5+ years’ experience designing and maintaining mission-critical backend … clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus points if you’ve worked with: large-scale data processing, ETL pipelines, cloud deployments, or DevOps/CI-CD practices. Why join? Competitive salary + benefits Ownership and impact in a high-growth cybersecurity scale-up Work with More ❯

systems, particularly language-based models. Conduct user research to identify risks, failure modes, and areas for improvement in AI applications. Integrate AI/ML components with frontend, backend, data pipelines, and compute infrastructure. Develop high-quality software following best practices, including active participation in code reviews. Collaborate with engineers and data teams across functions to build … robust, end-to-end data pipelines. Generate insights from GenAI datasets using machine learning and data analysis techniques. Qualifications Experience conducting user research in software development contexts. Solid understanding of generative AI and large language models. Proficiency in Python, including testing and development workflows. Familiarity with agile methodologies and working in agile development environments. Strong grasp More ❯

an experienced Splunk Consultant to join their expanding team and play a key role in mission-critical projects. This is an exciting chance to work on cutting-edge data and security initiatives, helping clients optimise their platforms and deliver real business outcomes through the power of Splunk and cloud technology. Key Responsibilities Act as a trusted advisor to … clients, shaping and delivering secure, scalable data and logging solutions. Build, maintain, and optimise data pipelines for operational and security-driven use cases. Integrate Splunk with AWS-based architectures and logging frameworks. Develop strong, lasting client relationships through consistent engagement and delivery excellence. Produce clear, structured technical documentation to support knowledge transfer and project handover. Work … complex challenges and deliver innovative solutions. What We’re Looking For Technical Expertise: Splunk Architect certification (minimum Splunk Admin with strong experience considered) Hands-on experience delivering Splunk data solutions AWS knowledge, particularly integrating logging to Splunk Security use-case engineering and SOC exposure (advantageous) Client & Stakeholder Focus: Track record of building strong client relationships and achieving high More ❯

art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯

active DV Clearance will be preferred. In this role, you'll: Contribute to the design, deployment, and maintainenance of the Splunk environments, including clustered architectures, for large-scale data ingestion and analysis. Reviewing and improving Data collection and Data normalisation Continuous improvement and updating of processes and workflow requirements Working with stakeholders, IT operations … issues. We're looking for someone who can bring: A background in solving complex security challenges. Strong knowledge of SIEM tools, ideally Splunk and Sentinel An understanding of data pipelines, modelling, integrety and compliance. Hands-on experience with Python and other scripting languagues would be an added advantage Flexibility to work onsite and ad hoc travel to London More ❯

other LLM-based solutions Technical experience with Node.js, Python, and SQL Experience with API design and development for both internal and external use cases Experience designing and scaling data pipelines and working with large datasets Track record of building and managing teams Important Notice: Both Leo Technology and the companies we partner with are incredibly passionate about building … from all backgrounds to apply. Leo Technology Limited is acting as an Employment Agency in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of the Leo Technology website More ❯

performance engineering culture through structured reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What they’re looking for: 10+ years of experience … SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture Work with cutting-edge technology More ❯

performance engineering culture through structured reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What they’re looking for: 10+ years of experience … SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture Work with cutting-edge technology More ❯

SC Cleared Python DeveloperC/C++ | Data Processing | Kubernetes | Sonar Systems | Hybrid (Southamptom)SR2 is partnered with an industry leading consultancy on the Defence programme, supporting critical Defence innovation, and we’re looking for an experienced Full Stack Software Engineer to join the team.This role will focus on developing robust, production-grade APIs, building data pipelines … and delivering software applications into secure containerised environments. You’ll work closely with scientists, engineers, and domain experts to ensure sonar data is processed, shared, and operationally ready.Key Responsibilities: Design and develop APIs for data streaming across multiple protocols (HTTP RPC, WebSockets, TCP, UDP) using JSON/Protobuf Support engineers and scientists in adopting and using … APIs effectively Build and maintain data processing pipelines in collaboration with domain experts Review and contribute to codebases across Python and C++ Create and maintain unit and integration tests for reliability and quality Deliver applications into container orchestration systems like Kubernetes Document design decisions and ensure knowledge sharing across teams Solve complex technical challenges across multi-technology environments More ❯

large-scale training of multi-modal LLM/VLM/VLA systems integrating inputs such as vision, audio, proprioception, LiDAR, and point cloud data. Build end-to-end data pipelines : collect sim/tele-op logs, manage versioned data lakes, apply weak supervision, curate datasets, and run evaluation loops. Collaborate with MLOps and Data More ❯

large-scale training of multi-modal LLM/VLM/VLA systems integrating inputs such as vision, audio, proprioception, LiDAR, and point cloud data. Build end-to-end data pipelines : collect sim/tele-op logs, manage versioned data lakes, apply weak supervision, curate datasets, and run evaluation loops. Collaborate with MLOps and Data More ❯