126 to 141 of 141 Data Pipeline Jobs in the South East

WFH Contract Type: Permanent TECHNE are representing exclusively a pioneering Battery Intelligence technology company is redefining how batteries are understood, optimised, and deployed. By combining electrochemistry, software, and data science , they deliver intelligent battery solutions across the full value chain - from automotive and energy storage to heavy-duty applications. They are now seeking a Cloud Application Engineer to … join their growing technical delivery team. This is a 90% technical, 10% customer-facing role focused on building and customising data pipelines , integrating battery analytics into customer frameworks, and collaborating closely with the product and cloud development teams. Role Overview You will act as the primary technical contact on customer-facing projects, translating requirements and providing technical support … and the core cloud development team. The role involves building automated customer pipelines for battery analytics , customising the existing codebase for customer-specific orchestration frameworks, and turning raw data into actionable, business-relevant insights. You’ll also contribute to the ongoing development of the Battery Intelligence Cloud Platform , helping to accelerate global electrification by improving the performance, safety More ❯

to guide small, inexperienced client teams in a collaborative yet authoritative manner. You will play a key role in shaping and delivering solutions built on open-source technologies, data pipelines, vector stores, and Generative AI (GenAI) capabilities, with an emphasis on integrating Large Language Models (LLMs). Key Responsibilities Leadership & Collaboration: Lead and mentor small client teams with … clearly to technical and non-technical audiences. Build strong relationships with client stakeholders, ensuring alignment on objectives and expectations. Technical Delivery: Design, implement, and document end-to-end data and GenAI solutions using open-source and cloud-based components. Develop and maintain data pipelines, vector databases, and LLM integrations. Configure and optimize solutions on Microsoft Azure … communication and presentation skills. Strong team player with a collaborative, mentoring mindset. Hands-on experience with open-source technologies across front-end and back-end systems. Proficiency in data pipelines, vector stores, and Generative AI/LLM implementations. Working knowledge of Microsoft Azure Cloud services, including configuration and deployment. Strong documentation and reporting skills. Desirable Current DV Clearance More ❯

of real-world cyber threats. As a Senior Backend Engineer , you’ll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assets—helping global security teams uncover exposures before attackers do. What you’ll be doing: Designing and building backend services and data pipelines powering … a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally What they’re looking for: 5+ years’ experience designing and maintaining mission-critical backend … clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus points if you’ve worked with: large-scale data processing, ETL pipelines, cloud deployments, or DevOps/CI-CD practices. Why join? Competitive salary + benefits Ownership and impact in a high-growth cybersecurity scale-up Work with More ❯

all stages of the AI lifecycle. Act as the technical SME, providing guidance and solutions to complex security challenges in AI/ML deployments. Work closely with engineering, data science, and DevSecOps teams to embed security best practices. Assess and mitigate risks specific to AI models, data pipelines, and ML/AI frameworks. Influence security strategy … edge AI security initiatives. Experience & Skills Required: Proven hands-on experience securing ML/AI systems (not theoretical knowledge). Deep technical expertise in AI/ML architectures, data pipelines, and model lifecycle security. Strong understanding of threat modeling, risk assessment, and security controls in AI/ML contexts. Previous experience as a Security Architect or senior security More ❯

Software Engineer AI & Data Systems £40,000 to £90,000 (DOE) + performance bonus Permanent Hybrid UK nationals only | Must hold SC clearance About the Role An innovative UK technology company is developing a next-generation AI platform designed for defence and health applications. Were looking for a Software Engineer who thrives on learning quickly, solving complex technical … Youll Work On Design, build, and scale intelligent systems and microservices Develop AI-driven capabilities (e.g. LLMs, retrieval-augmented generation (RAG), and AI agents) Build and maintain APIs, data pipelines, and backend components (primarily Python, FastAPI, or Flask) Engineer robust, containerised architectures using Docker and Kubernetes Work with ElasticSearch, Weaviate, Pinecone, and other vector databases Help deliver high … premise systems Passionate programmer with a problem-solving mindset Quick learner who enjoys exploring new technologies Familiarity with microservice architectures and containerisation (Docker/K8s) Experience in AI, data engineering, or distributed systems Flexible, collaborative, and adaptable, comfortable wearing many hats in an SME environment Security Check (SC) cleared, British nationals only (no dual nationality) Why Join? Shape More ❯

play a key role in enabling personalised, insight-led marketing activity across a global brand. You'll be the technical specialist supporting the Marketing Communications team, ensuring platforms, data flows, and integrations run smoothly and deliver maximum value. For this CRM Manager role, you'll manage the configuration and optimisation of core Marketing Automation tools, help shape customer … data strategy, and support the delivery of targeted campaigns using technology such as MS Dynamics Customer Insights, analytics platforms, and integrated marketing systems. You'll work closely with marketing, digital, and data teams to improve segmentation, reporting, and automation, making sure the business can execute high-quality, measurable campaigns. Responsibilities: Owning and refining the organisation's … marketing technology platforms to support campaign and insight needs. Managing integrations, data pipelines, and connectivity across systems to ensure reliable and accurate information flow. Collaborating with marketing and data teams to build advanced segmentation, customer insights, and reporting dashboards. Supporting tracking, analytics, and attribution processes to enhance campaign performance measurement. Identifying opportunities to introduce new automation More ❯

play a key role in enabling personalised, insight-led marketing activity across a global brand. You’ll be the technical specialist supporting the Marketing Communications team, ensuring platforms, data flows, and integrations run smoothly and deliver maximum value. For this CRM Manager role, you’ll manage the configuration and optimisation of core Marketing Automation tools, help shape customer … data strategy, and support the delivery of targeted campaigns using technology such as MS Dynamics Customer Insights, analytics platforms, and integrated marketing systems. You’ll work closely with marketing, digital, and data teams to improve segmentation, reporting, and automation, making sure the business can execute high-quality, measurable campaigns. Responsibilities: Owning and refining the organisation’s … marketing technology platforms to support campaign and insight needs. Managing integrations, data pipelines, and connectivity across systems to ensure reliable and accurate information flow. Collaborating with marketing and data teams to build advanced segmentation, customer insights, and reporting dashboards. Supporting tracking, analytics, and attribution processes to enhance campaign performance measurement. Identifying opportunities to introduce new automation More ❯

Seeking a hands-on data platform architect/engineer to reverse-engineer a legacy solution (currently on a VM) and migrate it to Microsoft Fabric. The goal is to stabilize critical data processes and lay the groundwork for a modular, scalable enterprise data platform. A working Microsoft Fabric-based replication of the legacy solution … with supporting documentation and recommendations for future improvements. Analyze and document the existing legacy system. Rebuild and optimize data pipelines in Microsoft Fabric using PySpark. Conduct forensic analysis of data transformations and dependencies. Collaborate with data architects, engineers, and analysts. Troubleshoot data quality and integration issues. Provide recommendations for future modularization and More ❯

Seeking a hands-on data platform architect/engineer to reverse-engineer a legacy solution (currently on a VM) and migrate it to Microsoft Fabric. The goal is to stabilize critical data processes and lay the groundwork for a modular, scalable enterprise data platform. A working Microsoft Fabric-based replication of the legacy solution … with supporting documentation and recommendations for future improvements. Analyze and document the existing legacy system. Rebuild and optimize data pipelines in Microsoft Fabric using PySpark. Conduct forensic analysis of data transformations and dependencies. Collaborate with data architects, engineers, and analysts. Troubleshoot data quality and integration issues. Provide recommendations for future modularization and More ❯

art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯

digital media and publishing group, working within their commercial technology and advertising division. You'll collaborate with senior analysts and product teams to deliver solutions across ad platforms, data systems, and video advertising technology. This is a hands-on, technically focused role ideal for someone who enjoys working in a fast-paced, data-driven environment. Our … and product teams to gather and define requirements. Translate commercial objectives into detailed technical specifications. Support the development and enhancement of ad technology solutions. Analyse and document processes, data flows, and systems integrations. Contribute to projects involving ad blockers, data pipelines, and analytics (e.g. BigQuery). Experience & Skills 3+ years' experience as a Business Analyst Strong … technical understanding and ability to work closely with developers. Familiarity with ad tech platforms, data signals, or video ad stacks (e.g. programmatic advertising, publishing media environments). Advantageous: exposure to AWS, GitHub, or backend systems. Detail-oriented, proactive, and comfortable in a fast-paced commercial environment. Preference for candidates from product-led or media/tech organisations More ❯

ArchitectSFIA: 5IR35: OutsideSC: YesStart: ASAP End: 31/03Rate: £600 Outside ir35RemoteLooking for someone who can help with Business and solution architecture You will look at Google cloud Data pipelines The migration from Google Process ledBackground Solution architect background Business Change experience across an enterprise Tools and expereince SAS Products Digital product Experience Migration from Google to Mircosoft … AWS Powerapps solution experience IT Transformation experience Team make up Senior BA X2 Lead Data Engineer Senior Data EngineerIf interested please get in touch with your cv More ❯

enables real-time biological analysis at scale. This is your opportunity to work at the intersection of science and software , building the systems behind next-generation sequencing and data platforms from portable lab devices to large-scale research infrastructure used by institutions worldwide. The Role You’ll join a collaborative international engineering team developing and maintaining high-impact … data applications that support critical scientific and commercial operations. You’ll work on systems that process large biological datasets , support telemetry pipelines , and help deliver cutting-edge tools for researchers and scientists around the world. What You’ll Do Design, build and maintain data-intensive web applications and APIs Develop scalable systems using Python (Django, FastAPI … background in building web apps, APIs, or workflow engines Hands-on experience with Docker , CI/CD pipelines , and cloud-native environments Knowledge of databases (SQL, MongoDB) and data pipelines Familiarity with Kubernetes , Terraform , or related orchestration tools What’s on offer: Competitive salary and bonus Private healthcare & pension Collaborative, mission-driven culture If you’re a Python More ❯

looking for a hands-on Lead Software Engineer to own the design and delivery of our IoT and cloud software platform. Youll connect our ultra-fast chargers, manage data and remote control functions, and ensure security and scalability across our systems. Youll work directly with the VP Product and VP Power Electronics, shaping architecture, integrations and performance turning … ideas into real, working solutions. ________________________________________ What Youll Do Build IoT and cloud software for charger connectivity and monitoring Create telemetry and data pipelines (PLC, CAN) Enable secure remote control and bi-directional communication (MQTT/WebSockets) Deliver OTA firmware updates and REST APIs (OCPP/OCPI) Develop secure, scalable cloud infrastructure (AWS IoT, Azure, etc.) Collaborate closely with More ❯

performance engineering culture through structured reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What they’re looking for: 10+ years of experience … SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture Work with cutting-edge technology More ❯

performance engineering culture through structured reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What they’re looking for: 10+ years of experience … SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture Work with cutting-edge technology More ❯