176 to 200 of 279 Data Pipeline Jobs in the South East

Data Engineer (Tech for Good) Hybrid – London Office & Home-Based Up to £68,000 per annum Are you a skilled data engineer looking to make a real-world impact? Join a fast-growing tech-for-good company using data to drive positive change for … people and the planet. We’re looking for a mid-level Data Engineer with 3–4 years of experience to help shape and scale our data platform, supporting socially responsible projects across the organisation. Your Role: Develop and maintain cloud-based data pipelines (real … time & batch) Design data models and ETL/ELT processes using AWS, Snowflake, etc. Collaborate across technical and non-technical teams Troubleshoot issues and support wider team adoption of the platform What You’ll Bring: Proficiency in Python, PySpark, Spark SQL or Java Experience with cloud tools (Lambda More ❯

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance More ❯

Principal Data Engineer 👔 FinTech 📍 London (Remote First) 💵£120-150k 📦Equity Incentive Scheme, Private Medical, Flexi-Working, Quarterly Salary Reviews, Half Day's L&D per fortnight Do you want to work for one of the fastest growing FinTech's in the B2B Banking space? Do you want … to want to own the Snowflake rollout for a business that runs on Data-Driven Decision making? My client are a hugely successful FinTech, who's data driving approach to lending is making big waves in the B2B banking sector. They now have an imminent requirement … for a Principal Data Engineer to spearhead an exciting new project for them, ideally with good knowledge of: Data Warehousing (Snowflake) Data Pipelines (DBT, Kafka) Programming (Python) Relational Databases (SQL, PostgreSQL, LookML) Data Visualisation (Looker) DevOps (Docker, K8s, Terraform) But most importantly More ❯

view synthesis, video generation, or 3D reconstruction. Familiarity with video processing tools (e.g., OpenCV, FFmpeg). Experience with large-scale model training and data pipelines. Contributions to relevant open-source projects. More ❯

+ Bonus, Benefits, Sales-Assist & Share Scheme 🕐 Full-Time | Permanent 🚫 No sponsorship available About Us Our client is a leading Data & AI consultancy and Microsoft Advanced Specialised Partner, delivering high-impact solutions across finance, healthcare, and retail. With a team of award-winning professionals, they drive innovation through … Microsoft Azure-based data platforms, helping clients solve complex business problems with elegant, scalable solutions. This is your opportunity to become the technical cornerstone of a growing, high-performance consultancy that values autonomy, expertise, and ownership. The Role We are seeking a Principal Business Intelligence Consultant with a … strong background in Microsoft Azure Data & AI solutions. You’ll play a pivotal role in leading the design, development, and delivery of advanced analytics and data engineering solutions, while also driving client engagement and contributing to the strategic growth of the consultancy. You’ll be a More ❯

technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive … Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability of the … technology in financial markets. Key Responsibilities: Design, develop, and maintain highly efficient Python-based applications for commodities trading, risk management, and real-time data analysis. Build scalable, high-performance data pipelines to process large datasets from multiple sources, including real-time market data and More ❯

in a commercial setting. Technical Skills : Proficiency in Python and libraries like TensorFlow, PyTorch, scikit-learn . Strong understanding of machine learning algorithms, data pipelines, and model deployment. What’s on Offer: Very competitive salary and stock options. Hybrid work model with flexible hours. Opportunity to work on More ❯

experimentation and iteration Enjoys working in a high-ownership, fast-paced startup environment Nice to have (but not required): Experience with APIs, SaaS, data pipelines, or cloud platforms (e.g., AWS) Familiarity with TypeScript or modern frontend/backend stacks What You’ll Get £80k–£120k base salary + More ❯

infrastructure that powers our cutting-edge medical technologies. Expect to: Design and develop event-driven backend services and modern microservices architectures. Build robust data pipelines and optimise deployment processes. Work cross-functionally on architecture, testing strategies, and system enhancements. Write clean, high-quality, maintainable code that drives real More ❯

to join their agile and collaborative software delivery team. You will play a leading role in shaping innovative, scalable solutions across backend systems, data pipelines, and modern web platforms, directly contributing to meaningful outcomes for Government clients . Key Requirements We are seeking a versatile and experienced Software More ❯

and partnerships, their growth trajectory is steep, and they’re building a best-in-class technical team to scale even faster. Right now, Data Engineering is their #1 priority. They’re actively hiring for: Data Engineer Lead/Head of Data Engineering About the … in combining technical excellence with creative innovation Why They’re Hiring: Their AI researchers and scientists are stretched thin, pulled into building foundational data pipelines when they should be focused on modeling. They're standing up a dedicated Data Engineering team - and they need top talent … think video datasets at petabyte scale) Curate datasets from messy, unstructured sources - with a focus on automation Architect ingestion systems and build scalable data infrastructure Partner deeply with Infra, AI Research, and Product teams Play a key role supporting projects like foundational model development and synthetic data More ❯

on experience with RAG (Retrieval-Augmented Generation) and deploying LLM solutions • Proven ability to build AI workflows and design effective prompts • Experience defining data pipelines and building microservices for deployment on AWS or Kubernetes • Bonus points for prior experience mentoring or leading a small team 📍Location: London More ❯

an early-stage startup or high-growth technology company Familiarity with cloud platforms and infrastructure as code (AWS, GCP, Terraform, etc.) Experience with data pipelines, event-driven architectures, or real-time systems What’s on Offer Early-stage equity as a bonus and between £50-£80k. Opportunity to More ❯

Senior Data Scientist - Python - SQL - Blockchain - Hybrid (London) - £75k-£95k (Equity Offered) Currently working with a client in the Crypto industry who is looking for a motivated senior data scientist to join their team and help prevent financial crimes and allow cryptocurrencies to be used for … good. Responsibilities: Work in a highly collaborative environment with engineers, blockchain analysts, data scientists, researchers. Your shared goal is creating intelligence, you contribute in different ways. Be deeply opinionated about where we're spending our time, and how we can increase the value of our intelligence. Own your … model? Participate in a collegiate group of blockchain experts, share your knowledge across our business wherever it is effective. Requirements: Is comfortable querying data with SQL and Python. Can optimise queries for huge datasets. Has a solid understanding of blockchain ecosystem elements like DeFi, Exchanges, Wallets, Smart Contracts More ❯

of new Trading desks across both the Systematic HFT and Discretionary businesses they're now looking to hire an experienced Software Engineer/Data Engineer to work closely with Trading, Quant Research, and parallel Technology teams. This is a fast-paced, collaborative and innovative environment, suited to individuals … both autonomously and as part of a vibrant rapidly expanding group. Your focus will be the design, building and implementation of advanced Big Data solutions, to enable the capture, ingestion, storage, and provision of Terabyte sized Alternate Datasets. Tools you'll create include ETL/ELT Data Pipelines and Frameworks APIs Data Store Candidate's suitable for this role, will ideally have 3-8 yrs' of blended Data Engineering and Software Engineering skills, include ETL/ELT pipelines for High throughput (and Low Latency Data) Expert Python skills including More ❯

meets meaning. We’ve evolved from a kinetic energy pioneer into a next-generation AI-powered engagement platform that transforms footfall into energy, data, and dynamic experiences. Our mission? To revolutionise how people connect with the spaces around them - through intelligent, sustainable, and interactive technology. That’s where … management role. You'll already understand and be in a position to architect complex integrated environments that connect hardware (kinetic and solar floors), data collection modules, cloud infrastructure, and customer-facing digital experiences while adding new technologies such as AI, Digital Twin and more working with our in … lead the charge on building our smart infrastructure ecosystem - from IoT devices on the ground, through to digital twins, edge computing, and cloud data pipelines that drive actionable insight for our clients. Responsibilities Technology Vision & Strategy Own and evolve the company’s technology roadmap to support the next More ❯

Osterley/Hybrid Duration: 12 Months We are seeking a highly skilled and experienced Back-End Developer with advanced expertise in Go (Golang), data analytics, and cloud-based backend services. This individual will play a key role in building scalable APIs, processing data pipelines, and supporting … services using Go (Golang). Design and implement RESTful APIs and GraphQL endpoints to support front-end applications. Process and optimize large-scale data pipelines for real-time analytics and reporting. Write clean, maintainable, and efficient code that adheres to best practices and coding standards. Utilize AWS cloud … services for scalable and secure backend application deployment. Ensure robust data storage and management using PostgreSQL and other database solutions. Implement authentication, authorization, and security best practices in backend services. Improve CI/CD pipelines for automated deployments and infrastructure management. Architecture and Performance Lead performance optimization initiatives More ❯

data to personalize interactions in a compliant manner, at scale (20m consumers and growing 10% MoM) Built out a data pipeline capable of handling millions of events daily Enabled the use of multiple LLMs for a single interaction, optimized for the best performance while reducing More ❯

and production support when needed. Key Requirements Solid experience working with Openlink Endur, including configuration and customisation. Familiarity with downstream system integration and data pipelines around Endur. Strong knowledge of OpenJVS and SQL. Exposure to or experience with Java development. Experience with Linux, Git, RabbitMQ, FIX messaging, and More ❯

class AI-enabled platform in a high-ownership environment, where you’ll be leading development across the backend, ML service, ML infrastructure, and data pipelines. Fine-tune and deploy large language models for patent search, analysis, drafting, and other intellectual property workflows. Evaluate and improve large language model More ❯

risk intelligence who are seeking a Senior Machine Learning Engineer. You will work along the end-to-end machine learning lifecycle, focusing on data engineering and maintaining real-time data pipelines. Your responsibilities will include developing and maintaining ETL processes, designing and implementing machine learning algorithms … and deploying and monitoring models in production environments The Ideal Candidate Education & Experience: Bachelor's or Master's degree in Computer Science, Data Science, or a related field. 7+ years of professional experience in areas such as fraud prevention or credit scoring. Machine Learning Expertise: Strong understanding of … machine learning algorithms and their practical applications. Experience with frameworks like TensorFlow, PyTorch, and scikit-learn. Data Engineering: Proficiency in developing and maintaining real-time data pipelines. Experience with ETL processes, Python, and SQL. Familiarity with big data technologies like Apache Hadoop and Apache More ❯

Data Scientist at Cerberus Capital Management As a Data Scientist in our AI team, you will contribute to the firm’s objectives by delivering rapid and scalable solutions that unlock value for Cerberus desks, portfolio companies, or other businesses/investments. You’ll do this by … member of the team. Technology polymath: experience with a wide range of technology and can learn and develop any solutions across the full data science lifecycle and application stack. Test & learn mentality: Challenge our current best thinking, test ideas, and iterate rapidly. Creativity: Invent new analyses and methods … STEM field or equivalent and advanced degree. Strong knowledge of statistics, machine learning, forecasting, NLP, computer vision, optimisation. Python programmer with experience building data pipelines and statistical/machine learning models. Additional languages preferred, particularly HTML+CSS+JavaScript, or low-level compiled languages such as C/C++. Proficiency in More ❯

internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality … providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software …/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure , latency optimization , execution systems , and market data feeds . Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a More ❯

applications working with other staff and partners. Collaborate with cross-functional teams to design, develop, and implement scalable and reliable cloud applications. Utilize data science and analytics to enhance application functionality and performance. Work with the data team to create and deploy machine learning models and … enterprise architecture design and delivery (Azure, GitHub, etc). Proven experience in building cloud applications using Microsoft Azure/cloud. Strong interest in data science and analytics. Excellent problem-solving skills and attention to detail. Knowledge of effective business analysis - ability to gather, document, and analyze business requirements … manufacturing, retail or hospitality industries. Knowledge of other programming languages and frameworks. Interest and experience with AI solution engineering Interest and experience of data analytics and data pipelines. What We Offer: Competitive salary and benefits package. Opportunities for professional growth and development. A collaborative and supportive More ❯

evolution. You won’t be stuck in a mere “pre-sales” loop—instead, you’ll dive into the technical depths, from integrating complex data pipelines to developing custom enterprise applications, all powered by our AI-6 platform. Your work will drive real business value and transform how organizations … BeyondRisk empowers organizations to rapidly design, build, and scale AI-driven solutions through our AI-6 platform. We seamlessly bring together smart agents, data, and automation so enterprises can solve their toughest challenges at speed. Backed by leading Silicon Valley investors - we’re expanding our specialized Forward Deployed … challenges—sometimes at the executive level—and translate them into clear technical requirements and project plans. Architect & Implement End-to-End Solutions Plan data models, orchestrate data pipelines, and build full-stack applications leveraging languages such as Python, Java, C++, or TypeScript. Embed AI Workflows Utilize More ❯