926 to 950 of 1,055 Data Pipeline Jobs in England

the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯

the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯

the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯

the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯

management, risk analysis, and transaction processing. Work closely with traders, risk managers, and compliance teams to gather technical requirements and deliver efficient, automated solutions. Build and refine APIs, data pipelines, and automation tools for seamless connectivity across trading systems. Continuously improve system performance, reliability, and security through testing, troubleshooting, and enhancements. Ensure the knowledge underpinning any new enhancement … SQL Server) Unit testing and test automation frameworks (e.g. xUnit, NUnit) Microservices, Azure Cloud Services, Power BI Experience working In Agile development teams · Essential: Integrating and consuming market data feed APIs (e.g. Bloomberg, DataGenics etc.) Knowledge of Salesforce CRM & integration 5+ years software development in a commodities or financial services firm, ideally metals, but other commodities also possibility More ❯

management, risk analysis, and transaction processing. Work closely with traders, risk managers, and compliance teams to gather technical requirements and deliver efficient, automated solutions. Build and refine APIs, data pipelines, and automation tools for seamless connectivity across trading systems. Continuously improve system performance, reliability, and security through testing, troubleshooting, and enhancements. Ensure the knowledge underpinning any new enhancement … SQL Server) Unit testing and test automation frameworks (e.g. xUnit, NUnit) Microservices, Azure Cloud Services, Power BI Experience working In Agile development teams · Essential: Integrating and consuming market data feed APIs (e.g. Bloomberg, DataGenics etc.) Knowledge of Salesforce CRM & integration 5+ years software development in a commodities or financial services firm, ideally metals, but other commodities also possibility More ❯

Senior Backend Engineer| AI x Data Systems Salary £80 to 100K plus equity A stealth start up backed by top investors is reimagining how data-driven workflows are built and automated with AI ( FS and Fintech ). We're looking for a Senior Backend Engineer to help design and scale core infrastructure powering next-gen, high … throughput data systems. The role: -Build and optimise ingestion pipelines, APIs, and query engines -Own data performance across PostgreSQL, ClickHouse, and Kafka -Shape architecture for large-scale, AI-powered data processing -Work closely with product and AI teams to ship fast and iterate You'll bring: -5+ years of backend experience (Python, Go … or Kotlin preferred) -Strong SQL and data modelling skills -Experience with distributed systems, streaming, or event-driven design -Curiosity about AI, data pipelines, and intelligent automation If you're excited by building reliable systems for AI-driven products and want to make an impact at an early stage - let's talk. More ❯

Research Engineer (Data Infra/ML) London (Hybrid) Can you build & optimize distributed ML pipelines with Ray or Spark? Do you love speeding up cloud infra (Kubernetes, Docker, CI/CD)? Excited to build the data backbone for large-scale ML training? We're a tier 1 VC-backed start-up, developing hyper-realistic 3D simulations … robotics. Role You’ll be hands-on improving CI/CD pipelines, speeding up Docker builds, and scaling scene processing on Ray. You’ll also: Build high-performance data pipelines for multimodal datasets (3D, video, sensor). Optimize distributed training and processing across Spark, Databricks, and Kubernetes. Work with researchers to productionize PyTorch models and streamline ML workflows. … Develop tools that make data discoverable, reusable, and reliable throughout the ML lifecycle. You Strong Python skills and experience with distributed systems (Ray, Spark, Flyte, Dask). Hands-on with cloud, Kubernetes, and distributed training (Ray, PyTorch DDP, Horovod). Familiar with dataset versioning and experiment tracking (DVC, MLflow). Bonus Points Experience in simulation, robotics, or autonomy More ❯

Research Engineer (Data Infra/ML) London (Hybrid) Can you build & optimize distributed ML pipelines with Ray or Spark? Do you love speeding up cloud infra (Kubernetes, Docker, CI/CD)? Excited to build the data backbone for large-scale ML training? We're a tier 1 VC-backed start-up, developing hyper-realistic 3D simulations … robotics. Role You’ll be hands-on improving CI/CD pipelines, speeding up Docker builds, and scaling scene processing on Ray. You’ll also: Build high-performance data pipelines for multimodal datasets (3D, video, sensor). Optimize distributed training and processing across Spark, Databricks, and Kubernetes. Work with researchers to productionize PyTorch models and streamline ML workflows. … Develop tools that make data discoverable, reusable, and reliable throughout the ML lifecycle. You Strong Python skills and experience with distributed systems (Ray, Spark, Flyte, Dask). Hands-on with cloud, Kubernetes, and distributed training (Ray, PyTorch DDP, Horovod). Familiar with dataset versioning and experiment tracking (DVC, MLflow). Bonus Points Experience in simulation, robotics, or autonomy More ❯

The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯

The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯

Develop and maintain robust APIs for processing and publishing financial metrics Write clean, efficient, and well-documented code Collaborate with the team to design scalable solutions for financial data pipelines Participate in code reviews and contribute to engineering best practices Debug and optimize existing systems for performance and reliability Work closely with stakeholders to understand requirements and deliver … solutions Your Skills & Expertise Solid understanding of data structures, algorithms, and software design principles Good knowledge of Python and object-oriented programming principles Understanding of relational databases and database design fundamentals Familiarity with unit testing and integration testing practices Comfortable working collaboratively in a team environments Nice to have Experience with low-level programming languages (Rust, C++) Financial … domain knowledge: understanding of financial concepts, metrics, or fintech/finance experience Experience building data pipelines, ETL processes, or handling large-scale data Familiarity with modern data processing libraries (NumPy, Polars, DuckDB) What we're looking for Beyond the technical requirements, we value engineers who: Are self-motivated and eager to learn and expand More ❯

AI driven insight and decision platform used within industrial and manufacturing environments. The platform connects to maintenance, inventory and procurement systems and is designed to turn complex operational data into predictive insight and automated decision making. Our aim is to help factories and large operational teams move from manual processes to intelligent and automated workflows. The Opportunity We … reduce costs and automate routine procurement activity. A key focus of the role is building agent driven ordering systems. This includes developing AI agents that can gather price data from public sources, compare supplier options, validate stock requirements and place orders on behalf of users with the correct safety checks and approval flows. Key Responsibilities Design and build … AI powered features including intelligent search, agent driven ordering, predictive stock recommendations and automated procurement workflows Develop autonomous agents that can collect price data, assess supplier choices and initiate or complete ordering actions through APIs or connected systems Build retrieval augmented generation pipelines and vector search capabilities to support accurate and grounded decision making Integrate AI functionality with More ❯

AI driven insight and decision platform used within industrial and manufacturing environments. The platform connects to maintenance, inventory and procurement systems and is designed to turn complex operational data into predictive insight and automated decision making. Our aim is to help factories and large operational teams move from manual processes to intelligent and automated workflows. The Opportunity We … reduce costs and automate routine procurement activity. A key focus of the role is building agent driven ordering systems. This includes developing AI agents that can gather price data from public sources, compare supplier options, validate stock requirements and place orders on behalf of users with the correct safety checks and approval flows. Key Responsibilities Design and build … AI powered features including intelligent search, agent driven ordering, predictive stock recommendations and automated procurement workflows Develop autonomous agents that can collect price data, assess supplier choices and initiate or complete ordering actions through APIs or connected systems Build retrieval augmented generation pipelines and vector search capabilities to support accurate and grounded decision making Integrate AI functionality with More ❯

We are a high-growth scale-up building a cloud SaaS platform that enables industrial and energy clients to manage fleets of autonomous systems and turn vast inspection data into actionable intelligence. Our platform is becoming the “mission control” for critical infrastructure monitoring, combining dashboards, anomaly detection, rules/alerts, and predictive analytics into one solution. Already working … and architecture of a SaaS platform Deliver across backend (Java) and frontend (Angular) systems Build secure, scalable cloud infrastructure (AWS) Implement APIs, authentication (SSO/LDAP), and secure data pipelines Develop dashboards and data visualisations to transform complex datasets into actionable insights Partner with leadership to define the technical vision and roadmap Scale into a leadership … SaaS products Hands-on expertise with Java (backend) and Angular (frontend) Skilled in AWS cloud services Solid understanding of APIs, authentication, and security protocols (SSO, LDAP) Experience with data visualisation and analytics platforms Proven ability to design and deliver scalable, secure architectures Entrepreneurial mindset: comfortable working in fast-paced, scale-up environments Nice-to-Haves: Knowledge of machine More ❯

and deliver impactful solutions that meet the evolving needs of global clients. Ready to join a world-class technology powerhouse? Apply now! Responsibilities: Manage, and maintain the enterprise data architecture within SAP Datasphere, ensuring scalability, security, and performance Implement advanced data models using spaces, views, and semantic layers to support operational and analytical use cases Integrate … data from SAP (eg, S/4HANA, BW/4HANA) and non-SAP sources (eg, APIs, cloud platforms) to enable end-to-end analytics Design and tune data pipelines for both Real Time and batch processing within SAP Datasphere Requirements: Hands-on experience designing, implementing, and optimizing solutions in SAP Datasphere (formerly SAP Data Warehouse Cloud) Proficiency in building complex data models using spaces, views, semantic layers, and graphical modeling tools Deep understanding of integrating SAP (S/4HANA, BW/4HANA) and non-SAP sources (cloud platforms, APIs, flat files) into Datasphere Experience in managing metadata, data lineage, access controls, and enforcing governance policies within SAP Datasphere More ❯

real ownership come together to shape the future of ad-fraud prevention. The Opportunity In this role, you'll help shape a platform that processes large volumes of data and safeguards digital advertising integrity. You'll design simple, effective solutions, write maintainable Python code, and ensure reliability through testing and observability practices. The work spans implementation, documentation, and … team responsible for building and scaling the backend systems that power a machine-learning driven ad-fraud prevention platform. You'll work extensively with Python and large-scale data sets, supporting model training on billions of data points, delivering features to data science teams, and helping launch new models, tracking capabilities, and integration's … across major ad platforms. The work spans everything from developing big-data pipelines on cloud infrastructure (AWS, Redshift, or equivalent) to supporting greenfield projects like new affiliate products and upcoming channel integration's. You'll contribute to a fast-paced engineering environment that deploys to production twice a week, where processes exist but can evolve and where autonomy More ❯

team Pertemps, is the UK’s largest independent recruitment agency, who are looking for a skilled SQL Database Administrator to manage our SQL Server environment and Azure SQL Data Warehouse. This is a fantastic opportunity for a SQL Database Administrator who enjoys tackling complex database challenges and improving performance and efficiency.What you’ll be doing: Administering, monitoring, and … to keep systems running at their best Advising, rearchitecting, and tuning existing databases for improved performance and cost savings Managing Database Access and Security Patch Management Migrating SQL data from on-premises SQL Server to Azure SQL using Data Migration tools Developing and maintaining scripts using SQLCMD and PowerShell What we’re looking for: Previous experience … as a SQL Database Administrator Experience with Database Server Security Patch Management Strong experience with Azure SQL Data Warehouse and ETL/data pipelines (ADF) Proficiency in Database Access Management Expertise in SQL Server Administration, Performance Tuning & Optimisation Experience with backups, restores, and recovery models Knowledge of High Availability (HA) and Disaster Recovery (DR) solutions Ability More ❯

WFH Contract Type: Permanent TECHNE are representing exclusively a pioneering Battery Intelligence technology company is redefining how batteries are understood, optimised, and deployed. By combining electrochemistry, software, and data science , they deliver intelligent battery solutions across the full value chain - from automotive and energy storage to heavy-duty applications. They are now seeking a Cloud Application Engineer to … join their growing technical delivery team. This is a 90% technical, 10% customer-facing role focused on building and customising data pipelines , integrating battery analytics into customer frameworks, and collaborating closely with the product and cloud development teams. Role Overview You will act as the primary technical contact on customer-facing projects, translating requirements and providing technical support … and the core cloud development team. The role involves building automated customer pipelines for battery analytics , customising the existing codebase for customer-specific orchestration frameworks, and turning raw data into actionable, business-relevant insights. You’ll also contribute to the ongoing development of the Battery Intelligence Cloud Platform , helping to accelerate global electrification by improving the performance, safety More ❯

Description We are seeking a skilled Palantir Developer to join our data engineering team. You will leverage Palantir Foundry to design, develop, and maintain data pipelines, models, and applications that enable advanced analytics and operational insights across the organization. Skills Palantir Gotham Foundry SQL ETL Python Linux Java Systems Engineering Job Title: Palantir Developer Location: London … referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website. To access our Online Privacy Notice, which explains what information we may collect … you, and describes your rights and choices about this, please go our website. We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group More ❯

to guide small, inexperienced client teams in a collaborative yet authoritative manner. You will play a key role in shaping and delivering solutions built on open-source technologies, data pipelines, vector stores, and Generative AI (GenAI) capabilities, with an emphasis on integrating Large Language Models (LLMs). Key Responsibilities Leadership & Collaboration: Lead and mentor small client teams with … clearly to technical and non-technical audiences. Build strong relationships with client stakeholders, ensuring alignment on objectives and expectations. Technical Delivery: Design, implement, and document end-to-end data and GenAI solutions using open-source and cloud-based components. Develop and maintain data pipelines, vector databases, and LLM integrations. Configure and optimize solutions on Microsoft Azure … communication and presentation skills. Strong team player with a collaborative, mentoring mindset. Hands-on experience with open-source technologies across front-end and back-end systems. Proficiency in data pipelines, vector stores, and Generative AI/LLM implementations. Working knowledge of Microsoft Azure Cloud services, including configuration and deployment. Strong documentation and reporting skills. Desirable Current DV Clearance More ❯

OpenAI, Anthropic, or open-source LLMs) for business use cases using prompt engineering and reinforcement learning. Experiment with model configurations to balance performance, cost, and scalability. Build robust data pipelines for continuous model improvement and retraining. Ensure compliance with ethical AI and data governance standards (privacy, bias mitigation). Develop APIs, microservices, and integrations to embed … AI-driven features in production. Required Skills Programming: Python, .NET/C# (Key to have a background in C#) Knowledge of AI principles and AI ethics Knowledge of data safety in LLM usage Experience with: AWS: boto3, Bedrock, SageMaker, Lambda, S3, EC2 Azure: Azure OpenAI Service, Cosmos DB Retrieval-Augmented Generation (RAG), Graph RAG Embedding models and LLM … Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found on our website. Please note that no terminology in this advert is intended to discriminate on the grounds of a person's gender More ❯

of real-world cyber threats. As a Senior Backend Engineer , you’ll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assets—helping global security teams uncover exposures before attackers do. What you’ll be doing: Designing and building backend services and data pipelines powering … a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally What they’re looking for: 5+ years’ experience designing and maintaining mission-critical backend … clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus points if you’ve worked with: large-scale data processing, ETL pipelines, cloud deployments, or DevOps/CI-CD practices. Why join? Competitive salary + benefits Ownership and impact in a high-growth cybersecurity scale-up Work with More ❯

Engineer , you’ll play a critical role in building and scaling the core platform. Working directly with the CTO and founding team, you’ll design backend architecture, build data pipelines, and integrate AI/LLM components into production systems. Role Breakdown: 50% Backend Engineering: FastAPI, Flask, Node.js, CI/CD 30% Data Engineering: ETL, DBT, Airflow … AI/LLM Integration: LangChain, RAG pipelines, orchestration Key Responsibilities: Design and build backend services to support AI agent deployment Develop scalable data pipelines and integration layers Implement AI/LLM-powered features with LangChain and related frameworks Collaborate with the CTO and adoption engineering team to deliver production systems Contribute to architecture decisions for scalability and reliability … person founding group including CTO, Head of Front-End, and adoption engineers Reporting Line: CTO Visa: Cannot sponsor Ideal Profile: 5–8 years’ experience in backend or data engineering (Python) Exposure to AI/LLMs, RAG, or personal AI side projects Experience in startups or scale-ups where you’ve helped build or grow systems Solid education and More ❯

Engineer , you’ll play a critical role in building and scaling the core platform. Working directly with the CTO and founding team, you’ll design backend architecture, build data pipelines, and integrate AI/LLM components into production systems. Role Breakdown: 50% Backend Engineering: FastAPI, Flask, Node.js, CI/CD 30% Data Engineering: ETL, DBT, Airflow … AI/LLM Integration: LangChain, RAG pipelines, orchestration Key Responsibilities: Design and build backend services to support AI agent deployment Develop scalable data pipelines and integration layers Implement AI/LLM-powered features with LangChain and related frameworks Collaborate with the CTO and adoption engineering team to deliver production systems Contribute to architecture decisions for scalability and reliability … person founding group including CTO, Head of Front-End, and adoption engineers Reporting Line: CTO Visa: Cannot sponsor Ideal Profile: 5–8 years’ experience in backend or data engineering (Python) Exposure to AI/LLMs, RAG, or personal AI side projects Experience in startups or scale-ups where you’ve helped build or grow systems Solid education and More ❯