151 to 175 of 254 Remote Data Pipeline Jobs

building the infrastructure and systems that power pricing and revenue optimisation across our platform. This role sits at the intersection of backend engineering, data engineering, and pricing systems. You’ll design and build scalable services, pipelines, and APIs that enable pricing logic, experimentation, and automation across our marketplace. … will work closely with Pricing, Data, Product, and Engineering teams to productionise pricing models and ensure pricing systems are reliable, observable, and built to scale. This is a hands-on engineering role focused on building robust, production-grade systems that support revenue-critical decision making. ...

Funds (ETF) sector, is seeking an experienced Lead Python Developer to play a key role in shaping the future of their technology and data platforms. This is a rare opportunity to join a highly respected organisation operating at the intersection of technology, data and financial markets. … delivery of business-critical solutions while working closely with senior stakeholders across the organisation. Key Responsibilities: Leading the design and development of scalable data platforms and applications Building and optimising Python-based solutions and automation tools Developing and maintaining PostgreSQL databases and data models Delivering Azure ...

building high-performing engineers, teams, and processes.Experience as an individual contributor or leader in the Search DomainWorked closely with Machine Learning and Data Science colleaguesWorked closely in tandem with Design and Product, as either a Product Engineer in the past, or Engineering Manager, to build rich user experiences.You … thrift.Bonus points if:You are familiar with search engine technology such as OpenSearch, ElasticSearch, Vespa..You are familiar with observability, tracking and data pipeline tools and methodologies.Additional InformationHealth + Mental WellbeingPMI and cash plan healthcare access with BupaSubsidised counselling and coaching with Self SpaceCycle to Work scheme with ...

Lead Data & Insight Analyst Location: Chertsey (Hybrid - 2 days onsite) At Foodbuy, we're driving transformation through data. As the procurement and supply chain division of Compass Group UK & Ireland, we sit at the heart of a £2.6bn spend network-delivering insight-led solutions to some … most recognisable organisations across healthcare, education, hospitality and business. We're now looking for a Lead Data & Insight Analyst to join our growing Analytics team, playing a key role in shaping how data and insight drive decision-making across the business. The Role This ...

third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. … Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services ...

technical delivery of customer projects Designing scalable, secure and resilient system architectures Translating customer requirements into practical technical solutions Working across cloud, integrations, data pipelines and distributed systems Providing technical leadership to multidisciplinary engineering teams Managing technical risk and driving engineering best practice Requirements: Systems Engineering, Solution Architecture ...

building high‐performing teams and processes. Experience as an individual contributor or leader in the Search domain. Worked closely with Machine Learning and Data Science colleagues. Worked closely with Design and Product as a Product Engineer or Engineering Manager to build rich user experiences. Full‐stack expertise, leveraging … familiar with search engine technology such as OpenSearch, ElasticSearch, or Vespa. You are familiar with observability, tracking, and data pipeline tools and methodologies. Additional Information Health & Mental Wellbeing: PMI and cash plan healthcare access with Bupa, subsidised counselling and coaching with Self Space, Employee Assistance Programme ...

Lead Data Engineer £400/day (Outside IR35) | 3-Month Initial Contract, with view to extend | Remote (occasional travel to London) | UK-based candidates only, must hold full right to work in the UK About the Role We're looking for a Lead Data Engineer … take ownership of core data engineering and architecture work while providing technical leadership to a delivery team. This is a hands-on senior role for someone equally comfortable designing scalable data solutions and guiding the engineers building them. Key Details Rate: £400 per day, Outside IR35 ...

opportunity This is not a standard reporting role. Our client is looking for a commercially minded analyst who is genuinely passionate about data - someone who sees insight as a tool for making better business decisions, not just producing charts for a weekly report. You'll be embedded … Projects team that delivers complex, bespoke, multi-million-pound solutions to international clients. You'll own the data and analytics function for that team - building dashboards, interrogating cost data and helping project managers and commercial leads make smarter decisions throughout the project lifecycle. Longer term, there ...

Lead Data Scientist | Fully Remote | £90,000–£100,000 + Benefits Build the models behind real-time decision making at scale. Why this role stands out This isn’t just another senior data science position. It’s a chance to shape the future of analytics … most successful privately owned technology businesses, a market leader trusted by millions and driven by data at its core. You’ll join a high-performing team working with real-time data, advanced machine learning, and large-scale analytical systems, with the freedom to influence both technical ...

delivery. You get huge satisfaction from tackling complex and ambitious problems, and delivering the highest quality features.Strong decision making skills, based on the data available in the face of ambiguous or changing priorities and goals, with preference towards simplicity and a strong bias towards delivery.Strong stakeholder management skills … familiar with any one of the following technologies : Scala, Java or Typescript.You are familiar with observability, tracking and data pipeline tools and methodologies.You have previously worked in an App first business.Additional InformationHealth + Mental WellbeingPMI and cash plan healthcare access with BupaSubsidised counselling and coaching with Self ...

About Future Works Future Works is a US-focused, AI-native professional services firm building operational AI and data systems. Our foundation beliefs are simple: optimization lowers need for resources, which increases sustainability and resilience. We are a team of "Time Benders" on a mission to collapse timelines … operational transformation of high footprint companies in energy, real estate, data and beyond. Together, we master velocity. We achieve our mission by building flawless, AI-powered systems. Our technology is already far more advanced than that of boutique services firms, but we are only getting started ...

vector database implementation, with practical experience using technologies such as OpenSearch, FAISS or similar to support scalable, production-ready retrieval workflows. Data pipeline engineering, building and operating AI-ready pipelines using AWS Glue, S3, and related services to support model training, inference and evaluation. Advanced observability ...

distributed training (DeepSpeed/FSDP/SLURM/K8s). Experience in deep learning, NLP or LLMs; bonus for CUDA or data‐pipeline chops. Strong software‐design instincts: testing, code review, CI/CD. Self‐starter, low‐ego, collaborative. Benefits France 💰 Competitive cash salary and equity 🥕 Food ...

guidelines for Airflow clusters and DAG's, working knowledge of performance tuning of the DAG's and task implementation, developing DAG - data pipeline to on-board and change management of datasetsExperience with installing, configuring and monitoring Airflow cluster, strong PythonUnderstanding of Airflow rest services and integration ...

Data Engineer - SC Cleared UK (Remote/Hybrid) | £490 per day | 6 Months | Inside IR35 We're seeking an experienced SC Cleared AWS Data Engineer to support a high-profile Central Government programme delivering critical data capabilities within a secure cloud environment. This … excellent opportunity to contribute to nationally significant work while leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage ...

applications without this cannot be considered) Core Engineering: Strong backend development skills (Python, Go, or C++) with solid API design and data pipeline experience AI Tooling: Hands‐on experience integrating LLMs, handling vector databases, and building robust chunking/embedding strategies Secure Architecture: Deploying LLM pipelines ...

production-scale algorithms for real-time intraoperative tissue intelligence. You will architect, train, and deploy ML models for hyperspectral imaging, build robust data pipelines, and maintain compliant ML systems in a regulated medical setting. You will collaborate with scientists, engineers, and regulatory teams, mentor juniors, and contribute ...

Engineering: Design, code, verify, test, and refactor complex backend applications and streaming services from agreed specifications. Event-Driven Design: Develop and maintain scalable data pipelines and real-time streaming architectures using Apache Kafka. Technical Governance: Active contributor to the selection of development tools and security practices. Lead technical ...

evidence to identify emerging risks, shape policy and improve decision making at a national level.Rather than focusing on building machine learning models or data pipelines, this role is centred around designing robust statistical methodologies , helping establish best practice and developing the long-term capability of the organisation ...

will have the opportunity to shape the direction of the product. You will evaluate your own work, leveraging our data pipeline and frameworks that we have established to understand the impact your features have on our commercial objectives and pivoting where necessary. You will consider the long ...

speed AI analytics at over 60 frames per second. Seamlessly integrating into existing surgical vision systems, our technology transforms standard cameras into intelligent, data-rich tools, revealing anatomical, physiological, and pathological information beyond human vision. Certified for both open and minimally invasive surgery, our platform achievedUKCA certificationandFDA clearancein … Program. With multi-centre clinical evaluations underway and strategic partnershipswith world-leading technology and surgical manufactures,includingimecandZEISS Ventures,Hypervisionis shaping the future of data-driven surgery. Hypervision Surgical process all personal data in accordance with the UK GDPR and Data Protection Act 2018. ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...