401 to 425 of 472 Data Pipeline Jobs in London

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...

improving the robustness, stability, and performance of our technology systems. You will work across the technology platform, with an initial focus on data pipelines, helping to redesign and enhance data processes to make them more fault tolerant, scalable, and efficient. The role offers broad exposure … investment management data, systems, and the wider business. We will count on you to: Work closely with the Head of Production and support teams to identify areas for improvement Learn our technology architecture and systems, with a focus on trading systems and the data lake used ...

APIs, orchestration frameworks, RAG and retrieval patterns Making informed decisions between different models, platforms, low-code solutions and custom development Designing integrations, APIs, data pipelines and the underlying data architecture required by AI applications Working extensively across Microsoft technologies including Copilot Studio, Power Platform, Azure … Microsoft 365 Establishing reusable architectural patterns and engineering standards Considering security, governance, performance, resilience, data residency and cost throughout solution design Providing technical direction and mentorship to engineers Supporting client conversations, technical discovery, proposals and pre-sales activity Presenting complex technical concepts credibly to both technical ...

other internal systems, to build agents, automations, and tools that solve real business problems. The role partners closely and collaboratively with reporting, data engineering, operations, and other technical teams. Job ResponsibilitiesDesign, build, and maintain internal AI agents, applications, mcp servers, and automation workflows Develop and test scripts, APIs … agents that support reporting, operations, and cross-functional workflows Design and refine systems to ensure reliable, consistent outputs Apply established engineering practices, sound data structure design, and coding standards to deliver reliable, maintainable solutions Consider cost models (e.g., token usage, compute, API costs) when designing balancing performance with ...

with cloud and third-party AI services to deliver production-ready outcomes. Your role spans the full solution lifecycle — assessing client needs and data, selecting and customizing models (including Deep Learning, Generative AI, and Large Language Models), designing scalable data and DevOps & MLOps pipelines for training … practical, efficient, and scalable AI and Machine Learning solutions Develop and implement machine learning algorithms, models, and computational systems; design and build scalable data pipelines to support model training and production with DevOps & MLOps Customize and apply Deep Learning and Gen AI models for various use cases based ...

product whilst tackling key pain points our customers experience in dealing with our servicing teams. WHAT YOULL BE DOING Derive actionable insights from data to drive the team's strategy and inform product decisions. Establish clear goals, define measurable KPIs, and develop compelling narratives to help your team … understand their progress. Ensure accurate, impactful, fast decision making with high quality analysis, helping us to iterate faster. Build automated data pipelines and dashboards to minimise repetitive tasks and allow data self-serve. Identify & evaluate high impact opportunities, find ways to support & accelerate or identify ...

cutting-edge technology, AI-driven content creation, and cloud-native platforms, we're evolving from traditional shoot-led production to a scalable, data-driven content engine enabling faster speed to market, richer personalisation, and truly immersive shopping experiences. This is a unique opportunity to shape how millions … developing AI solutions using LLMs and generative AI, including iterating on prompts and workflows to improve output quality Building and maintaining scalable data pipelines, applying best practices in data preparation to ensure quality and reliability Helping to standardise and reuse AI workflows, making it easier ...

their AI platform. Responsibilities Design and develop scalable backend services using Golang and Python . Build and optimise APIs, databases and large-scale data pipelines. Develop reliable distributed systems handling significant traffic and data volumes. Improve performance, scalability, observability and infrastructure efficiency. Own features ...

cutting-edge AI capabilities and the specific needs of UK Government and defence organisations. You'll navigate complex procurement processes, stringent security requirements, data sovereignty concerns, and regulatory compliance while ensuring our customers successfully deploy and scale our AI solutions. In this role, you'll collaborate with … contact for government customers, building trusted relationships with departmental CIOs, IT directors, and technical teamsTranslate complex government requirements (security, compliance, accessibility, bilingualism, data sovereignty) into actionable engineering plansNavigate government procurement processes, RFP responses, and contractual technical obligations. Strategic Communication: Provide clear, timely, and objective communication across Cohere ...

build, train and optimise machine learning models focused on personalisation, recommendation engines, ranking algorithms, user segmentation and content analysis. Develop and maintain scalable data pipelines to support feature engineering, model training and deployment across large structured and unstructured datasets. Deploy, monitor and maintain machine learning models in production … ongoing optimisation. Design and analyse A/B tests and offline experiments to measure model effectiveness and drive continuous improvement. Collaborate closely with data scientists, engineers, product teams and stakeholders to align ML solutions with business and user requirements. Research emerging developments in machine learning, deep learning ...

into product workflows with guardrails, evaluation and monitoring - Optimise model serving and inference for latency and cost on AWS (ECS, Lambda, S3) - Build data pipelines for training and evaluation (PostgreSQL, Redis, OpenSearch) - Work with engineering, product and QA in Scrum squads, with CI/CD and infrastructure … including building APIs and integrating models into applications - NLP frameworks such as Hugging Face Transformers, PyTorch, spaCy or TensorFlow - AWS and distributed systems - Data pipelines and orchestration for model training and evaluation Nice to have - Legal tech or another document-heavy domain - Vector databases and semantic search (OpenSearch ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. QualificationsWhat do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. Additional InformationInterested? Find out more: How we work – a practical ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. Additional InformationInterested? Find out more: How we work - a practical ...

trade-offs and maintaining high standards of reliability, performance, efficiency and user experience. Influence beyond your immediate team: Collaborate with engineering, product, UX, data science, data engineering and business stakeholders to align technical decisions with broader product and commercial objectives. Challenge what's possible: Bring fresh … backend, frontend, mobile, APIs and system architecture as technical challenges require. Strong architectural design skills, including high-scale distributed services, well-designed APIs, data pipelines, efficient algorithms and reliable integrations. Sound technical judgment, with the ability to balance speed of delivery, experimentation, scalability and long-term engineering quality. ...

trade-off decisions in delivery and resourcing. Capability Building & Tech Pioneer Champion resilient, extensible, and reusable platform capabilities (APIs, Cloud infrastructure, and modern data architectures) that ensure scalability and a competitive advantage. Partner closely with engineering teams to challenge and inform technological choices that enable both near-term … design solutions. Define robust success metrics and customer-driven acceptance criteria to measure product impact and performance post-launch. Commercial & Business Focus Leverage data, business analytics, and operational rigor to ensure high-quality product performance and well-managed execution within a highly regulated consumer credit landscape. Partner with ...

their personal style as well as current fashion trends. This is a senior individual contributor role where you'll work closely with engineers, data scientists and product partners to productionise machine learning at scale. Our mission is to continuously improve the customer experience through thoughtful, responsible and high … this space)Familiarity with modern deep learning frameworks and distributed computing approaches for training large‐scale modelsExperience training models across GPUs using data and/or model parallelism, or enthusiasm to deepen your knowledge in this areaA solid understanding of software engineering principles, including data pipelines ...

client relationship made available via the Cloud. As a Machine Learning Engineer you will lead the Machine Learning activities within the Insights and Data Analytics Team from conception to deployment, creating and scaling high-impact models that solve core product challenges. You'll define the Machine Learning roadmap … from a technical perspective, evaluating model architectures, optimising data pipelines and ensuring that ML features provide actionable insights within the product. This isn't just about training models; it's about building the ML infrastructure that enables the business to iterate and scale with confidence. There ...

process as they are building and shipping the service behind it. What you'll doEmbed with customers to understand their actual operation — their data, their constraints, their people — rather than working from a requirements document written by someone who's never been on siteLead technical discovery: separate … across front-end and back-end, and build or extend the APIs and event-driven services that connect workforce, project, scheduling and financial data across IFS Cloud and customer systemsKnow the platform and AI service catalogue well enough to spot what can be reused or extended, and help ...

customers' needs at the centre of every decision while building effective controls that help Wise onboard businesses safely and compliantly. We use data, research, customer feedback and operational insights to identify the most important problems, reduce unnecessary friction and strengthen our verification processes. At Wise, teams have … What do you need? A strong product mindset and passion for user experience, you prioritise work with the customers in mind and make data-driven decisions to fix customer pain-pointsExperience of Java or other JVM based language, experience with Spring framework and deep understanding of JDBC ...

challenge isn't simply getting an LLM to produce an answer. It's designing systems that deliver accurate, reliable recommendations, work with complex data and can be maintained and improved in production. You'll be involved in: Designing the architecture for new AI-powered features and services. Building … Designing systems that incorporate user feedback to improve recommendations over time. Making architectural decisions around scalability, reliability, latency and cost. Building and optimising data pipelines, model evaluation and monitoring. Working closely with the CTO and wider engineering team, providing technical direction while remaining hands-on. What ...

Docusign solutions to accelerate the process of doing business and simplify people's lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were disconnected from business systems of record, costing businesses time, money, and opportunity. Using Docusign … into production level AI enabled business solutionsMemorialize repeatable deployment strategies and contribute insights and learnings back to Docusign product and engineering teamsDevelop robust data pipelines, containerized microservices, distributed system architectures, and system context management repositories to ensure autonomous AI tools operate accurately and reliablyMaintain strong knowledge ...

looking for a talented Data Engineer to join a growing team in London, working on high-impact data projects for well-known UK brands. You'll design and build scalable data pipelines, work with cloud technologies, and turn complex data into trusted … usable assets. You'll have the opportunity to work across a variety of projects while exploring how Agentic AI is transforming data engineering click apply for full job details ...

Description We're looking for a talented Data Engineer to join a growing team in London, working on high-impact data projects for well-known UK brands. \ N You'll design and build scalable data pipelines, work with cloud technologies, and turn complex data … into trusted, usable assets. You'll have the opportunity to work across a variety of projects while exploring how Agentic AI is transforming data engineering. \ N Wh... \ N \n \n ZIPC1_UKTJ ...

timePosted: 2026-10-27Closes: 2026-12-21Storage Architect - Engineering TechnologistInfrastructure Solutions Group (ISG) builds the products that power infrastructure, solutions, and data management our customers need most. Our teams design and develop the hardware and software that connect infrastructure, accelerate computational workloads, integrate across the stack … protect data continuity, and deliver the platforms, applications, and diagnostics our customers rely on every day at enterprise scale. Some product builders follow the rules. Ours rewrite them. Within ISG, innovation isn't just about creating new technology- it's about challenging assumptions and reimagining how work gets ...