17 of 17 Data Pipeline Jobs in the City of Westminster

hackajob is partnering directly with Moody's Corporation to hire for this role. Skills and Competencies 6+ years of experience in Data Engineering, Analytics Engineering, Solution Engineering, or related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform … Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable analytics and artificial intelligence use cases Proven knowledge of data modeling, data governance ...

client is looking for an experienced Senior Data Engineer to join them on a contract basis , taking end‐to‐end ownership of business‐critical data products on their Azure Databricks‐based data platform . This is a hands‐on role embedded directly within … product team, working closely with product managers and lead engineers to raise engineering quality and shape how modern data products are built for analytics and AI. The Role As a Senior Data Engineer, you will: Design scalable data products within a cross‐functional product ...

This role will be responsible for leading business process redesign, map existing and to-be processes for operational optimization, digital transformation initiatives. With Data at the heart of everything we do, this role will require strong data analytical skills, tracing lineage of data, and developing conceptual and logical data models. The role is expected to drive cross-functional collaboration and effective communication with business and technology partners, to guide, influence and convince others and lay the direction for Product development. Ownership of the Product backlog and roadmap, strategy, outlining ...

Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable Work hands-on with Databricks suite to deliver high-quality data engineering solutions … data science teams Contribute to collaborative development through GitHub, code reviews and shared engineering standards Work effectively in feature-led environments, supporting repeatable, controlled and high-quality delivery Strong data engineering experience, with the ability to work independently, take ownership, and be accountable for delivery outcomes. ...

Simply the Best'. Job Category Technology Position Type Permanent Target Openings 1 What Is the Opportunity? Heres what youll be doing: Data isnt just numbers to usits the driving force behind how we champion and protect millions of small business owners. Joining our award-winning, international data team, youll dive headfirst into modern Big Data and analytics technologies to solve real-world problems. In this role, youll work at the intersection of business strategy and technical innovation. You'll team up with cross-functional developers, data engineers, and data ...

design, build, test, and deploy scalable AI services integrated with strategic systems and operational processes. You will collaborate with software engineers, AI and data science specialists, operations stakeholders, and business partners to improve operational workflows, controls, and the software development lifecycle. You will focus on hands-on engineering … experience Demonstrate strong Python programming skills Design, develop, and integrate RESTful APIs, such as with FastAPI Build and support ETL and data pipeline engineering workflows Apply Infrastructure as Code practices, such as Terraform, and work within CI/CD pipelines Design and integrate databases and data ...

Senior Data Scientist, Graph Risk Analytics Department: Engineering Employment Type: Full Time Location: London Compensation: £105,000 - £120,000/year Description Location: London, UK Annual Remuneration : £105,000 - £120,000 and discretionary annual bonus Pay Frequency : Monthly Probationary Period: 180 days Work Arrangement : Hybrid, 3-days … week TL;DR Kharon is seeking a full-time Senior Data Scientist, Graph Risk Analytics based in London. RESPONSIBILITIES: Taking ownership of Kharon's risk propagation and entity analytics system — the engine that evaluates entities in our knowledge graph and surfaces meaningful risk signals to customers Designing ...

Marks & Spencer plc in London is seeking a data engineer to design, build and maintain robust data pipelines that support data science workflows. You will manage Airflow orchestration and work hands-on with the Databricks suite to deliver high-quality data engineering … solutions for data science teams. You will collaborate across teams, participate in code reviews on GitHub, and contribute to shared engineering standards while continuously learning in a fast-changing environment. #J-18808-Ljbffr ...

deliver production-grade solutions., AI Solution Development Technical Architecture & Implementation Architect and implement RAG pipelines for knowledge retrieval from structured and unstructured financial data sources Design and optimize vector databases and embedding strategies for efficient information retrieval Develop prompt engineering frameworks and fine-tuning strategies for domain-specific … applications Build multi-agent systems that can collaborate to solve complex financial problems Implement guardrails, validation frameworks, and monitoring systems for AI applications Data Engineering & Integration Design and build data pipelines to support AI/ML workflows, integrating market data, trade data ...

Google Inc. is seeking a Senior Data Scientist in London to advance reliability analytics. You will design ML tools and data pipelines, influencing platform reliability and change management across Google Cloud Platform. The role emphasizes collaboration with engineering and product teams to drive data-driven improvements. The Reliability Analytics Team aims to improve decisions and systems on PRE through advanced data science, statistical methods, and generative AI approaches to benefit #J-18808-Ljbffr ...

Developer Advocate) within the cloud computing industry. Experience designing, architecting, and deploying cloud-native applications, containerized environments (Kubernetes/GKE), and modern data pipelines. Preferred qualifications: Experience working directly within or as a technical advisor to high-growth, venture-backed startups or scaleups. Background as a CTO, lead … architect, or head of engineering at a startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning ...

evolve the technical systems that power P&T Business Operations - Jira architectures, data pipelines, dashboards, and integrations with enterprise platforms. You identify where operational capability could be stronger, scope those opportunities, and design and build solutions in collaboration with the Business Operations Manager. You approach problems with … first mindset and make technical decisions with clarity about trade-offs. Own and evolve the standardisation of Jira and other Kaluza data systems. Configure, extend, and redesign them to support increasingly complex business operations. Build and maintain reliable data pipelines and dashboards that turn raw operations ...

research or research engineering, including experience leading technical projects. 3 years of experience training, adapting, or evaluating large-scale foundation models, and building data pipelines for heterogeneous datasets. 3 years of experience with modern machine learning frameworks (e.g., JAX, PyTorch, TensorFlow) and distributed training on accelerators. 3 years … research projects. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. Experience modeling longitudinal or multimodal real-world data (e.g., audio, wearable sensor data, health records). Experience profiling and debugging distributed training on TPU or GPU clusters (including handling data ...

Rates Swap Derivative products and Options products . You will be responsible for developing scalable, performant code that handles large volumes of market data and complex financial calculations. This includes implementing risk metrics, PnL attribution frameworks, and data pipelines that connect trading systems with downstream consumers. … rates products including Swaps, Securities, Options, and Repo Familiarity with risk methodologies and PnL calculation frameworks Experience with distributed systems and real-time data processing Proficiency with relational and NoSQL databases Knowledge of modern development practices including CI/CD pipelines and containerization Exposure to quantitative finance concepts ...

years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. Preferred qualifications: Experience with data pipelines. Knowledge of SQL. Strong understanding and experience with production systems. Ability to manage issues and evolving changes in the areas of software design … looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will ...

include building workflows, integrating codecs with AI and media frameworks, and exploring how LCEVC and VC-6 can reduce the amount of video data, decoding and processing required by AI applications. The Integration Team's day-to-day work is dynamic. You will collaborate with codec engineers … tools and sample applications for V-Nova's LCEVC and VC-6 technologies within AI video workflows. Integrate codec SDKs into video curation, data preparation and inference pipelines, including workflows using technologies such as NVIDIA NeMo Curator, with either native integrations or via frameworks such as FFmpeg ...

Kaluza Ltd. is seeking an experienced technical operations specialist to own and evolve Jira architectures, data pipelines, dashboards, and platform integrations. You will identify opportunities to strengthen operational capability, scope solutions, and co-build them with the Business Operations Manager, with an AI-first mindset and clear trade ...