26 to 50 of 94 Data Pipeline Jobs in the City of London

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working with some … most complex data challenges in the insurance and financial services sector, operating in a highly regulated and analytically demanding environment. You’ll help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping long‐term Azure ...

reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging … technologies. The successful candidate will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies ...

rebuilding the investment stack from the ground up. As we scale into a next-generation environmental asset manager, we are designing a proprietary data and AI platform that transforms how sustainability data is captured, validated, and used in real investment decisions. We are at an inflection … advantage. Job Overview: We're looking for a software developer to join the team that builds and operates our environmental, fundamental and market data platform — from ingestion and extraction through to the tools our analysts and clients use every day. Someone who understands the needs of the business ...

Senior Data Engineer London £65-85k + 15% bonus A London-based software company on a mission to make data work smarter. Their products power thousands of businesses, and as they grow, they’re building a data stack that scales with their ambition. … They’re looking for a Data Engineer who’s excited about designing modern data systems, experimenting with new tech, and helping shape how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics ...

Data & Analytics Manager Location: London (Hybrid, 3 days onsite) Salary: £90,000 + benefits + bonus The Opportunity A large, complex organisation operating in a highly regulated environment is seeking a senior-level data and analytics professional to play a pivotal role in the evolution … enterprise data capability. This is not a traditional people-management or hands-on engineering role. Instead, you’ll act as a technical authority and trusted partner to the business , ensuring data solutions are well-designed, robust, and genuinely support decision-making at scale. Why This Role ...

Were partnering with a leading organisation seeking a Snowflake specialist to help modernise and scale their data capability. This is a delivery-focused role where youll shape cloud data architecture, lead migrations, and build high-performance data pipelines that directly support business-critical decision … making. The Opportunity Youll take ownership of Snowflake environments from design through to optimisation, ensuring data is structured, accessible and engineered for performance. Working across technical and business teams, youll translate complex requirements into scalable, resilient data solutions that support analytics, reporting and operational insight. Your ...

Data Engineer 12 months Croydon - x1 day a week x4 remote Inside IR35 - Umbrella only Active SC clearance required Are you passionate about building reliable data pipelines and microservices? Our client, a leading organisation in the IT sector, is hiring for a talented Data … Boot. Containerise applications with Docker and deploy them efficiently. Integrate data from multiple sources, ensuring flows are clean, reliable, and consistent. Optimise pipeline performance, reliability, and observability. Collaborate with Data Scientists, Analysts, and Software Engineers to create robust data solutions. Contribute ...

Data Integration Analyst (Azure/Databricks) Hybrid – Central London | £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business … initial 3-month fixed-term contract . This is a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity ...

Senior Data Engineer – London Insurance Market | London (Hybrid) About the Role We are hiring an experienced Senior Data Engineer to join a high-impact transformation programme focused on modernizing data platforms within the London Insurance Market . This is an excellent opportunity to work … native solutions that power underwriting, pricing, claims, reinsurance, regulatory reporting, and AI-driven analytics. You will play a key role in designing scalable data architectures, building robust pipelines, and partnering with senior stakeholders across business and technology functions. Location: London, United Kingdom Working Model: Hybrid Key Responsibilities Design ...

Senior Software Engineer/Data Platform Engineer London Area, United Kingdom (Hybrid – 3 days onsite) Contract Type: 6 month Inside IR35 £700–£750 per day The Role You will support the evolution of a large-scale financial data platform, modernising legacy enterprise systems while building scalable … skills. Nice-to-Haves Financial services or market data background Experience modernising legacy platforms API design and ETL/data pipeline experience AI-assisted development tools (GitHub Copilot) Quantitative or mathematics background To Apply - click the link provided. OR Email Barry.Ansell@HarringtonStarr.com for a faster ...

Engineer London & Leeds (Hybrid) Cntract - Inside IR35 SC Eligible Looking for strong SQL + Python , AWS/Azure , and data pipeline (ETL) experience. Exposure to Palantir Foundry is a big plus. 📩 Interested? Drop me a message or share with your network! #Hiring #DataEngineer #SQL #Python ...

Senior Data Scientist London (Hybrid - 2-3 Days a Week on-site) £80,000 – £90,000 We’re partnering with a global software provider in the energy and utilities sector to hire a Senior Data Scientist to join a high-impact, innovation-focused internal team. This … fantastic opportunity to work on cutting-edge and data initiatives, helping shape advanced analytics products used across the business. This is an ultra visible team who will be positioned at the forefront of real innovation. The Opportunity As a Senior Data Scientist, you’ll work ...

Hybrid) Permanent | Start ASAP £65k - £75k We’re working with a fast-growing organisation looking for a SQL Commercial Analyst to sit between data engineering and commercial analysis. You’ll own the SQL data environment and turn raw data into insight that drives decision … making across finance, operations, and leadership. This is a high-ownership role with exposure across the business and real impact on how data is used. What You’ll Be Doing Build and maintain a scalable SQL data warehouse Develop and manage data pipelines ensuring ...

Compliance in Transaction reporting ), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted … technical users. Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable ...

outcomes, provide decision support, and unlock new capabilities in medical robotics. You will work across the full ML lifecycle, from problem definition and data strategy through to deployment, monitoring, and continuous improvement. You will be expected not only to build models, but to define robust ML architectures, establish … regulatory, and quality teams. Key responsibilities: Translate clinical and product requirements into ML problems, datasets, metrics, and evaluation plans. Define the data pipeline, from raw and uncurated data to model-ready and traceable datasets. Develop robust training, validation, and evaluation pipelines with strong reproducibility ...

Senior AWS Data Engineer | London | Hybrid | £75,000-£105,000 I'm working with a fast-growing B2B finserv business based in London, and they're looking for a Senior Data Engineer to join their data platform team. This is a genuinely interesting engineering … data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right to work in the UK — no sponsorship available for this role ...

this role unusual: This team tracks individual trades across our network in real time, using eBPF and kernel-level instrumentation to capture transaction data on the wire and correlate it into a per-trade observability stream. That means measuring the SLOs we promise our clients, hunting down latency … signals from the network and OS layer with minimal performance overhead. Capabilities & Skills: Hands-on software engineering experience building observability or data-pipeline applications-metrics aggregation, distributed tracing, or real-time streaming. Proficiency in at least one systems-level language (C++, Go, or Rust) and one scripting ...

growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team … London. This is a newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work ...

Data Engineer - International Motorsport London - Hammersmith (3 days in-office) Regular travel to major international events (races) Permanent | £40,000 - £50,000 + benefits AI Connect are delighted to be supporting a global motorsport organisation on a brand-new AI initiative that will be seen and consumed around … world. The Role We’re hiring a Data Engineer to help design and build a data platfrom that supports live events, fan engagement, and race insights for teams. You’ll be hands-on with Google Cloud Platform, building data pipelines to supply AI models ...

engineering function on our largest hospitality client — a household UK brand operating across 2,700+ venues — and to manage a team of six Data Engineers working across Databricks and Treasure Data. This is a senior technical leadership role. You will own the engineering roadmap across both platforms … tooling and career development for one of our most critical pods. The work speaks for itself: a Single Customer View built on Treasure Data, advanced analytics and ML in Databricks, and real-time omnichannel activation through Braze. The programme consistently beats its commercial targets — YoY by an average ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...

/Kubernetes SQL (PostgreSQL or similar) Previous contract experience is a plus Desirable Experience in fast-paced or scale-up environments Exposure to data pipelines or high-volume systems Ideal for a mid-level developer stepping up, or a senior who wants to focus on building without heavy ...

security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution ...

Integrate advanced AI capabilities including voice, reasoning, and context management ⚙️ Design and own scalable APIs connecting products and intelligence systems ⚙️ Architect data pipelines that power decision-making and agent context ⚙️ Build backend systems for knowledge extraction, enrichment, and automation ⚙️ Contribute to DevOps practices across CI/CD, infrastructure ...

skills: 8+ years’ experience in backend development, specifically in Python. Experience with DevOps tools and principles as well as IaaC. Experience in building data pipelines. Experience with NoSQL Databases. Able to lead and grow teams. Interview process: 1 st stage – video call with the Squad Lead (30 minutes ...