1 to 25 of 44 Data Pipeline Jobs in the City of London

provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: SL Transformation- Data Designer Location: London Duration: 31/12/2026 Sector: Insurance Days on site: 2-3 Pay Rate: £438 per day all inc. (PAYE … through Umbrella) Role Description: The role will be responsible for designing conceptual, logical, and physical data models that support business pricing capabilities and analytical use cases. The successful candidate will work within a Medallion Architecture (Bronze, Silver, Gold) implemented on Azure Databricks and Azure Data Factory ...

clean, normalize, and store structured and semi-structured data in Snowflake, our core relational data warehouse. Analyze data pipeline performance and implement optimizations to improve efficiency and reliability. Conduct data quality checks and build validation logic to identify anomalies and ensure … transitioning legacy datasets and codebases into scalable, cloud-native workflows aligned with our modern data architecture. Document data sources, pipeline logic, and data models to ensure maintainability and knowledge transfer. Qualifications: Currently pursuing a Bachelors or higher degree in Computer Science, Engineering, Management ...

LEAD DATA ENGINEER Salary up to £120,000 + Equity London-based role - hybrid working with 4 days per week in the office Join a fast-growing technology business building modern, cloud-based data platforms Lead the design and development of scalable data infrastructure … cloud technologies Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Lead Data Engineer to join an ambitious technology business with exciting expansion plans. You'll play a key role in shaping the organisation's data ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience ...

SENIOR DATA ENGINEER Salary up to £100,000 + Equity London-based role - hybrid working with 4 days per week in the office Join a fast-growing technology business building modern, cloud-based data platforms Develop scalable data infrastructure using Python, SQL and cloud … technologies Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Senior Data Engineer to join an ambitious technology business with exciting expansion plans. You'll work as part of a collaborative engineering team, helping to design and deliver ...

Senior Data Engineer Microsoft Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. Job details … Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Industry: STEM Technology Permanent role salary £50- £70,000 dependant on skills and location Requirements: Strong experience as a Senior Data Engineer ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

focuses on building and optimising data infrastructure that enables advanced marketing and customer data capabilities. You will create scalable pipelines, data models, and governance practices that support analytics, segmentation, and real-time engagement. Working closely with cross-functional teams, you will help deliver reliable … MarTech, and marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data ...

BettingJobs is seeking a Data Engineer to join a small but growing quant team in the sports betting industry. Working alongside the modelling team, you will be responsible for ensuring they have access to reliable, well-structured and high-quality data for research, modelling and analysis. … From building robust Python-based workflows to investigating complex data issues and assessing new data sources, the Data Engineer will be responsible for extracting maximum value from the data. Responsibilities: Work day-to-day with quant modellers to prepare, refine and maintain datasets used ...

Lead Data Consultant | Azure, Databricks, Microsoft Fabric | Hands-On Seat in a Scaling AI Consultancy Salary: £70,000 to £100,000, depending on experience, plus a company-performance bonus Location: London, hybrid (around 2-3 days in the office, plus client visits) Essential: a consultancy or professional services … Microsoft Purview (or a comparable cataloguing and lineage tool) Dimensional modelling, Data Vault, warehouse and lakehouse architecture ETL and data pipeline design and build CoPilot, Claude and OpenAI in day-to-day delivery Nice to Haves: Agentic architecture, putting LLMs to work on real data ...

Working £450 - £500 per day, Inside IR35 We're recruiting on behalf of a global IT Services Provider who are looking for a Data Consultant (Cerner/… Oracle Health) to support the remediation of performance issues and other problems associated with data pipelines. Key Responsibilities Remediate data pipeline and performance issues Provide DBA expertise across performance tuning and optimisation Work with stakeholders to gather and understand requirements Support data architecture ...

shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … orchestration tools. • Ability to translate business needs into logical, scalable data models. • Comfortable working across multiple data sources and handling pipeline design. • Experience with Power BI, including semantic models or Tabular Editor. • Curious, collaborative mindset with the ability to push back constructively and guide stakeholders. ...

exciting opportunity has arisen to join a well-established tier one main contractor as an IT Data & Platform Engineer, working within a collaborative Group IT team responsible for delivering modern data engineering and business intelligence solutions across the business. This permanent position is based in Canary … working arrangement following probation period, where employees will be expected to work full-time from the office. About the Role As an IT Data & Platform Engineer, you will play a key role in the design, development and maintenance of modern data platform solutions. Working closely with ...

About the job As part of the Transform Together Consulting team you will lead impactful change primarily in the area of Data and AI by partnering with industry-leading companies to shape strategy and drive operational excellence. You will be working across organisational levels, depending on your comfort … technology teams, translating business outcomes into executable technology roadmaps and ensuring technical delivery remains aligned to the underlying business objective. Experience delivering data-led transformation programmes, with sufficient technical understanding to confidently manage programmes involving modern data platforms, data architecture, data quality ...

Data Engineer – AWS, Python, Spark & AI Salary: £60,000–£75,000, dependent on experience Location: London - Three days in the office and two from home Job reference: J13171 Build the data platform powering a new generation of AI-driven consumer intelligence. You’ll work … intersection of AWS, large-scale behavioural data and agentic AI, creating scalable pipelines and data products that turn ethically sourced, consented consumer data into meaningful insights. Joining a collaborative, scaling technology company, you’ll have the freedom to experiment with cutting-edge tools, broaden ...

Senior Data Engineer - Immediate start Location: UK Remote Salary: Up to £70,000 Dependent on Experience Ref: J13159 We’re looking for an experienced Data Engineer who is available immediately or at short notice to take ownership of a business-critical SQL data warehouse … solutions. Driving engineering best practice, including version control, CI/CD, automated testing and documentation. Monitoring data quality, performance and pipeline health, resolving issues proactively. Supporting the ongoing evolution of the data platform and cloud environment. What we're looking for Strong ...

Head of Data Products and Technology Our client are a leading user-generated video marketplace, with an extensive video library of unique content. As demand for high-quality AI training data accelerates, they're uniquely positioned to transform this library into valuable datasets, metadata, and annotation … build that from the ground up, not just direct it from above. This is a hands-on role. There is no data analytics team to hand work off to, you are the data function, as well as its strategic owner. We're looking for someone with ...

Overview Gravitas is seeking a Senior Data Architect to lead the design and delivery of modern data platforms and analytics architectures within a fast-paced, client-facing environment. You will act as the Databricks champion within the business, shaping best practice, guiding delivery teams, and supporting … stakeholders through pre-sales and solution definition. Key Responsibilities Own end-to-end data architecture across lakehouse, warehouse, and streaming patterns, ensuring scalability, security, and governance. Act as Databricks champion: define standards, reference architectures, accelerators, and reusable assets. Lead architectural design for Databricks (workspaces, clusters, jobs, Delta Lake ...

contract, model-based and property-based testing across the wide range of experiences customers can create. Validating analytics and data correctness, verifying pipeline integrity and aggregation accuracy across our Postgres and MongoDB data layers. Wrong numbers erode enterprise trust quietly and permanently. Owning visual-regression … counts. Depth in at least one of: testing configuration-driven or composable systems (contract, model-based or property-based testing), or data-pipeline and analytics validation. Both is a strong plus. Experience designing and building automated E2E, integration and visual-regression frameworks and wiring them into ...

This innovative and fast-paced Global Fintech brand is going through considerable growth and is looking for a Data Analyst to join this dynamic Procurement Team... This is an exciting new role and would suit someone who has a strong background in Data Analysis … comfortable presenting to executive audiences. Data Analyst role: Data Analysis & Reporting. Extract, clean, and integrate data from a variety of systems (AWS, procurement systems, etc, Hardware Asset and Software Asset Management) to create accurate and insightful reports. Develop and maintain dashboards and visualisations ...

Senior Data Analytics Consultant London/Hybrid Salary: Up to £55,000 Are you a Data Analyst with strong SQL skills who enjoys combining technical analysis with client-facing consulting? Maxwell Bond are partnered with a growing consultancy looking for a Senior Data Analytics … Consultant to work closely with clients, using data to solve complex business problems and identify opportunities for growth. You'll take ownership of client engagements from end to end, combining advanced analytics and data modelling with strong stakeholder management and commercial understanding. This is a great ...

Lead Azure Data Engineering Architect – Insurance Domain (Lloyds Marketplace) London Onsite - Hybrid Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. … Vendor to Watch’ by Gartner. Please visit Fractal | Intelligence for Imagination for more information about Fractal Responsibilities: Design and implement scalable data migration strategies and ETL/ELT data pipelines. Strong Insurance domain experience, preferably within the Lloyd’s marketplace Good understanding of tools and platforms ...

Funds (ETF) sector, is seeking an experienced Lead Python Developer to play a key role in shaping the future of their technology and data platforms. This is a rare opportunity to join a highly respected organisation operating at the intersection of technology, data and financial markets. … delivery of business-critical solutions while working closely with senior stakeholders across the organisation. Key Responsibilities: Leading the design and development of scalable data platforms and applications Building and optimising Python-based solutions and automation tools Developing and maintaining PostgreSQL databases and data models Delivering Azure ...

Senior Data Scientist Location – London – Hybrid Salary - £75k – £82,5k + Benefits Please Note: Due to the AWESOME nature of this work, Applicants must hold a valid British passport - Duel Nationality wont be accepted - sorry Some data science roles are about optimising marketing campaigns or improving … recommendation engines, this isn't one of them. We're looking for an experienced Data Scientist to work on highly secure, technically demanding projects where the questions are complex, the data is challenging and the outcomes genuinely matter. You'll work alongside experts from a range ...