1 to 25 of 54 Permanent Data Pipeline Jobs in the City of London

About the Role An established professional services organisation is seeking a Data Engineer with experience in enterprise data platforms, data analysis and data architecture to join its growing Data Services function. The successful candidate will support the delivery … modern Reporting & Analytics programme by designing, developing and maintaining an enterprise data platform. The role focuses on building scalable data solutions, ensuring reliable data movement from operational systems into a Snowflake environment, and developing robust data models that underpin enterprise reporting ...

observable data pipelines supporting critical Commodities datasets Modernize legacy workflows, reduce technical debt, and improve performance, reliability, and maintainability. Design automated pipeline controls for validation, monitoring, schema change, exception handling, and data integrity. Develop workflow orchestration, alerting, observability, and remediation processes. Translate business and client … Finance or other STEM related field or degree‐equivalent qualifications 4+ years of experience designing and building scalable data solutions, ETL pipelines, data workflows, and monitoring frameworks. Strong hands‐on experience with Python or similar programming/scripting languages. Experience with querying structured, semi‐structured ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience ...

SENIOR DATA ENGINEER Salary up to £100,000 + Equity London-based role - hybrid working with 4 days per week in the office Join a fast-growing technology business building modern, cloud-based data platforms Develop scalable data infrastructure using Python, SQL and cloud … technologies Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Senior Data Engineer to join an ambitious technology business with exciting expansion plans. You'll work as part of a collaborative engineering team, helping to design and deliver ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop ...

Role –Senior Databricks Architect Technology – Databricks (Spark, PySpark/SQL) and data lake architectures Location – London, UK Duration-Permanent Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern … data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially ...

Python Data Engineer 3-6 Months initial contract London/Hybrid - 1-2 days per week on site £Negotiable rate (Inside IR35) We are seeking an experienced Python Data Engineer to join a high-performing data engineering team, building and enhancing centralised data … candidate will have experience in Hedge funds, Asset management or Investment banks. As well as a good understanding of Quant engineering/Quant data groups, Fixed income, rates, FX, macro, trading or pricing environments. This is a hands‐on engineering role focused on designing, developing and maintaining scalable ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Data Analyst London (Hybrid, 4 days in office) | £45,000 + Bonus This is an excellent opportunity to play a key role in turning complex datasets into meaningful insights. You'll work across a range of high-profile communications and brand measurement projects, helping stakeholders understand performance, audience … engagement, and brand impact through data. The Company This specialist analytics consultancy supports clients with data-driven decision making across communications, marketing, and brand performance. They bring together data from multiple sources to deliver actionable insights and strategic recommendations. With a collaborative team environment ...

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers secure, scalable digital tools, software services, and infrastructure across all business units. Agile development teams align with … foster innovation, establish common technology standards, and develop reusable capabilities that accelerate delivery across Marex. Role Summary We are seeking a Senior Enterprise Data Engineer to lead the development of enterprise-scale data integration and data product capabilities across the organisation. This role will ...

experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions for a banking client.The ideal … candidate should have strong experience in building enterprise-grade data platforms, processing large volumes of structured and semi-structured data, and implementing secure, reliable, and high-performance data pipelines in AWS-based environments. Hybrid working: The places that you work from ...

Senior Data Adviser - Lawtech/AI & Data Our client, a leading UK law firm is seeking a Senior Data Adviser to join its innovative Lawtech function. This is a newly created role and the first dedicated data specialist within the team, offering … unique opportunity to shape data strategy, influence AI adoption, and drive transformation across the business. You will work at the forefront of data, AI and legal technology, helping deliver smarter, more efficient legal services and building scalable, data-driven solutions. Key Responsibilities: Data ...

notice. No. of Positions:1 We are seeking an experienced AWS Architect with strong hands‐on expertise in designing and implementing cloud‐based data platforms and lakehouse architectures. The ideal candidate will be responsible for architecting scalable, secure, and high‐performance data solutions on AWS while … collaborating closely with engineering and data teams to deliver robust cloud‐native data pipelines and analytics platforms. Key Responsibilities Design and implement scalable and secure data architectures on AWS. Build and manage lakehouse‐based data platforms using modern AWS data ...

shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … orchestration tools. • Ability to translate business needs into logical, scalable data models. • Comfortable working across multiple data sources and handling pipeline design. • Experience with Power BI, including semantic models or Tabular Editor. • Curious, collaborative mindset with the ability to push back constructively and guide stakeholders. ...

enforcement data environments – the layer that makes complex, multi-source data pipelines trustworthy, traceable and defensible. We have a growing pipeline of engagements in this space and are expanding our bench of senior, cleared engineers to draw on. This is a hands-on, lead engineering … ground the build in how systems are actually used. What you'll do Own the technical design and delivery of a data-pipeline/provenance engagement Build ingestion, transformation and lineage across distributed systems, streaming and batch Define integration interfaces with partner's existing pipeline ...

bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Principal Data Engineer What you’ll do: Act as a technical leader for data engineering best practice across delivery teams Lead the design, build, test … deployment of secure and scalable data pipelines Maintain and operate data products, ensuring availability, performance and resilience through monitoring and incident management Provide assurance on code quality and automation used to manage data flows Lead service reviews, health checks and root cause analysis ...

Data Software Engineer - Azure Databricks Location: London, UK Rate: £500 per day, inside IR35 Working Mode: 3 days a week on site Description We're looking for a Data Software Engineer - Azure Databricks to join our client (Financial Services) team in London, UK in an hybrid … working mode. In this role, you will design and build data engineering solutions leveraging Azure Databricks and related Azure services, enabling efficient processing and transformation of large-scale datasets. You will collaborate with cross-functional teams to ensure the delivery of optimized, reliable, and scalable data ...

Head of Data Engineering I'm partnered with a high-growth Series C fintech that is looking to hire a Head of Data Engineering to lead and scale its data platform as the business continues its rapid growth. You'll lead a team … data engineers, define the technical roadmap, and work closely with engineering, product and data leadership to build a modern, scalable data platform that supports both analytics and AI initiatives. They're looking for someone with: Previous experience leading and growing Data Engineering ...

technically diverse engineering program. Operating across multiple complex domains, you will serve as the premier technical authority, designing mission-critical enterprise systems, overarching data ecosystems, and leading our artificial intelligence (AI) integration strategy. The successful candidate will set the architectural target state, establish design patterns for highly resilient … acting as a Principal or Senior Architect designing large-scale, high-throughput, and mission-critical enterprise distributed systems. Deep Technical Breadth & Depth: Advanced data architecture experience using Databricks, Microsoft Fabric, and large-scale data processing (Data Mesh/Lakehouse patterns). Strong background ...

Data Scientist (Python, PySpark, Healthcare Analytics) Contract: Initial 2 Months (Mid-September – Mid-November) Location: Remote (UK) with 1 day per week in London (2–3 days preferred) We are seeking an experienced Data Scientist to join a high-profile digital transformation programme focused on building … innovative products on a large-scale UK healthcare data platform. Working within a multidisciplinary product team, you will design and develop data science solutions that support population health management and analytics. This is an excellent opportunity to contribute to products that help improve healthcare outcomes through ...

Quantexa Data Engineers (Mid-Level through to Lead) £55,000 - £85,000 dependant on experience + bonus + car allowance + benefits Full Time/Permanent Hybrid/London/Birmingham/Manchester/Leeds Background I am looking for Data Engineers at all levels … clients as and when required. The successful candidates must either hold or be eligible for SC clearance. The Role As a Data Engineer/Senior Data Engineer, you will lead/contribute towards the technical development of Quantexa based solutions, bringing deep hands-on experience with ...

Overview I'm partnered with a high-growth Series C fintech that is looking to hire a Head of Data Engineering to lead and scale its data platform as the business continues its rapid growth. Responsibilities You’ll lead a team of data engineers … define the technical roadmap, and work closely with engineering, product and data leadership to build a modern, scalable data platform that supports both analytics and AI initiatives. Qualifications Previous experience leading and growing Data Engineering teams Strong hands‐on background with modern cloud data ...

Senior Data Scientist | Telecoms | London (2 Days) | £78,000-£83,000 DOE + Strong Bonus We are working on a fantastic opportunity with a telecoms powerhouse who is looking to hire a Senior Data Scientist due to organic growth. The Company Created from humble beginnings … worldwide! The Role This will be a hands-on position where you will be responsible for building, validating, optimising, and managing models and data pipelines, working within a Data Science function alongside Data Analysts and Data Engineers. You will work ...

British Airways is seeking a Principal Data Engineer to lead data engineering practices across delivery teams. You will design, build, test, and deploy secure and scalable data pipelines, ensuring availability and performance of data products. You will lead agile ceremonies and coach … engineers while on-call to support live data products. You will also manage senior data engineers, set standards for data processing documentation, and collaborate with stakeholders to drive reliable, scalable data #J-18808-Ljbffr ...

Lead Data Engineer (Permanent, London on-site) A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used by property teams. This is a hands-on, high-ownership … role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. What you'll do Architect and build scalable data pipelines and distributed data systems Design ingestion, transformation and storage patterns for operational ...