Data Pipeline Jobs in Central London

26 to 50 of 71 Data Pipeline Jobs in Central London

Data Engineer

City of London, London, England, United Kingdom
McNally Associates Limited
We’re looking for a talented Data Engineer to join a dynamic technology team driving innovation across a fast-paced and forward-thinking organization. This is a unique opportunity to be part of mission-critical projects that shape the way the company uses and understands its data. As a Data Engineer, you'll play a key … role in modernizing legacy platforms and building robust data pipelines using the latest Azure cloud technologies. You’ll work closely with cross-functional teams to ensure data is reliable, accessible, and valuable across all areas of the business. What you’ll be doing: Designing, building, and owning high-performance data pipelines and APIs Developing … processes to support analytics, reporting, and business operations Assembling complex datasets from a wide variety of sources using tools like SQL, Python, dbt, and Azure Supporting and improving data quality, data infrastructure, and performance Defining and documenting cloud-based data architecture and technical solutions Collaborating across teams and contributing to architectural decisions Troubleshooting data More ❯
Employment Type: Full-Time
Salary: £60,000 - £90,000 per annum
Posted:

Principal Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Anson McCade
Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus … on designing and implementing end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion … engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau More ❯
Posted:

Data Scientist

City of London, London, United Kingdom
Harnham
Data Scientist Hybrid – London (3 days a week) Up to £75,000 + Pension + Share Scheme About the Role We’re working with a professional services firm undergoing a major data transformation, now looking to bring on board their first in-house Data Scientist . Reporting directly into the CFO, you’ll take … the lead on developing and managing the firm’s data infrastructure, starting with the continued build-out and integration of their data lake. You’ll work on high-impact reporting and analytics projects, and long-term, deliver commercially focused data science solutions such as price optimisation and revenue forecasting. This is a hands-on … role in a people-first business, ideal for someone eager to take ownership, collaborate cross-functionally, and uncover opportunities to use data more effectively across the organisation. Key Responsibilities Build and manage data pipelines and infrastructure, including a developing data lake Support reporting projects and ongoing Power BI development Deliver commercial data More ❯
Posted:

Machine Learning Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Talent Hero Ltd
is 100% free for all UK applicants. Applying through Talent Hero gives you access to global opportunities without navigating the typical hiring grind. Youll work alongside US product, data, and engineering teams to build scalable ML pipelines and turn advanced algorithms into business value. We are looking for Machine Learning Engineers who are technically sharp, production-minded, and … excited to push the boundaries of intelligent systems. Responsibilities Design, build, and deploy machine learning models to solve complex business problems Develop scalable data pipelines for training, testing, and deploying models Collaborate with data scientists, product teams, and software engineers to integrate ML into production Optimize models for speed, accuracy, and efficiency in real-time environments … Experience deploying machine learning models into production environments Solid understanding of data structures , algorithms , and statistical learning Familiarity with cloud platforms (AWS, Azure, or GCP) and ML pipeline orchestration Bonus: Experience with deep learning , NLP , recommendation systems , or computer vision Excellent problem-solving, communication, and documentation skills Benefits 100% REMOTE Working with a US company, you will More ❯
Employment Type: Contract, Work From Home
Rate: £60,000
Posted:

Power BI developer

City of London, London, United Kingdom
Harmony Fire
Power BI & Data Platform Developer Reports to: Head of IT About Harmony Fire Harmony Fire is one of Europe’s fastest-growing fire protection companies, ranked 72nd among the fastest-growing businesses in the region. Our mission is to make the UK safer — one building at a time — by delivering fire protection services that combine technical excellence with … we serve our clients, grow our business, and support each other. Key Responsibilities Design, develop, and maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows … looking for 3+ years of experience in Power BI development and/or data engineering Proven experience with Microsoft Fabric , including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Citywire
Data Engineer We’re looking for a Data Engineer to join our fast-moving, hands-on data engineering team. This isn’t a traditional pipelines-for-analysts role - you’ll be building data systems and products that directly power real-time applications, internal tooling, and commercial projects across the business. Entrepreneurial and … space to experiment and the responsibility to stabilise when it counts. You’ll work across AWS and GCP, using a modern, containerized, event-driven stack. From real-time data processing to batch workflows, from APIs to backend services, you’ll help evolve our data fabric — the foundation for how data flows and generates value … across the business. What you’ll be doing: -Design and build real-time, event-driven, and batch data pipelines using Python. -Develop and deploy containerized microservices using Docker, running in ECS Fargate or similar cloud-native environments. -Work across AWS and GCP, leveraging services like Lambda, Kinesis, SQS, EventBridge, AWS Batch, Spark, and BigQuery to power cross-cloud More ❯
Posted:

Data Scientist

City of London, London, United Kingdom
Hybrid / WFH Options
Fruition Group
tech leaders, the company specialises in automated credit decisioning, embedded finance, and next-gen lending platforms . As part of this expansion, they’re looking for an experienced Data Scientist to join their fast-paced, agile environment on a 6-month hybrid contract . Key Responsibilities: Design and deploy machine learning models for risk scoring, customer segmentation, and … product and credit teams Develop custom statistical models for portfolio analysis and performance forecasting Collaborate cross-functionally with engineering, product, and analytics teams Contribute to scalable data pipeline and feature store development Requirements: 3+ years of experience as a Data Scientist in a commercial setting Strong skills in Python, SQL , and machine learning libraries (e.g. … scikit-learn, XGBoost, etc.) Familiarity with cloud platforms (e.g., AWS, GCP) and version control (e.g., Git) Experience working with financial or transactional data is a plus Bachelor’s or Master’s degree in Data Science, Statistics, Computer Science, Mathematics, or a related field Prior experience in a start-up or scale-up preferred More ❯
Posted:

Data Scientist

City of London, London, United Kingdom
Insurwave Limited
At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Scientist to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning, then this could be the perfect opportunity and … the start of something incredible! What will you be doing? As a Mid-Level Data Scientist, you will play a critical role within a multidisciplinary team of data scientists, analysts, and domain experts, developing advanced AI and analytics solutions for the Insurwave platform. This self-sufficient team is responsible for the entire delivery lifecycle—from design … analytics, and model asset behaviour for the commercial insurance market. Responsibilities Design, build, and deploy machine learning models that meet defined performance and business requirements Develop production-ready data science solutions and maintain high-quality, testable code using modern development practices Build and maintain APIs, data pipelines, and automated workflows to support model deployment, monitoring, and More ❯
Posted:

Senior Data Scientist

City of London, London, United Kingdom
Hybrid / WFH Options
Vertical Advantage
We’re working with a leading insights consultancy in the food and drink space, known for its high-quality, subscription-based data tools used by global brands. They’re now hiring a Senior Data Scientist to shape and execute … the company’s data strategy and develop AI-driven features that elevate their platform. The Role You’ll lead on the full data lifecycle - from pipeline development to deploying machine learning models. Working closely with product and commercial teams, you’ll drive innovation through LLMs and advanced analytics, while mentoring a small team and aligning … data solutions with business growth. Key Responsibilities Build and optimise data pipelines and infrastructure Design and deploy ML models, including LLM-powered features Mentor junior data scientists and foster team development Align data science with product and business strategy Identify opportunities for automation and platform enhancements About You Strong experience delivering end More ❯
Posted:

Data Analyst - Womenswear Fashion Supplier

City of London, London, United Kingdom
MODE SEARCH Ltd
Mode Search is supporting a leading fashion supplier in the search for a dynamic and commercially minded Data Analyst to join their growing team. This is an excellent opportunity to join a fast-paced, trend-led fashion business with a strong presence across major UK retail channels. The successful candidate will play a key role in shaping how … data drives commercial decision-making across trading, pricing, and supply chain operations. The Data Analyst will be responsible for designing, building, and scaling data solutions to support the business’s commercial and trading functions. The role sits at the intersection of data engineering, analytics, and commercial strategy — ideal for someone who thrives … on translating complex data into actionable insights. Key Responsibilities Build and maintain robust data pipelines to support trading, pricing, and product availability decisions Develop and maintain data models that provide meaningful insight into supplier performance, customer demand, and margin analysis Collaborate with trading, commercial, and supply chain teams to deliver high-impact dashboards and More ❯
Posted:

Analytics Consultant

City of London, London, United Kingdom
Brio Digital
in London 💰 Up to £80,000 per annum 🔍 The Role As an Analytics Engineer , you’ll work across a range of exciting client projects, designing and building scalable data pipelines to support analytics on large, complex datasets. This is a client-facing role, ideal for someone who thrives in a fast-paced consultancy environment and enjoys working closely … with stakeholders. You’ll also play a key role in mentoring junior team members and contributing to the wider data engineering strategy. 💼 What You’ll Be Doing Building robust, scalable data pipelines across multiple client projects Presenting insights and technical solutions directly to clients Supporting and mentoring junior engineers within the team Collaborating with cross-functional … value 🛠️ Tech & Experience We’re Looking For Strong SQL and Python skills Experience with cloud platforms such as GCP or Azure Hands-on with BigQuery , Synapse , or similar data warehouses Familiarity with data visualisation tools — D3.js or similar Proven client-facing experience Previous consultancy experience is highly desirable This is a fantastic opportunity to join a More ❯
Posted:

Business Intelligence Manager

City of London, London, United Kingdom
Amazon
reoccurring governance, validation and audit exercises of existing solutions. You will work closely with global measurement team, external agency partners and service providers to develop, standardize and optimize data pipelines and operational parameters that can be applied consistently across 12+ European countries while capturing local nuances. You will collaborate with our tech & tools team on the development of … functions and locations, and have demonstrable experience in stakeholder engagement. We are looking for someone who is highly organized and comfortable working in a fast-moving, dynamic and data driven environment. This role is based at our Amazon corporate office in London/UK or Munich/DE. Key job responsibilities Automate: Identify opportunities to standardize, off-shore … media budget management and business insights. Partner with our external media agency, internal and external measurement partners across Europe and US central team, aligning measurement project and supporting data collection, acquisition and validation. BASIC QUALIFICATIONS 6+ years relevant professional experience in media planning, media finance or media buying. Have experience in media research, insights or data More ❯
Employment Type: Permanent
Posted:

Snowflake Data Engineer - AWS, Airflow & Iceberg

City of London, London, United Kingdom
Hybrid / WFH Options
IO Associates
x Contract Data Engineers - Snowflake/AWS/Python/Airflow/Iceberg Location: London (Hybrid - 3 days per week onsite) Duration: 6 months Day Rate: £550 - £600 (Inside IR35) A highly reputable consultancy is seeking 2 x Contract Data Engineers to join their data team on a 6-month engagement. You will play … a key role in building and optimising data pipelines, supporting modern data platform architecture, and enabling advanced analytics and reporting capabilities. Key Skills & Experience: Strong experience with Snowflake data warehousing Solid AWS cloud engineering experience Proficient in Python for data engineering workflows Skilled in building and maintaining Airflow DAGs Familiarity with Apache … Iceberg for table format and data lake optimisation If this could be of interest, please get in touch with Alex Lang at iO Associates to apply and for more information. On this occasion, we can only accept applications from UK-based candidates with right to work in the UK. More ❯
Employment Type: Contract
Rate: £550 - £600 per day
Posted:

Data Engineering Manager

City of London, London, United Kingdom
Hybrid / WFH Options
McCabe & Barton
A leading Financial Services client in London is undergoing a major data transformation and is hiring a Data Engineering Manager on a permanent basis. The role offers a base of £85,000, strong benefits, and flexible hybrid/remote working. Were looking for a hands-on leader from a forward-thinking, modern data environment … with a strong foundation in Data Engineering and experience managing a squad of 47 Data Engineers. Youll bring solid SQL skills, cloud expertise (preferably Azure), and familiarity with tools such as Snowflake, Databricks, ADF, Python, and GenAI. Youll manage a squad of engineers and play a key role in delivering scalable, modern data solutions … as part of a group-wide transformation. Requirements: Proven experience in fast-paced environments working with modern data architectures and tooling; Financial Services experience is a plus. Experience managing Data Engineering teams Strong SQL and cloud skills (Azure preferred) Familiar with modern data tools (e.g. Snowflake, Databricks, ADF, Python) Track record of building/ More ❯
Employment Type: Permanent, Work From Home
Salary: £90,000
Posted:

Data Architect

City of London, London, United Kingdom
Hybrid / WFH Options
Hays
Data Architect (18-Month Fixed Term Contract) Salary: £65,000 - £72,000 per annum + benefits Location: London/Hybrid Our client is underway with an exciting Transformation Programme and is looking to recruit an experienced Data Architect. The role is critical in helping to shape their future as a data-led organisation. The … Data Architect will be instrumental in building the foundational architecture, governance and strategy needed to bring that vision to life. Key Responsibilities Include Defining and owning the enterprise and commercial data strategy aligned with the digital transformation goals Establishing data governance policies, metadata standards, data stewardship roles, and classification models Designing scalable … data architecture that integrates corporate services and operational data systems Architect data pipelines and semantic layers to support BI, advanced analytics, and future AI capabilities. Presenting data models, architecture diagrams, and governance strategies to executive and technical stakeholders Key Skills Required Demonstrable hands-on systems integration and enterprise-scale data More ❯
Employment Type: Permanent
Salary: £70,000
Posted:

Artificial Intelligence Engineer

City of London, London, United Kingdom
SciPro
Research and prototype innovative AI technologies aimed at improving system performance and clinical efficiency Enhance ML development workflows with tools for model tracking, experiment management, and reproducibility Apply data science techniques to extract insights from complex and varied data sets Plan and manage infrastructure for model training and deployment Develop systems for monitoring ML models in … production environments Build and maintain reliable data pipelines for training, testing, and validation Assist in evaluating and comparing model performance and outcomes Requirements: Degree in Computer Science, Software Engineering, or a related technical discipline Minimum 5 years of industry experience or a PhD in a relevant area Strong theoretical foundation in ML, deep learning, and computer vision Proficient More ❯
Posted:

Front Office Full Stack Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
La Fosse
Benefits A leading financial services firm with over £60bn AUM is expanding its core engineering group to power the next generation of its front-office trading, risk, and data infrastructure. This is a unique opportunity to work in a modern, high-performance tech environment shipping production-grade code daily, solving real business problems, and collaborating directly with end … team building services and tools that underpin: Trade capture and lifecycle management across asset and liability books Risk calculation, storage, and distribution for complex portfolios Market and reference data services enabling pricing and analytics You’ll work across the stack, building performant services and UIs using Rust, Python, React, and PostgreSQL/ClickHouse, with deployments to AWS and … ownership and daily interaction with front-office users. What You’ll Do Design, implement, and maintain scalable HTTP/GRPC services in Rust and Python Develop and optimise data pipelines, databases, and schemas (Postgres, ClickHouse) Build intuitive, real-time UIs using Python and React Translate complex financial logic into accurate, testable code Collaborate with business teams to define More ❯
Posted:

Data Scientist

City of London, London, United Kingdom
Harnham
Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer … insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits … of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing and potential customers Requirements: 2/3 years in data science or a related field, or a Master’s degree. Proficient in Python (core skill), with strong experience in SQL More ❯
Posted:

Business/Data Analyst (kdb+/q)

City of London, London, United Kingdom
Caspian One
Business/Data Analyst – KDB & Python | Greenfield Build | Investment Banking -EXPERIENCE IN KDB+ IS Essential- A leading investment bank is building a brand-new team for a greenfield project and is looking for a Business/Data Analyst with strong KDB and Python skills. Key Responsibilities: Gather and analyze business requirements from front-office and tech … teams. Build data models and analytics solutions using KDB+/q and Python. Define data pipelines and ensure data quality and performance. Translate business needs into actionable insights and documentation. Requirements: Experience in financial services, ideally trading or investment banking. Strong hands-on skills in KDB+/q and Python . Solid understanding of … market data and financial instruments. Excellent communication and stakeholder management skills. Why Apply? Join a greenfield build with full ownership from day one. Work with cutting-edge tech in a high-impact, front-office environment. Be part of a collaborative and fast-paced team shaping a new platform. More ❯
Posted:

Data Engineer

City of London, London, England, United Kingdom
Hybrid / WFH Options
Fusion People Ltd
Data Engineer - MS Fabric - UK role (WFH) - 6 months initial contract - Top rates - Outside IR35 Major consultancy urgently requires a Data Engineer with experience of MS Fabric (tech stack is Microsoft Fabric, PySpark/RSpark and Github) for an initial 6 months contract (WFH and Outside IR35) who is passionate about building new capabilities from the … ground up and want to help explore the full potential of your data platform. As aa Data Engineer you will have hands-on technical ability and experience of building and managing modern data platforms, preferably in Microsoft Fabric and ideally be familiar with integrating customer/third-party data into Fabric, possess … Product Development Awareness: Understanding how data platform capabilities may integrate into digital products and services. Experience working with or within product development teams is a plus Technical knowledge and underrating of the following is required:- Data Engineering Best Practices, CI/CD for data pipelines, Modular, testable ETL development, Git-based collaboration and branching More ❯
Employment Type: Contractor
Rate: £450 - £800 per day
Posted:

Product Data Manager

City of London, London, United Kingdom
Hybrid / WFH Options
Uniting Ambition
Data Product Manager (Platform & Insights) Location: London/Hybrid Salary 90k – 100k + Benefits DoE About the company This is an opportunity to join a scale-up advisory firm that work with clients to reduce their environmental impact and manage sustainability-related risks. The company works with a diverse range of businesses across sectors such as aviation, energy … in aligning operations with evolving sustainability goals and regulatory expectations. About the role This is a zero-to-one product role, focused on architecting and launching a robust data platform from scratch. You’ll work closely with the Head of Product to define the product vision, align cross functional stakeholders and oversee technical execution. The platform will integrate … data pipelines, analytics and reporting tools to support internal teams and external clients with actionable insights and market intelligence. What matters most is your ability to connect business needs with technical solutions and to build data products that are scalable and well governed. Key Responsibilities Platform Strategy & Development Define the product roadmap for a new data More ❯
Posted:

ETL Developer

City, London, United Kingdom
Deerfoot Recruitment Solutions Limited
ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯
Employment Type: Contract
Rate: GBP Annual
Posted:

Senior AWS Data Engineer

City of London, London, United Kingdom
Tenth Revolution Group
Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they More ❯
Employment Type: Contract
Rate: £500 - £600/day
Posted:

Data Scientist

City of London, London, United Kingdom
Harnham
Data Scientist (PropTech) London - Hybrid (3 days in office) Up to £70,000 About the Role An established data-led business is looking for a commercially-minded Data Scientist to join their growing London team. You’ll collaborate with cross-functional teams to design, build, and implement data science solutions that directly … into core product offerings. This is an exciting opportunity to apply ML and statistical techniques to real-world problems, while also developing in areas such as software engineering, data pipelines, and ethical product delivery. Key Responsibilities Collaborate with product teams to identify opportunities for ML and data science integration Build and maintain data pipelines … learning models in production environments Present insights and results to technical and non-technical stakeholders Apply statistical methods and model validation techniques to reach accurate conclusions Work with data engineers to ensure clean, usable datasets Contribute to ethical, privacy-aware, and user-centric data products Stay curious, research new methods, and continually build your technical capability More ❯
Posted:

Data Operations Manager

City of London, London, United Kingdom
BOSS ERP Consulting
Data Operations Manager. Duration 6 months We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a … team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities for the Data Operations Manager: Data Infrastructure Management … Oversee the design, implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across More ❯
Posted:
Data Pipeline
Central London
10th Percentile
£54,000
25th Percentile
£57,500
Median
£73,750
75th Percentile
£127,500
90th Percentile
£155,000