1 to 25 of 94 Permanent Data Pipeline Jobs in Central London

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading global … energy trading firm offering the opportunity for a contract Business Analyst to support a major data transformation programme. This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data ...

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated … Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed ...

Senior Data Engineer - Commodities & Energy Trading £Up to £175,000 GBP Competitive Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Senior Data Engineer - Commodities & Energy Trading London | Permanent | Hybrid Working Our client is a global commodities and energy trading organisation operating … analytics, proprietary technology, and robust risk management to support trading, optimisation, and risk-management decisions across energy and commodities markets. As a Senior Data Engineer , you will join a highly technical Data, AI & Analytics function responsible for building the data platforms that underpin trading ...

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure … workflows that power analytics and decision-making across the business. This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data ...

client, a highly prestigious hedge fund, is seeking a Data Engineer to join their Data Platform team in London. Embedded within a high-performing and collaborative data function, you will play a key role in designing, building and enhancing a best-in-class data platform that supports front-office decision making across multiple asset classes. Working closely with investment professionals, technology teams and data stakeholders, you will help drive data quality, accessibility and scalability across a complex, business-critical environment. This is an opportunity to take ownership ...

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead … workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such ...

Cleared Data Consultants and Analysts – London – Up to £60,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled SC & DV Cleared Data Consultant and Analysts to join ...

company seeking a Senior Associate - Marketing Technology to support and evolve its enterprise marketing ecosystem. This position operates at the crossroads of marketing, data, and technology, with a strong emphasis on marketing tech data, AI & machine learning, and data workflows. You will play … role in enhancing platform performance, strengthening integrations, and enabling scalable, data-driven marketing operations. This opportunity is ideal for someone who thrives in complex environments and enjoys improving how systems, data, and teams connect. Key Responsibilities Optimise and maintain core marketing technology platforms to ensure strong ...

which enables us to deliver, powerful, connected business solutions that drive significant client value. The Role: We are looking for a client-facing Data Consultant who can design, build, and optimise modern data platforms and analytics solutions using the Microsoft data stack, with … experience delivering data solutions with Microsoft Fabric, including Lakehouse, Pipelines, and Notebooks/Spark-based processing. Strong capability in data pipeline and architecture design and optimisation across Microsoft tooling (Fabric and/or other Azure services). Strong Power BI capability (reporting + modelling ...

product, and have your voice heard. At the core of what we build is a large dataset and data processing pipeline covering UK property data. You'll work closely with this data, helping to consume, refine, and unlock its value based on evolving product requirements … Write clean, well-tested, and maintainable code with a focus on long-term scalability Work with our UK property dataset and data pipeline to surface meaningful information through the product Participate actively in code reviews, giving and receiving feedback constructively Contribute to architectural discussions and help raise ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Senior Data Engineer Build the engine behind next-generation trading analytics This is an opportunity to work on a high-impact data platform that turns complex trading data into powerful, actionable insight. You’ll be building a cutting-edge analytics engine … used to evaluate performance, surface opportunities, and power smarter decision-making through data products, dashboards, and machine learning. This isn’t just pipeline work, it’s about shaping how data drives strategy. You’ll join a highly collaborative team of Data Engineers, Analytics ...

Data Engineer | London Hybrid | £70,000–£100,000 + 30–40% Bonus I’m currently working with a well-established and growing business in the insurance market that is looking to hire a Data Engineer into its London team. This is a great opportunity for someone … company up to 10% This is a genuinely strong opportunity for a Data Engineer who wants a mix of: core platform and pipeline ownership exposure to a complex, data-rich environment strong overall package and benefits involvement in current and future AI/LLM projects ...

Data Engineer - SC Cleared 6 Month Contract Hybrid - 2 days per week onsite Please note: Active SC Clearance is required for this role A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud‐first data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake ...

Role Title Production Support Palantir Data Engineer Business Unit/Segment Analytics/Data Management/Insurance Location London, United Kingdom Employment Type Permanent – immediate start preferred Role Overview We are looking for an experienced Palantir Data Engineer to provide production support for data … TypeScript Experience working with AWS services such as S3, Lambda, Glue, and related data services Solid understanding of data pipeline architectures, ETL processes, and production data workflows Proven experience working in production support or operational data engineering environments Familiarity with Generative ...

double our revenue within five years and become the world leader in HR digital transformation. YOUR MISSIONS Define and deliver high-impact data integration and visualization solutions by working closely with client business and data teams to empower data-driven decision-making. Architect, implement … global customer base as a key member of the HR-Path team. Build strong customer relationships to bridge the gap between complex external data sources and Workday’s native reporting. Train end-users and data analysts on Prism self-service capabilities to ensure long-term solution ...

Data Migration Engineer Location: Hybrid - 1-2 days a week in London Salary: 70-90k + 10% Bonus Job Type: Permanent Sponsorship: Not Available Role Summary: We are looking for a Data Migration Engineer to help us achieve a multi-system, multi-client, company-wide … secrets management Required Qualifications: 5+ years of experience in data engineering, analytics engineering, or backend engineering with significant data pipeline ownership Demonstrated past success in a stakeholder management heavy data role Excellent communication skills, able to translate technical knowledge to non-technical colleagues ...

shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … orchestration tools. • Ability to translate business needs into logical, scalable data models. • Comfortable working across multiple data sources and handling pipeline design. • Experience with Power BI, including semantic models or Tabular Editor. • Curious, collaborative mindset with the ability to push back constructively and guide stakeholders. ...

leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting … intelligence initiatives, while influencing the evolution of the organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with ...

Software Delivery Manager (Data Products/SaaS) Location: Blackfriars, London (5 days onsite) We are looking for an experienced Software Delivery Manager/Agile Delivery Manager to lead the end-to-end delivery of data-driven products within a fast-paced, data-centric environment. … hands-on familiarity with data environments, including: Tools: Python, SQL, Tableau/Power BI (or similar) Data concepts: ETL pipelines, data modelling, reporting layers Metrics: Accuracy, latency, completeness, recall/precision (where relevant) Ability to confidently interpret and challenge data to inform ...

Senior Data Engineer (Contract) Location: London (2 days onsite per week) Day Rate : £500-550 Per day (Outside IR35) Duration: 6-month contract Start: ASAP Contact : Matthew.Makranczy@forsythbarnes.com Overview We are looking for a Senior Data Engineer to join a high-performing team delivering advanced data … teams to generate actionable insights from large-scale datasets. This is a hands-on leadership position focused on building robust, scalable, and governed data solutions using modern cloud technologies. The Role Own the end-to-end design, build, optimisation, and support of scalable Spark/PySpark data ...

Senior Data Engineer London Hybrid Salary £80,000 - £90,000 (depending on experience) VIQU has partnered with a leading organisation in the clean energy sector to recruit a Senior Data Engineer. You will design and build scalable data infrastructure, turning complex datasets into valuable … collaborative, agile team, you ll take ownership of key initiatives while contributing to best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support ...

driving the success of our Logistics product improvements and advancing our logistics-wide experimentation efforts. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product … insights. This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. Please note: This is a 12 month Fixed Term Contract These are some of the key ingredients to the role: Product Performance Analysis: Support analytics Define, monitor ...