426 to 450 of 1,416 Data Pipeline Jobs in London

About Unifeye Unifeye is a delivery-led, Databricks first consultancy helping organisations unlock the full value of their data and AI. We're a lean, high growth team based in London, working at the intersection of data, technology and business strategy. We partner with enterprise organisations … across industries to solve complex data challenges through modern Lakehouse architectures on Databricks. Joining Unifeye means more than delivering projects. From day one, you'll be trusted to take ownership, challenge conventional thinking and make a genuine impact. With a high degree of autonomy, you'll help shape ...

Lead Data Engineer About CRU CRU International is a leading provider of business intelligence and consulting services in the metals, mining, and fertilizer industries. With over 50 years of experience, we offer valuable insights and analysis that help our clients make informed decisions in an ever-changing global … market. About the role We are looking for a Lead Data Engineer to take ownership of a business domain within our modern Snowflake, Airflow, and dbt data platform. This role will combine hands-on technical leadership with team coordination, helping ensure stable platform operations, strong data ...

Disguise Technologies Ltd in London seeks an experienced Data Engineer to design, build, and maintain robust data pipelines and a scalable data warehouse. You will work with large, complex … datasets to empower analysts and stakeholders to make data-driven decisions shaping the company’s future. Key responsibilities include ETL/ELT pipeline development, data modelling, and data quality monitoring. Strong SQL, Python and AWS experience, plus CI/CD and Docker ...

Senior Data Analytics Consultant London Up to £65,000 This is an excellent opportunity for a Senior Data Analytics Consultant to join a high-growth data and analytics consultancy delivering impactful solutions for globally recognised organisations. The role combines hands-on technical expertise with … decision-making, and drive measurable business outcomes. The Company They are a specialist analytics and AI consultancy that helps organisations unlock value from data through reporting, business intelligence, and advanced analytics solutions. Their teams work closely with clients to solve complex business challenges, improve performance, and embed data ...

technology consultancy in London is seeking a Lead Data Engineer to help public sector organizations become data-led. This role involves defining data strategies … advising teams on data value, and contributing to recruitment and management efforts. Ideal candidates will possess strong skills in data pipeline creation, architecture design, and have a thorough understanding of agile practices. The role also offers flexible remote working arrangements. #J-18808-Ljbffr ...

Sydney. About WPP WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic … platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. For more information, visit WPP.com. Job Title : Senior Data Platform Enablement Lead Location : London Department : Data Intelligence/Open Intelligence Product & Engineering Role Overview As we scale the rollout of Open ...

Principal Azure Data Engineer (Databricks)Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentLead the architecture of data platforms driving the future of financial services. The RoleAs a Principal Azure Data Engineer (Databricks) at Capco, you'll architect and lead the delivery of enterprise … grade data solutions using the Databricks platform within the Azure ecosystem. You'll drive the design and implementation of streaming and batch data pipelines, helping our clients modernise their data capabilities. Working with cross-functional teams, you'll guide clients on technical strategy ...

monitoring the commercial performance of our algorithmically underwritten insurance business in real time. We’re upgrading the foundation that captures algorithm decision data, moving from database logging to a versioned event stream with purpose-built views for each customer use case. This will unlock faster, more reliable insights … released, as well as stress-test changing market conditions. You’ll have the chance to dive deep into insurance domain modelling problems alongside data engineering. You’ll work in an agile, cross-functional squad close to the people who consume what we build, helping us shape our engineering ...

funded AI business that is building the operating system for a large, traditionally under-digitised industry, and looking to hire their first Lead Data Engineer into a small, high-impact team. This is a broad and genuinely technical role sitting at the heart of the data … their AI products. Already live with pilot customers managing 14,000+ units, this is a rare opportunity to join early and own the data architecture from day one, working closely with AI engineers, backend engineers and product teams to translate business needs into real-time, AI-ready data ...

London, United Kingdom | Posted on 24/11/2025 We provide end-to-end IT solutions and services including Applications services, Data & Analytics services, AI/ML Technologies and Professional services in the UK and EU market. Job Description Role Overview We are developing a next-generation … type hints, linters, and test frameworks such as pytest. Solid understanding of data engineering fundamentals including batch processing, schema evolution, and ETL pipeline development. Experience with—or strong interest in learning—Apache Spark for large-scale data processing. Familiarity with AWS data ecosystem ...

well-funded, fast-growing data intelligence startup based in London backed by leading venture investors. The problem Every growing company eventually reaches the same point: its data is everywhere. Customer information lives in one system. Revenue data sits in another. Product activity, operations … through dashboards, writing queries or waiting for someone to bring the numbers together. We’re building a better way. We’re building a data intelligence platform for a world in which AI agents, not just people, need to understand and use business information. Our platform connects fragmented data ...

long way, there's still so much exciting work to do. Come join us at the heart of trust! About the Role: Data isn’t just a byproduct of our business; it’s the engine that drives our growth. We are looking for a Lead Pricing & Monetization Analyst … this role, you’ll focus on empowering the Pricing & Monetization team while working cross-functionally across our commercial organization, and broader analytics and data teams. What You’ll Be Doing: Pricing & Monetization Analytics: Partner with product and commercial leadership to evaluate pricing and packaging strategies, analyzing discount behaviors ...

Location: London (Hybrid - 4 days on-site) The Role We are seeking a mid-level Data Engineer to join a small, high-impact technology team. This role is suited to a self-starter who enjoys autonomy, takes full ownership of their work, and is comfortable operating close … business in a regulated financial context. You will design, build, and maintain robust batch data pipelines, transforming data from diverse sources into a consistent, well-modelled SQL-based warehouse. Your work will directly support investment analysis, risk management, accounting, and external reporting. This is a hands ...

Location: LondonDepartment: TechnologyExperience Level: Experience ProfessionalsContact: Paul KrugJob ID: REQ8322Role overviewWe are hiring a senior engineer to build and operate the data systems that turn vendor feeds, weather data, and satellite and vessel-tracking signals into decisions our commodities investment teams act on directly. The role … covers the full path from external data sources to end users. You will ingest vendor feeds, define schemas and data models, load data into analytical stores, and build controls that identify incomplete or incorrect data before it reaches the desk. The datasets ...

analytics engineering team operating within a highly regulated environment. Key Responsibilities Technical Leadership & Platform Ownership Provide technical leadership for the organisation's strategic data and analytics products. Define and drive the technical roadmap for the GCP Analytics platform from concept through to implementation. Take ownership of engineering standards … with organisational governance standards, security policies and regulatory obligations. Balance innovation and rapid delivery with appropriate risk management and control frameworks. Design secure data integration patterns incorporating authentication, authorisation and access management technologies. Support delivery of solutions that are suitable for audit scrutiny and regulatory reporting requirements. Operate ...

Data Scientist, Research, Reliability Analytics Share Data Scientist, Research, Reliability Analytics link Copy link corporate_fare Google London, UK Mid Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Share Data Scientist, Research, Reliability … Analytics link Copy link Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field. 3 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 3 years ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … joining an established defence programme requiring additional engineering support across an existing data platform. You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment. Due to the nature of the work you will be required to work ...

/pain points. Next 6 months - some examples of what to expect: Help architect and deploy a scalable & cost effective ETL data pipeline with version control, outputting clean data ready for tokenisation. Help deploy our active deep learning training & validation architecture to prod, so that … healthcare and save lives. Work with the ML/data team to creatively ideate and ship features to improve ETL pipeline throughput and quality through a data-driven approach powered by analytics. #J-18808-Ljbffr ...

maintenance of environments and services in cloud and/or on premisesArchitect, engineer and deploy low latency network infrastructure across multiple data centresWriting and maintaining cloud infrastructure scripts, buying into the infrastructure as code paradigmAssist in debugging and resolving production operational issuesEnsuring … proper monitoring and log collection/aggregation is in place and comfortable adding new instrumentation in code as necessaryCreating and maintaining data pipeline(s) and data projections for other departments to have self-service to data sets (ETL Pipelines)The DevOps Engineer Must ...

Through PJT Park Hill, it also provides private fund advisory and fundraising services for alternative investment managers. Задачи: Design and own the Snowflake data architecture, including data models, schemas, warehouses, RBAC, and performance; Write and optimize complex SQL for extraction, transformation, validation, and ad-hoc analysis … transformations; Design and maintain integrations with upstream and downstream systems via RESTful APIs and Core Connectors; Develop subject‐matter expertise on key data elements and ensure data lineage and accuracy; Implement data quality checks, automated validation, and testing; Build and automate departmental workflows, approvals ...

Paris, FRA | Spain, SPA | Italy, ITA | Germany, GERThe EU Amazon Vendor Services (AVS) and Retail Vendor Experience (VX) Program teams are seeking a Data Engineer to design and implement scalable data solutions and pipelines that can meaningfully contribute to both programs. This role is pivotal … inputs for improving the end-customer experience and Amazon's long-term free cash flow. Key job responsibilitiesThis role will sit within a data and analytics team supporting two large program teams (EU AVS and VX) while working closely with BIEs, scientists and 15+ Product Managers. ...

## Senior Data EngineerApplylocations: Londontime type: Full timeposted on: Posted Todayjob requisition id: R114934**Senior Data Engineer****Are you passionate about building scalable, high-performance data-driven applications? Do you enjoy turning complex datasets into robust, reliable systems that deliver real business impact?****About … team:**The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‐driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‐scale search and analytics use cases. You will ...

Fabric Consultant - Hybrid (UK) Client-Facing - Microsoft Fabric - Azure Data Platform - Up to £90,000 Are you a Microsoft Fabric specialist looking to play a key role in shaping enterprise data strategies? We're partnered with a leading technology consultancy that is investing heavily … significant investment and project demand. Interviews are being scheduled quickly, and there is urgency around securing the right person due to a strong pipeline of Fabric engagements. ...

proper monitoring and log collection/aggregation is in place and comfortable adding new instrumentation in code as necessaryCreating and maintaining data pipeline(s) and data projections for other departments to have self-service to data sets (ETL Pipelines)This is a greenfield ...

Hybrid Role Purpose We are seeking a highly experienced, hands-on Azure Databricks Platform Engineer/Architect to enhance and optimise an enterprise Data Platform. The role combines architecture with direct implementation: the successful candidate must be able to configure, develop, troubleshoot and optimise Azure Databricks rather than … compute based on duration, utilisation, SLA, concurrency, performance and cost. Enable and configure Serverless for appropriate jobs, SQL workloads, notebooks, analytical processing and data pipelines. Establish workload-placement guidance, including when Serverless is not economical for predictable, heavy or continuously running workloads. Implement compute policies, autoscaling, quotas, budget ...