376 to 400 of 513 Data Pipeline Jobs in London

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

ETL Application Developer Capacity Management & Data Engineering 6 month contract - Inside IR35 London - Moorgate tube Day rate to be confirmed Our leading bank client is seeking an experienced ETL Application Developer to join their technology resilience and capacity management team. This is a contract opportunity based in London. As an ETL Application Developer, you will play a key … role in ensuring that critical business services have the capacity and resilience to meet regulatory and operational demands. You will focus on developing robust data pipelines and solutions that support capacity monitoring, reporting, and forecasting across complex IT environments. Key Responsibilities: Design, develop, and maintain ETL processes to collect, transform, and load capacity and infrastructure data from multiple sources. Collaborate with cross-functional teams and DBAs to ensure seamless data integration and delivery. Analyse and normalise raw infrastructure and monitoring data for reporting, trending, and predictive analytics. Develop and implement automated methods to forecast future capacity requirements using historical data. Support compliance with regulatory standards (including DORA) by providing accurate More ❯

in Trademark and Brand Protection, we partner with businesses to safeguard their most valuable assets in an increasingly complex digital environment. Our comprehensive solutions, powered by AI-driven data and deep analytics, enable brands to establish, monitor, and protect their presence against infringement and counterfeiting. Why Choose Corsearch? Innovative Solutions : We combine cutting-edge technology with expert judgment … You will design and optimize AI models that power our state-of-the-art image search engine and other innovative solutions. Collaborating with Corsearch’s global team of data scientists, engineers, and brand protection experts, you’ll help drive innovation in brand protection and online content monitoring , ensuring our clients stay ahead in a rapidly evolving digital landscape. … teams to improve product and system performance. Research and implement state-of-the-art algorithms and techniques to improve the accuracy and performance of AI solutions. Build scalable data pipelines for the ingestion and processing of image and text data for model training and evaluation. Continuously monitor the performance of models in production, identify bottlenecks, and More ❯

experienced analytics expert within a digital agency? Are you looking for a new and challenging experience? Ever wondered what working with social media, digital marketing and influencer campaign data is like? At Digital Voices, we drive growth for brands through global Influencer Marketing campaigns. We are looking for a talented, seasoned and motivated Analytics Director to join our … technical, hands-on and client-facing role. The following are the day-to-day tasks and responsibilities expected of the role Working closely with our CTO to create data and measurement applications for internal and external data consumers Build a rapport with our strategy team and our clients, to consult, manage and successfully execute analytics and … dataLayer, server side, etc) and consent management systems (e.g. OneTrust, Cookiebot, etc) Expert user of Google Cloud Platform and adjacent analytics connectors, APIs and platforms. Develop and manage data pipelines between key data sources and destinations using platform APIs and GCP resources such as Cloud Run, Cloud Functions, BigQuery, Cloud SQL Manage and maintain data More ❯

Some of the basics: Salary: £70k-£90k + equity Full-time & Onsite Mon - Thu in Chancery Lane, London Hiring Manager: Marco Giglio (Data Lead) What are we building? Great people are working on overdrive to do a great job, but are held back because their inbox is failing them. We're building an AI Productivity tool that eliminates … HF0 in San Francisco, the world's leading AI startup accelerator, learning directly from leaders at OpenAI, Snowflake, and Instacart. We're now in hyper growth mode and data is at the heart of how we scale. Why This Role Matters As our first Analytics Engineer with a product & marketing focus, you'll empower the teams closest to … our users and growth engine. You'll build clean, fast, flexible data models that unlock insight across product usage, user behaviour, marketing performance, monetisation, and retention. Beyond data modelling, you'll help answer critical business questions: What drives retention across user types? Which features correlate with conversion or churn? How should we allocate budget across growth More ❯

rather than endure) change Bring critical thought and opinion — and embrace differences and disagreement to get shit done and move forward Work digital-first for your daily work Data is a crucial part of Shopify’s mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants … and stakeholders across the organization. From pipelines and schema design to machine learning products and decision support, data science at Shopify is a diverse role with many opportunities to positively impact our success. Our Staff (aka Lead) Data Scientists focus on pushing products and the business forward, with a focus on solving important problems rather than … specific tools. We are looking for talented data scientists to help us better understand our merchants and buyers so we can help them on their journey. This role is focused on building the next generation Search algorithms, incorporating the newest ML techniques. You may also work on projects involving LLM-based work. You will also create the architecture More ❯

powering our marketing technology and performance efforts. As a Junior MarTech Analyst, you will be embedded within the acquisition and performance marketing teams, working closely with Marketing Managers, Data Engineers, and MarTech Operations leads. You’ll collaborate with cross-functional partners wider data teams to connect, segment, and optimise data flows that drive our … advertising platforms. This role offers a great opportunity to develop your technical skills, particularly in SQL and data engineering, while contributing directly to marketing growth and innovation. You’ll have the autonomy to support and improve our marketing data infrastructure, helping the team make data-driven decisions that fuel Trainline’s success. As a … Trainline, you will... As a Junior MarTech Analyst, You Will Work Closely With The MarTech Operations Lead And Performance Marketing Teams To Support The Connection And Management Of Data Pipelines Between Our Data Platforms And Advertising Channels. You’ll Collaborate With Stakeholders To Connect and configure customer, route, and pricing data from our data More ❯

partners. Continuing to support and complement Ripple's Payments, Custody and Stablecoin business units WHAT YOU'LL DO: Design and build scalable, low-latency microservices and event-driven data pipelines to support high-throughput trading systems. Champion data engineering best practices including schema evolution, data contracts, and data quality across event streams. … Collaborate with cross-functional teams to model, publish, and maintain high-quality data products aligned with enterprise standards. Implement CI/CD pipelines, automated testing, infrastructure-as-code, and monitoring solutions to ensure operational excellence. Lead end-to-end software development efforts-from gathering requirements to deployment and production support. Contribute to engineering excellence through mentoring, code reviews … proficiency in Java or similar languages (Golang, Scala, etc.). Proven track record building large-scale, low-latency distributed systems in trading or financial environments. Deep understanding of data streaming, order management systems, and modern persistence technologies (e.g., Aurora, DynamoDB). Experience working in front-office trading environments, ideally with exposure to FX and/or crypto trading More ❯

be responsible for the implementation of technology to enable large-scale computational efforts in quantitative research, as well as related efforts, such as the preparation and transformation of data and other operational tasks. Preferred Location London or Dubai preferred Principal Responsibilities Partner closely with the Portfolio Manager to develop data engineering and prediction tools primarily for … Develop software engineering solutions for quantitative research and trading Assist in designing, coding, and maintaining tools for the systematic trading infrastructure of the team Build and maintain robust data pipelines and databases that ingest and transform large amounts of data Develop processes that validate the integrity of the data Implementation and operation of systems … the trading group in a transparent environment, engaging with the whole investment process Preferred Technical Skills Expert in Python and/or KDB/Q Proficient in modern data science tools stacks (Jupyter, pandas, numpy, sklearn) with machine learning experience Good understanding of using Slurm or similar parallel computing tools Bachelor's or Master's degree in Computer More ❯

to a better life, enabled by economic prosperity that lifts society up. That's why we empower British businesses and government to harness the power of AI and data analytics, so they can create value for people, not just profits. By working with brave and ambitious organisations who share our vision, we're building a future where everyone … and AI. We supercharge high-value, complex processes to drive operational efficiency and profitability. As markets face greater disruption, QuantSpark empowers companies in realising their competitive advantage through data, strategic insight, and AI. Why Join QuantSpark? At QuantSpark, we believe in creating value for people-not just profits-through the power of data-driven insights and … software development, with a strong background in developing web applications. Familiarity with relevant technologies, including Python (Flask or Django) for backend and React.js for frontend development. Advanced in data pipelining and schema design, with demonstrable experience designing and implementing robust, performant data pipelines from a variety of sources such as databases, APIs, SFTP, etc. Experience building More ❯

and outcomes at scale. With tools for work order management, compliance, inspections, and field service coordination, we help our partners streamline operations, deliver essential services faster, and make data-driven decisions with confidence. Today, millions of homes are managed through Plentific-and we're just getting started. We're a team of curious minds and problem solvers, united … sits at the centre of everything we do at Plentific and is constantly tackling challenging problems, such as online payments, quoting, invoicing, booking, search/scoring algorithms, ETL, data pipelines, in-app messaging, real-time notifications and fraud prevention. Our backend engineers mostly work with Python and Django on an increasingly more service-oriented architecture. The rest of … with product owners, engineering managers, user interface designers and other software engineers to write technical documents that identify software project requirements Design, build and maintain APIs, microservices and data pipelines Write well-formulated, testable and readable code using appropriate software design patterns Design, normalise and optimise relational databases Write complex SQL queries to get data from More ❯

to enter prize draws via an app and website - both of which are seeing exponential growth.They've recently launched a new app and are investing heavily into data, product and engineering to optimise user experience and fuel innovation. You'll join a mission-driven company that combines a growth-focused product mindset with a meaningful social purpose. The … Product), reporting directly to the Director of Analytics. This role will be central to shaping new customer propositions, pricing experiments, digital journeys, and app strategies.You'll own the data behind product development and customer experience, driving forward ideas that directly impact retention, user satisfaction, and revenue. You'll have access to billions of rows of data and collaborate closely with data engineers and product managers to test hypotheses and uncover actionable insight. Key Responsibilities Act as the dedicated data partner to the product team across web and app Lead A/B and multivariate testing to validate feature development, UX changes, and pricing experiments Analyse performance of new customer propositions More ❯

of-the-art. We are a venture backed company founded by professionals with experience spanning machine learning, trading, and quantitative research. The Role We're looking for a data-savvy software engineer who thrives on solving new and unexpected challenges - building bespoke software, APIs, data pipelines, and platform components that bring AI capabilities to life. On … a practical level, you'll work closely with our data scientists, product team (and sometimes end-users) to bring AI systems into the real world. That could mean shaping how a new model is integrated, debugging a system bottleneck, or helping internal teams and customers get more value from model outputs as needs evolve. Requirements Proven experience designing … or depend on ML models, including deployment or inference tooling (e.g. model serving, feature stores) Think in terms of use cases and outcomes, not just infrastructure and moving data Strong software engineering fundamentals, with deep knowledge of algorithms, data structures, and system design Nice to Have Built tools or interfaces for internal teams (e.g. dashboards, annotation More ❯

Additional Job Description As a Product Taxonomy Lead at Barclays, you will be at the forefront of designing and delivering enterprise-grade data solutions that support Product Taxonomy adoption across front-to-back processes, regulatory reporting, and business insights. This role sits at the intersection of data architecture, data analytics, and regulatory transformation, ensuring … that product taxonomies, data structures, and analytical frameworks are aligned with both operational execution and strategic goals. To be successful as a Product Taxonomy Lead, you should have experience … with: Deep understanding of investment banking products and its application in regulatory and operational contexts. Strong technical expertise in data modelling, logical design, and data pipeline development. Familiarity with reference and master data management Proven experience in data architecture, data analytics, or engineering within financial services or investment banking. More ❯

you a hands-on Product Analyst with a passion for experimentation and impact? This established, fast-growing company is looking for a technically-savvy analyst who thrives on data-driven product optimisation and loves uncovering opportunities for growth through A/B testing. THE ROLE: As the Product Analyst, you’ll: Design, run, and analyse A/B … features, UX changes, and other product optimisations. Work closely with Product Managers, Engineers, and Designers to identify opportunities, define success metrics, and guide decision-making. Develop and maintain data pipelines and dashboards using BigQuery and Looker Studio to monitor performance and key KPIs. Deliver actionable insights that drive user engagement, retention, and business value. Be a key part More ❯

those looking to make a severe impact and are excited about working in a high-growth startup. We ship fast, continuously, and iteratively, learning each step. We are data-informed. And are ok with finding the data when it's missing. Our products We have a suite of API products that automate tax-related workflows for … any internet company. Those products are Lookup , Tax , Returns , Data sharing and E-Invoicing . We may discover novel customer needs as we learn and spin up new products as required. Our API docs For you as an engineer, API documentation is probably an important part when considering a new career move. Thanks to the API docs, you … features across the stack, from back-end business logic implementation to front-end customer-facing interfaces. You would be a great fit if You have experience working with data scientists and data engineers. You have a good understanding of how machine learning works and can bring this expertise to Fonoa. You have experience working with LLMs More ❯

The Data and Artificial Intelligence (AI) team is a new function within Customer Engagement Technology. We own the end-to-end process of defining, building, implementing, and monitoring a comprehensive data strategy. We also develop and apply Generative Artificial Intelligence (GenAI), Machine Learning (ML), Ontology, and Natural Language Processing (NLP) to enhance customer service associate and … Service globally, leveraging GenAI, ML, and/or NLP to transform complex business requirements and customer needs into innovative technology solutions. Your expertise will be key in shaping data-driven strategies and addressing complex data challenges. With your expertise in AI, text analysis, embeddings, language modeling, and generation, you'll design and develop scalable AI-powered … technology solutions, prioritize initiatives, drive data-driven insights, and deliver business impact. This position will advance applied science best practices, leverage data and AI to drive customer experience (CX) improvements, and set new global standards for customer experience. This role requires you to work with a cross-functional team, including scientists, engineers, and product managers, to More ❯

systems (TMS), and mobile measurement platforms (MMPs). Campaign Enablement & Optimization Oversee deployment and optimization of digital campaigns through technologies like DCO, SPO, and MMP. Drive efficiency through data-informed testing, measurement frameworks, and performance optimization techniques. Tagging, Pixel & Tech Implementation Own onsite tagging strategies and data accuracy across web and mobile environments. Partner with developers … Analytics & Reporting Use tools like GA4 and Adobe Analytics to create actionable insights and stakeholder dashboards. Collaborate with regions to drive visibility, consistency, and readiness across reporting outputs. Data Governance & Compliance Enforce policies that safeguard data privacy, accuracy, and platform compliance. Implement and optimize Conversion APIs and data pipelines that support attribution and decision … Google Tag Manager, Adobe Launch). Proficient in web analytics tools (e.g., GA4, Adobe Analytics). Hands-on experience with DCO, MMPs (AppsFlyer, Kochava), SPO, Conversion APIs, and data c lean rooms. Familiarity with CDPs, CMPs, DSPs, and social/search activation platforms (e.g., Meta, Google Ads). Strong knowledge of data governance, privacy frameworks , and More ❯

decisions. - Develop queries and visualizations for ad-hoc requests and projects, as well as ongoing reporting. - Write queries and output efficiently, and have in-depth knowledge of the data available in area of expertise. Pull the data needed with standard query syntax; periodically identify more advanced methods of query optimization. Convert data to make … it analysis-ready. - Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation. - Monitor and troubleshoot operational or data issues in the data pipelines. - Review and audit existing ETL jobs and SQL queries. - Good communication and writing. Effectively communicates with both business and technical teams. A day … in the life - Partner with Business Stakeholders to automate metrics and dive data to drive decisions that will support Sellers on the Amazon Platform - Surface opportunities to drive process improvement, looking beyond the surface to understand what the data means for the team - Participate in reviews with Global leadership spanning our six operations sites, from Arizona More ❯

committed to your career growth from day one. In this role, you will: Develop backend components for a Python web application. Integrate AI/ML modules with frontend, data, and compute infrastructure. Ensure high-quality software implementation following best practices, including automated testing and documentation. Develop, measure, and monitor key metrics for tools and services, iterating for improvements. … Participate in code reviews to enhance personal and team standards. Collaborate with technical staff and data engineers to build end-to-end data pipelines. Why you? Qualifications & Skills: Bachelor's degree in a relevant field or equivalent experience. Experience with cloud platforms (e.g., Google Cloud, Cloud Run). Strong Python skills. Experience with unit testing frameworks … development practices. Proficiency with modern development tools (git/GitHub, DevOps). Preferred Qualifications & Skills: Experience with Python backend frameworks (e.g., FastAPI). Experience with biological or scientific data or pharmaceutical industry. Knowledge of AI/ML deployment, especially language models, NLP, agent-based approaches. Experience with Docker and containerized applications. Leadership experience in software development projects. Experience More ❯

Data Integrations Engineer - London THE GOAL The role of the Data Integrations Engineer is to manage the implementation, change, and maintenance of Product and Sales data within the KellyDeli group. This key role manages product data, enabling our kiosk network to print labels at POS with product pricing and label information. Sales … data management is also a responsibility, ensuring inbound data feeds are managed promptly to support invoicing processes. WORKING RELATIONSHIPS Working within the IT Support team, the role has key relationships with marketing, quality, and partner networks, including retailers both large and small. The role reports to the IT Manager and is crucial to the business and … Extract, transform, and reload data within the role's scope, ensuring business logic is documented, reviewed, and clearly communicated. Assist in implementing data management and pipeline processes. Become an expert in sales and operational data processes, supporting Business Intelligence and reporting. Run PLM system integration jobs, review results, and report accordingly. WHO THEY More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £500-600 (Outside IR35) The reason they're hiring now, they have More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they More ❯

Head of Data Engineering Are you ready to shape the future of digital advertising through data? A fast-growing, innovative ad tech company is looking for a Head of Data Engineering to lead the development of its audience intelligence and targeting infrastructure. This is a rare opportunity to build from the ground up and … make a direct impact on campaign performance for some of the world's most recognisable brands. What You'll Do As Head of Data Engineering, you'll sit at the intersection of data, strategy, and technology. Your mission: to design and manage the systems that power audience targeting across a video advertising platform. Key Responsibilities: Audience … Data Infrastructure : Build and evolve the architecture for ingesting, storing, and activating digital audiences across publisher and SSP networks. Data Pipelines : Design robust pipelines to process real-time and historical data for audience segmentation. Identity Resolution : Lead the integration of identity resolution solutions to unify first- and third-party data sources. AI More ❯

AWS, Kubernetes, and Docker Proficiency in Unix systems, ideally Linux (Ubuntu) Strong communication skills and experience mentoring engineers Responsibilities Your main responsibilities will involve working on: Data pipeline and underlying infrastructure, especially Apache Kafka and PostgreSQL database Technologies like Kubernetes, Vault, Go microservices, and other cloud services On-premise infrastructure Your technical expertise will play a crucial More ❯