351 to 375 of 465 Data Pipeline Jobs in London

of-the-art. We are a venture backed company founded by professionals with experience spanning machine learning, trading, and quantitative research. The Role We're looking for a data-savvy software engineer who thrives on solving new and unexpected challenges - building bespoke software, APIs, data pipelines, and platform components that bring AI capabilities to life. On … a practical level, you'll work closely with our data scientists, product team (and sometimes end-users) to bring AI systems into the real world. That could mean shaping how a new model is integrated, debugging a system bottleneck, or helping internal teams and customers get more value from model outputs as needs evolve. Requirements Proven experience designing … or depend on ML models, including deployment or inference tooling (e.g. model serving, feature stores) Think in terms of use cases and outcomes, not just infrastructure and moving data Strong software engineering fundamentals, with deep knowledge of algorithms, data structures, and system design Nice to Have Built tools or interfaces for internal teams (e.g. dashboards, annotation More ❯

Additional Job Description As a Product Taxonomy Lead at Barclays, you will be at the forefront of designing and delivering enterprise-grade data solutions that support Product Taxonomy adoption across front-to-back processes, regulatory reporting, and business insights. This role sits at the intersection of data architecture, data analytics, and regulatory transformation, ensuring … that product taxonomies, data structures, and analytical frameworks are aligned with both operational execution and strategic goals. To be successful as a Product Taxonomy Lead, you should have experience … with: Deep understanding of investment banking products and its application in regulatory and operational contexts. Strong technical expertise in data modelling, logical design, and data pipeline development. Familiarity with reference and master data management Proven experience in data architecture, data analytics, or engineering within financial services or investment banking. More ❯

you a hands-on Product Analyst with a passion for experimentation and impact? This established, fast-growing company is looking for a technically-savvy analyst who thrives on data-driven product optimisation and loves uncovering opportunities for growth through A/B testing. THE ROLE: As the Product Analyst, you’ll: Design, run, and analyse A/B … features, UX changes, and other product optimisations. Work closely with Product Managers, Engineers, and Designers to identify opportunities, define success metrics, and guide decision-making. Develop and maintain data pipelines and dashboards using BigQuery and Looker Studio to monitor performance and key KPIs. Deliver actionable insights that drive user engagement, retention, and business value. Be a key part More ❯

those looking to make a severe impact and are excited about working in a high-growth startup. We ship fast, continuously, and iteratively, learning each step. We are data-informed. And are ok with finding the data when it's missing. Our products We have a suite of API products that automate tax-related workflows for … any internet company. Those products are Lookup , Tax , Returns , Data sharing and E-Invoicing . We may discover novel customer needs as we learn and spin up new products as required. Our API docs For you as an engineer, API documentation is probably an important part when considering a new career move. Thanks to the API docs, you … features across the stack, from back-end business logic implementation to front-end customer-facing interfaces. You would be a great fit if You have experience working with data scientists and data engineers. You have a good understanding of how machine learning works and can bring this expertise to Fonoa. You have experience working with LLMs More ❯

systems (TMS), and mobile measurement platforms (MMPs). Campaign Enablement & Optimization Oversee deployment and optimization of digital campaigns through technologies like DCO, SPO, and MMP. Drive efficiency through data-informed testing, measurement frameworks, and performance optimization techniques. Tagging, Pixel & Tech Implementation Own onsite tagging strategies and data accuracy across web and mobile environments. Partner with developers … Analytics & Reporting Use tools like GA4 and Adobe Analytics to create actionable insights and stakeholder dashboards. Collaborate with regions to drive visibility, consistency, and readiness across reporting outputs. Data Governance & Compliance Enforce policies that safeguard data privacy, accuracy, and platform compliance. Implement and optimize Conversion APIs and data pipelines that support attribution and decision … Google Tag Manager, Adobe Launch). Proficient in web analytics tools (e.g., GA4, Adobe Analytics). Hands-on experience with DCO, MMPs (AppsFlyer, Kochava), SPO, Conversion APIs, and data c lean rooms. Familiarity with CDPs, CMPs, DSPs, and social/search activation platforms (e.g., Meta, Google Ads). Strong knowledge of data governance, privacy frameworks , and More ❯

decisions. - Develop queries and visualizations for ad-hoc requests and projects, as well as ongoing reporting. - Write queries and output efficiently, and have in-depth knowledge of the data available in area of expertise. Pull the data needed with standard query syntax; periodically identify more advanced methods of query optimization. Convert data to make … it analysis-ready. - Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation. - Monitor and troubleshoot operational or data issues in the data pipelines. - Review and audit existing ETL jobs and SQL queries. - Good communication and writing. Effectively communicates with both business and technical teams. A day … in the life - Partner with Business Stakeholders to automate metrics and dive data to drive decisions that will support Sellers on the Amazon Platform - Surface opportunities to drive process improvement, looking beyond the surface to understand what the data means for the team - Participate in reviews with Global leadership spanning our six operations sites, from Arizona More ❯

committed to your career growth from day one. In this role, you will: Develop backend components for a Python web application. Integrate AI/ML modules with frontend, data, and compute infrastructure. Ensure high-quality software implementation following best practices, including automated testing and documentation. Develop, measure, and monitor key metrics for tools and services, iterating for improvements. … Participate in code reviews to enhance personal and team standards. Collaborate with technical staff and data engineers to build end-to-end data pipelines. Why you? Qualifications & Skills: Bachelor's degree in a relevant field or equivalent experience. Experience with cloud platforms (e.g., Google Cloud, Cloud Run). Strong Python skills. Experience with unit testing frameworks … development practices. Proficiency with modern development tools (git/GitHub, DevOps). Preferred Qualifications & Skills: Experience with Python backend frameworks (e.g., FastAPI). Experience with biological or scientific data or pharmaceutical industry. Knowledge of AI/ML deployment, especially language models, NLP, agent-based approaches. Experience with Docker and containerized applications. Leadership experience in software development projects. Experience More ❯

Data Integrations Engineer - London THE GOAL The role of the Data Integrations Engineer is to manage the implementation, change, and maintenance of Product and Sales data within the KellyDeli group. This key role manages product data, enabling our kiosk network to print labels at POS with product pricing and label information. Sales … data management is also a responsibility, ensuring inbound data feeds are managed promptly to support invoicing processes. WORKING RELATIONSHIPS Working within the IT Support team, the role has key relationships with marketing, quality, and partner networks, including retailers both large and small. The role reports to the IT Manager and is crucial to the business and … Extract, transform, and reload data within the role's scope, ensuring business logic is documented, reviewed, and clearly communicated. Assist in implementing data management and pipeline processes. Become an expert in sales and operational data processes, supporting Business Intelligence and reporting. Run PLM system integration jobs, review results, and report accordingly. WHO THEY More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £500-600 (Outside IR35) The reason they're hiring now, they have More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they More ❯

Head of Data Engineering Are you ready to shape the future of digital advertising through data? A fast-growing, innovative ad tech company is looking for a Head of Data Engineering to lead the development of its audience intelligence and targeting infrastructure. This is a rare opportunity to build from the ground up and … make a direct impact on campaign performance for some of the world's most recognisable brands. What You'll Do As Head of Data Engineering, you'll sit at the intersection of data, strategy, and technology. Your mission: to design and manage the systems that power audience targeting across a video advertising platform. Key Responsibilities: Audience … Data Infrastructure : Build and evolve the architecture for ingesting, storing, and activating digital audiences across publisher and SSP networks. Data Pipelines : Design robust pipelines to process real-time and historical data for audience segmentation. Identity Resolution : Lead the integration of identity resolution solutions to unify first- and third-party data sources. AI More ❯

AWS, Kubernetes, and Docker Proficiency in Unix systems, ideally Linux (Ubuntu) Strong communication skills and experience mentoring engineers Responsibilities Your main responsibilities will involve working on: Data pipeline and underlying infrastructure, especially Apache Kafka and PostgreSQL database Technologies like Kubernetes, Vault, Go microservices, and other cloud services On-premise infrastructure Your technical expertise will play a crucial More ❯

Data Operations Manager: We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities of the Data Operations Manager: Data Infrastructure Management: Oversee the design … implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across AWS products, including More ❯

Data Analyst - SQL & BigQuery Outside IR35 | £300 - £340 | Remote first SR2 is working with an organisation within a regulated industry who are looking for a data analyst to help provide additional insights on a section of the business. You will also be building data pipelines. Given that this is a regulated industry, they are … etc. For this contract, it is essential that you have strong experience with SQL and BigQuery. These will be assessed at interview phase during a tech test. Role: Data Analyst SQL (essential) BigQuery (essential) AWS/GCP (desirable) Python (desirable) Overview: Outside IR35 £300 - £340 Remote first Start ASAP 6 month contract Please only apply if you have More ❯

Data Analyst - SQL & BigQuery Outside IR35 | £300 - £340 | Remote first SR2 is working with an organisation within a regulated industry who are looking for a data analyst to help provide additional insights on a section of the business. You will also be building data pipelines. Given that this is a regulated industry, they are … etc. For this contract, it is essential that you have strong experience with SQL and BigQuery. These will be assessed at interview phase during a tech test. Role: Data Analyst SQL (essential) BigQuery (essential) AWS/GCP (desirable) Python (desirable) Overview: Outside IR35 £300 - £340 Remote first Start ASAP 6 month contract Please only apply if you have More ❯

ideal candidate will have extensive hands-on experience building and implementing ELK solutions from the ground up-not just monitoring existing systems. Key Responsibilities: Design, build, and implement data ingestion pipelines using Logstash and Kafka Set up and configure the ELK Stack (Elasticsearch, Logstash, Kibana), including Fleet and Integrations Collaborate with stakeholders to analyze data and … availability, and reliability of the ELK environment Maintain and support the ELK stack and its integrations Apply domain knowledge in security and cloud environments to enhance data pipeline resilience and compliance Mandatory Skills & Qualifications: 8+ years of hands-on experience with Elasticsearch , Logstash , and Kibana Proven track record of implementing and maintaining ELK stacks Experience designing and … developing data pipelines Strong exposure to cloud platforms (e.g., AWS, Azure, GCP) Proficiency with Kafka for data streaming and ingestion Background or familiarity in the security domain Deep understanding of ELK ecosystem components including Fleet , Beats , and advanced Kibana dashboards Strong problem-solving and analytical skills Desirable: Experience with Elastic Security or Observability solutions Certification in More ❯

have become a multibillion-dollar asset manager, and we have ambitious goals for the future. Role Overview You will be developing the company's production trading systems and data pipelines that support our machine learning models in both production and research environments. Collaboration with research and trading teams is essential to meet diverse requirements and complex trading behaviors. … world-class machine learning researchers. Responsibilities Develop and maintain real-time distributed trading systems that execute orders based on our machine learning models. Design and optimize large-scale data processing systems for historical and real-time ML feature pipelines. Enhance the resilience and performance of trading and data processing systems. Build tools to integrate and validate … in Computer Science, Engineering, or a related field, or equivalent industry experience. Preferred Qualifications Experience or interest in mentoring junior engineers. Familiarity with data-centric workflows and pipeline orchestration (e.g., Apache Airflow). Proficiency in data validation, anomaly detection, or debugging using tools like Pandas, Polars, or data.table/R. Experience working with AWS or More ❯

Python Developer/Data Engineer Python, NoSQL, Elasticsearch Fully remote. 100% Home Working Opportunity to join a small data consultancy who are delivering a major impact to their customer. Customers are gaining increased revenue and finding cost efficiencies directly from the data insights provided through the SaaS platform. Build data pipelines to … stakeholders then deliver the solution. Experience required: STEM/Computer Science Degree OR sufficient commercial experience Good skills with Python. Use of Pandas is a bonus Experience building Data Pipelines/ETL using Python Experience consuming with REST API services 1 years + commercial experience with Python or languages such as JAVA, PHP, Go Communication skills. You must More ❯

/Week in Central London A high-growth AI startup is redefining one of the world's most complex industries with cutting-edge generative models and large-scale data systems. They're hiring a backend-leaning full-stack engineer to build the infrastructure powering novel, AI-driven workflows, from scratch. 💰 What's on offer: * Up to … visa sponsorship + generous relocation support * Greenfield AI product work in a high-autonomy environment 🔍 What you'll be doing: * Architect secure, scalable backend infrastructure * Build and maintain data pipelines, microservices, and DevOps tooling * Work across the stack to deliver fast, end-to-end product iterations * Collaborate directly with users to shape product and engineering direction ⚙️ Tech environment … Secure system design 🎯 You bring: * 3+ years' experience as a backend or full-stack engineer * Strong proficiency in Python and relational databases (PostgreSQL) * Experience building distributed systems or data platforms * Bonus: hands-on with AWS, Docker, CI/CD tooling Excited to build the backbone of next-gen AI products - and ship fast? Apply now More ❯

measuring, and reporting market risk across trading activities and investment portfolios. You will leverage your strong analytical and programming skills to build and maintain robust risk models and data pipelines, ensuring the accuracy and efficiency of their risk management framework. We are looking for a self-starter who can collaborate with other teams and communicate effectively with stakeholders. … VaR), portfolio sensitivities, and other market risk metrics. Utilize Python programming language and relevant libraries (Pandas, NumPy, SciPy) to manipulate, analyze, and visualize market data. Build and maintain data pipelines for efficient ingestion, transformation, and cleansing of financial data from various sources. Conduct back-testing and stress-testing exercises to assess the effectiveness of risk models … methodologies, including econometrics. Proficiency in Python and relevant libraries (Pandas, NumPy, SciPy). Solid understanding of time series analysis techniques and statistical modeling. Experience with building and maintaining data pipelines for financial data. Excellent communication and collaboration skills. Ability to work effectively in a fast-paced, dynamic environment. Experience with financial modeling and derivatives pricing. Knowledge of SQL More ❯

based in the UK to join a dynamic team on a contract basis. What you’ll do: Lead and deliver complex Databricks projects end-to-end Collaborate with data engineers, scientists, and business stakeholders Optimize and implement scalable data pipelines on the Databricks platform Provide expert guidance and best practices for Apache Spark and cloud data More ❯

problems, processing large datasets, and building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply them to customer problems. We … the team's products. Key job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new features participating in design reviews … We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our More ❯

can work across the entire tech stack from crafting seamless user experiences in ReactJS, to writing robust backend logic in PHP/Hack, and developing automation tools and data pipelines with Python. You’ll collaborate closely with cross-functional teams, bring technical ideas to life, and contribute to the full software development lifecycle from architecture and coding to … applications using ReactJS, PHP/Hack, and Python Design user interfaces and implement server-side logic and databases for optimal performance Create Python-based solutions (e.g., automation libraries, data processing pipelines) Analyse complex problems and deliver effective technical solutions Write clean, efficient, and well-documented code Support system performance monitoring, incident resolution, and disaster recovery planning Evaluate new More ❯

Engineer/SRE - Observability Location London Business Area Engineering and CTO Ref # Description & Requirements The Role As a Senior Software Engineer/SRE in Bloomberg's Market Data group, you'll help ensure our real-time data infrastructure is reliable, automated, and observable at massive scale. Our systems process hundreds of billions of financial ticks … tools, systems, and models that expose and improve the health of this infrastructure across the globe. The Team Platform Observability sits at the heart of Bloomberg's Market Data operations. Our mission is to make decision-making across Market Data intelligent and data-driven. To do that, we build the systems that model metadata … and drive reliability across one of the world's most critical real-time data platforms. What You'll Do Expand and maintain the Market Data Pipeline Ontology, our semantic model for system metadata. Build and extend ETL plugins that collect, transform, and aggregate metadata from key systems. Develop intuitive GUIs and interfaces to expose system More ❯

IR35, pays £400 - £450 per day and requires no onsite work.The successful candidate will be responsible for enhancing, designing, and deploying ongoing improvements to our bespoke data pipeline and associated API services. Key Requirements 5+ years of Python experience with frameworks like Flask, FastAPI, and Django. Strong command orchestration tools (e.g. Prefect, Airflow), Docker, and AWS infrastructure … . Solid understanding of API services, authentication methods (JWT, SSO), and clear, pragmatic communication skills. Maintain, upgrade, and improve existing systems and custom ETL pipelines. Collaborate with developers, data scientists, and QA teams to enhance tooling, processes, and documentation. Guide best practices and governance for web applications and services. What you need to do now If you feel More ❯