251 to 275 of 564 Data Pipeline Jobs in London

and installing automation. As a Senior Process Mining Consultant, you play a key role in shaping our clients' strategic goals by transforming raw data into actionable insights. You collaborate closely with the project team to deliver impactful, data-driven solutions that maximize value for clients. Leveraging … levels. Passionate about understanding and interpreting business processes. Known for your analytical mindset, organizational skills, and ability to learn quickly. Excited about Big Data, Data Mining, Business Intelligence, and Process Mining, with a desire to continuously expand your expertise. Preferred Qualifications: Experience with setting up data pipelines (configuring source connections, using flat files, SQL for data transformation, and defining data models). Motivated and forward-thinking, ready to contribute to the evolution of Process Mining technology. Eager to tackle challenges and embrace a steep learning curve to grow and expand More ❯

Lead Data Engineer | Build and Lead a New Data Team I am looking for a Lead Data Engineer to establish and lead a new Data Engineering team. This is a unique opportunity to shape data architecture from the ground up … working with cutting-edge technology to drive business performance. The Role As the first Data Engineering hire, you will: Design and implement scalable data architectures for efficient storage and access. Build and maintain data pipelines handling terabyte-scale datasets. Work closely with data scientists, analysts, and stakeholders to optimize data solutions. Own the reliability, performance, and scalability of data infrastructure. Recruit and lead a growing team of data engineers. Tech Stack Python (3.10+), Pandas, NumPy PostgreSQL (TimescaleDB), SQL optimization RabbitMQ, ZeroMQ, Linux servers Prometheus, Grafana More ❯

Sr. Product Mgr, Business Data Technologies At Amazon, data is critical to everything we do, from understanding product inventories across our global fulfillment centers to predicting what products to recommend to customers. Data ceaselessly informs our flywheel, helping us to understand customer needs, onboard … new sellers and selection, and identify opportunities for cost savings. Business Data Technologies (BDT) provides trustworthy, intuitive, and cost-efficient solutions for Amazonians to secure, store, analyze, and transform this data at unparalleled scale. BDT owns, develops, and operates Andes, one of the largest data lakes in the world, storing more than 2 exabytes of data, read/written to by 100k+ data pipelines, with >60k monthly active users. To do this, we need extraordinary individuals to build the next generation of data analytics, machine learning, and More ❯

team We are the central Amazon Business Marketing Analytics (ABMA) team for WW AB Marketing team. Our vision is to simplify and accelerate data driven decision making for AB Marketing by providing cost effective, easy & timely access to high quality data. Our core responsibilities towards AB marketing include … the speed of business decision-making by reducing the effort & time to access actionable data. Minimum Requirements 2+ years of analyzing and interpreting data with Redshift, Oracle, NoSQL etc. experience. Experience with data visualization using Tableau, Quicksight, or similar tools. Experience with one or more industry … Python, Java, or R). Preferred Qualifications Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

Staff Data Engineer Joining one of the best-known retail brands in the UK as a Staff Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and … maintaining data pipelines and to collaborate with the wider data teams. The Opportunity For this role as Staff Data Engineer, they are looking for this person to have extensive experience with data pipelines, data warehousing and to play a key … role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision making. Within this role as a Staff Data Engineer, they'd also be More ❯

Job Title: AWS Data Engineer Location: UK Wide Travel Frequency: Hybrid (Need to travel on-site 2-3 days per week to any nearby Capgemini office) Working Pattern: Full-time Permanent The Job You're Considering The Cloud Data Platforms team is part of the Insights … and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers' digital … and data transformation journey using the modern cloud platforms. We specialise in using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Your role We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to More ❯

you'll grow both professionally and personally. Community: Join a diverse, passionate team that values collaboration . We're looking for a Senior Data Engineer based in London to join our Data Team to help shape the future of the data infrastructure that powers … their work on the life sciences industry, and this fuels their passion. The core skills we seek: Expertise in Python and SQL for data processing, analysis and automation. Proficiency in building and maintaining batch and streaming ETL/ELT pipelines at scale, employing tools such as Airflow, Fivetran … Production experience across the core technology stack of Python and SQL for data scripting and transformation, data engineering tools for pipeline development and orchestration and running on cloud infrastructure such as AWS. Delivery-focused and pragmatic in ensuring customer value is delivered efficiently, with necessary More ❯

network of 20 offices nationally: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations There has never been a been a better time to join the Data & AI team at KPMG. Our clients and communities we act in embrace the opportunities provided by AI, and are looking for help deploying GenAI … in a fair, ethical and impactful way. The KPMG Data & AI team helps clients on their AI transformation journeys by leveraging advanced analytical techniques and industrial-scale AI platforms. Our projects span industries such as Financial Services, Retail, Public Sector, Healthcare, Energy, and Utilities, with a focus on … extracting data insights, building AI models, and delivering value through engaging, data-driven stories. Our approach is multi-disciplinary, so we are able to answer our clients’ most complex issues and have significant impact on their business results. KPMG UK is looking for a Generative AI More ❯

network of 20 offices nationally: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations There has never been a been a better time to join the Data & AI team at KPMG. Our clients and communities we act in embrace the opportunities provided by AI, and are looking for help deploying GenAI … in a fair, ethical and impactful way. The KPMG Data & AI team helps clients on their AI transformation journeys by leveraging advanced analytical techniques and industrial-scale AI platforms. Our projects span industries such as Financial Services, Retail, Public Sector, Healthcare, Energy, and Utilities, with a focus on … extracting data insights, building AI models, and delivering value through engaging, data-driven stories. Our approach is multi-disciplinary, so we are able to answer our clients’ most complex issues and have significant impact on their business results. KPMG UK is looking for a Generative AI More ❯

and retaining talent - and yet so many companies struggle to get it right. They simply have no choice but to rely on poor data and unsophisticated tools for their pay decisions. That's why we created Ravio. We help many of the world's most innovative and ambitious … companies build stronger teams and reach their goals through better compensation. Our real-time data platform brings compensation into the modern age, tracking the market across all compensation types from salary to equity and benefits. We're passionate about ensuring everyone is paid what they deserve, no matter … and maintaining Ravio's data pipelines and infrastructure - the core of our business. Shape and implement the data roadmap, improving pipeline structure, robustness, testing, and continuous development as well as helping oversee the team's cloud infrastructure. Ensure data quality, governance, and security More ❯

Job Title: Data Engineer (senior/principal) 💰 Salary: ~£90-120k 📍 Location: Covent Garden (4 office days/week) 📱 Industry: Telecoms (challenger) This MVNO company is on a mission to disrupt the mobile network industry with highly innovative ideas and a revolutionary business model that truly places customers … latest technology, setting out to be a hub of creativity and pioneering ideas that will transform the industry. As a Senior/Principal Data Engineer, you will be an integral part of a data-driven organisation, responsible for the data infrastructure from data collection through to data service of analytics, you will provide self-servicing tools and access of data to support colleagues to make data-driven decision and drive results. ✅ Must have requirements: Python SQL expertise designing and maintaining ETL/data More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … so, you might be the idealcandidate for the role in the Data and Analytics function forGlobal Pet Nutrition (PN) atMars. Pet Nutrition (PN) isthe most vibrant category in the FMCG sector. As we work totransform this exciting category, a new program, Digital First, hasbeen mobilized by the Mars … thought leadership, quality decisionmaking, deep technical know-how, and an ability to navigate complexbusiness challenges while building and leading a team of worldclass data and analyticsleaders. With Digital First,PN is moving to a Product based model to create business facingdigital capabilities. Develop and maintain robust data More ❯

problems as well as ability to think abstractly • Experience with Natural Language Processing: Java or Python, and ML, AI, Labeling, Annotation, Data Pipeline, Big Data, AWS, or Cloud Services • Experience with Computer Vision: Kernel, Hardware Accelerator, TVM, or Code-gen • Experience with Deep Learning: C++ More ❯

are well known for supporting some previous successful unicorns such as Airbnb, Pinterest, Skyscanner and Tesla. What will I be doing? As a Data Specialist (Directories) at Bridebook you will play a major role in the development & maintenance of our venue directories data pipeline. Working closely … responsible for ensuring our users get the most engaging & accurate information while they're using the Bridebook App. You'll be ensuring the data that we transform into our directories is of high quality & is integrated in an efficient manner. Specific responsibilities will include: Monitoring and reporting on … the quality of venue directories & information across global markets. Effective data quality management across both internal & external data sets. Analysing existing directories across regions, identifying gaps & enriching where appropriate. Using your analytical & coding abilities in conjunction with emerging technologies to improve Bridebooks data management More ❯

excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions and work with cross functional teams to design solutions. Above all you should be passionate about bringing large datasets … together to answer business questions and drive change. Key job responsibilities Design automated processes for in-depth analysis Design automated data control processes. Collaborate with the software development team to build and test the designed solutions. Learn, publish, analyze and improve management information dashboards, operational business metrics decks … teams. Participate in annual budgeting and forecasting efforts. Perform monthly variance analysis and identify risks & opportunities. Deliver products that exceed customer satisfaction, ensure data accuracy and completeness, automate manual tasks and develop efficient data pipelines. A day in the life Work with the largest dataset in More ❯

What is Human Native? At Human Native, we're building an AI data marketplace that ensures creators and rights holders are fairly compensated for their work while providing AI developers with high-quality, responsibly licensed training data. We believe in building AI the right way - ensuring transparency, fairness … solve it. The Opportunity As an ML Engineer, you'll help us index, benchmark, and evaluate training datasets at scale. Your expertise with data, AI and ML training methodologies and evaluation techniques will advance the state of the art for developing AI. You will work across: Designing and … developing benchmarks that allow our customers to understand their value of data for training ML (quantifying dataset quality and biases). Deploy these benchmarks by implementing end-to-end data evaluation pipelines to be run on different datasets and ML models. Tools to visualise, analyze, and More ❯

Role: Analytics Engineer/Data Analyst Duration: 3 Months Rolling Rate: £350-400/Day (Outside IR35) Location: Remote (Occasional London Office visits) We are seeking a highly skilled Analytic Engineer/Data Analyst for a 3-month contract position within the wellness industry. This is … a fully remote role with occasional office visits to London as required. The successful candidate will play a key role in a major data migration project focused on redesigning and optimising a Looker instance. This position offers a competitive daily rate of £350-£400 and operates outside IR35. … The ideal candidate will possess a strong background in data analytics, with particular expertise in business intelligence tools and data modelling. You will work closely with other data professionals to ensure a smooth migration and to maximise the performance and usability of the Looker More ❯

Role: Analytics Engineer/Data Analyst Duration: 3 Months Rolling Rate: £350-400/Day (Outside IR35) Location: Remote (Occasional London Office visits) We are seeking a highly skilled Analytic Engineer/Data Analyst for a 3-month contract position within the wellness industry. This is … a fully remote role with occasional office visits to London as required. The successful candidate will play a key role in a major data migration project focused on redesigning and optimising a Looker instance. This position offers a competitive daily rate of £350-£400 and operates outside IR35. … The ideal candidate will possess a strong background in data analytics, with particular expertise in business intelligence tools and data modelling. You will work closely with other data professionals to ensure a smooth migration and to maximise the performance and usability of the Looker More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … timely andaccurate delivery of data products that meet business needs andqualitystandards. DataOpsand Optimisation: Implement DataOpspractices to streamline dataengineering workflows andimprove operationalefficiency. Automate datapipeline deployment and monitoring using CI/CDtools. TechnicalLeadership: Providetechnical leadership and guidance on data engineering bestpractices. Stay informedabout industry trends and emerging technologies … policies, procedures and standards.Implement best practices for data management, security, andcompliance. Promote data quality and integrity across all dataproducts. Monitor datapipeline performance and optimise for scalability, reliability, andspeed. StakeholderEngagement: Collaboratewith PN D&A leadership, PN product owners, and segment D&Aleadership to synchronise and formulate data More ❯

Senior GCP Data Engineer Start: ASAP Duration: initial 12-month contract Pay: inside IR35, negotiable Location: central London (3-days per week in office) We are looking for a Senior GCP Data Engineer to join its Cyber Security team on a contract basis. You'll be … responsible for delivering high-quality data engineering solutions using Google Cloud Platform, supporting large-scale data ingestion, transformation, and integration projects. Key Responsibilities: - Build and maintain APIs and backend systems - Develop and optimise GCP-based data pipelines (BigQuery, DataFlow, Composer) - Design scalable data models and cloud data lakes - Integrate data from cloud and on-prem sources - Automate infrastructure with Terraform and CI/CD tools - Collaborate with product teams to deliver business value Requirements: - 8+ years in data engineering, with strong GCP expertise - Proficient in More ❯

consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data & analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll … visits based on the needs. Handle customer escalations and facilitate any patches or fixes as needed to resolve any issues relating to their data platform. Investigate issues in and maintain data models to support analytics and reporting. Monitor and maintain data infrastructure to ensure … availability, correctness and performance. Perform regular checks to ensure data pipelines and ML models are working correctly. You'll collaborate with the customer on a quarterly basis to ensure all requirements continue to be met. Scope and plan implementation of any customer changes/requirements. Maintain automated data More ❯

gen labour automation unit, providing highly efficient services across various use cases, starting with industrial applications. We are looking for Senior/Lead Data Engineer to join our team based in London, UK. Our Mission At Humanoid we strive to create the world’s leading, commercially scalable, safe … manage large datasets used for training humanoid robots — projected to reach hundreds of terabytes by 2025. Ensure the quality, accuracy, and consistency of data across multiple projects. Collaborate with machine learning teams to design data pipelines that support efficient training workflows. Develop and maintain data quality metrics reporting systems. Implement best practices for data management, including versioning, security, and compliance. Expertise Bachelor’s or Master’s degree in Data Science, Computer Science, or a related field. 5+ years of experience in data engineering and data More ❯

We are currently recruiting for a Data Engineer with hands-on experience of Azure and Insurance experience to join one of our Global Insurance Clients on a 6-month contract. Please note, this role is Inside IR35 with travel to London 1 day a week (Mondays). Key … Responsibilities: Design, build, and maintain robust data pipelines to curate and ingest data efficiently. Work with Azure cloud services to deploy and manage scalable data solutions. Implement and maintain CI/CD pipelines for seamless data workflows. Collaborate with cross-functional teams … to ensure data integrity, security, and accessibility. Key Skills & Experience: Strong programming skills in Python (PySpark). Hands-on experience with Azure Data Services (Azure Data Factory, Databricks, Synapse, Data Lakes, etc.). Experience with CI/CD pipelines for release management. More ❯

is pivotal in you owning the Databricks strategy and how it's used to innovate across their brands. You'll design and develop data frameworks, power real-time data pipelines, and create data services that deliver actionable insights to their customer base. You will … and leveraged to maximize value. You'll also own and be responsible for all Databricks-related activities, acting as the architect across the Data Engineering, Data Analytics, and Data Science teams. Your Profile A background in data architecture Experience of unity catalogue More ❯

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯