101 to 125 of 460 Data Pipeline Jobs in London

p/day Hybrid working: 3 days in the office (City of London) The BA will: Gather and document business requirements for the Data Analytics & Reporting platform. Identify and resolve data-related issues and concerns by working directly with business teams. Capture and define data lineage, ensuring clear understanding of data flow from ingestion to reporting. Design and optimize data pipelines to ensure efficient data processing and analysis. Collaborate with technical teams to ensure proper data remediation and data quality. Utilise tools like … Knowledge & Experience Banking experience preferred. Expert in investigating manual processes and identifying opportunities for automation Knowledge of cloud environments (GCP) Strong understanding of data management, data governance, data analytics, MIS reporting and business intelligence concepts. Knowledge of SQL for data manipulation and More ❯

Moody's Insurance Solutions Graduate Program, you'll work with the people, teams, and companies leading the way in the use of models, data, analytics, and technology to derive relevant insights across the insurance lifecycle. Our insurance customers use our models, data, analytics, and technology to … are crucial to our future, and we are committed to supporting yours as well. Skills and Competencies: Applied experience collecting, processing, and using data to solve a problem or answer a question. Working knowledge of a computer programming language (examples include SQL, R/tidyverse, Python, Microsoft Excel … domain/catastrophe modeling, Database management/working with relational databases (SQL), Moody's RMS products (e.g. RiskLink, Risk Modeler, Intelligent Risk Platform), Data engineering, data analytics, data science, using a programming language, Collaborative code development using version control software (e.g., GitHub), Kubernetes. Education More ❯

systems and tools to identify and reduce supply chain defects in our systems and inputs, while driving operational leverage and scaling. As a Data Engineer, you will analyze large-scale business data, solve real-world problems, and develop metrics and business cases to delight our customers … worldwide. You will work closely with Scientists, Engineers, and Product Managers to build scalable, high-impact products, architect data pipelines, and transform data into actionable insights to manage business at scale. We are looking for people who are motivated by thinking big, moving fast, and exploring … tech teams and build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark. Monitor and improve data pipeline performance, ensuring low latency and high availability. Automate repetitive data engineering tasks to streamline workflows and improve efficiency. About the team Supply More ❯

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, with good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients is looking for a Senior Data Engineer to join the team on a long-term … programme of work. Key Responsibilities: Develop, optimize, and maintain ETL pipelines for efficient data extraction, transformation, and loading from various sources, ensuring high data quality. Monitor and troubleshoot production data pipelines to ensure performance and reliability. Mentor junior engineers and lead technical discussions to … promote best practices and innovation. Stay updated with the latest data engineering trends and technologies, recommending improvements for data processing capabilities. Write and optimize SQL queries to ensure data integrity, performance, and scalability. Implement a flexible Data Vault model in Snowflake to More ❯

Data Production Engineer Location: London, United Kingdom Salary: Competitive + Excellent Benefits Our client, a leading global trading firm, is seeking a talented Data Production Engineer to join their highly collaborative Data team. Data is central to their success, powering one of … the unique opportunity to work directly with live trading teams, automate processes, explore vast datasets, and engage with key external stakeholders such as data vendors, brokers, and exchanges. You'll play a hands-on role in acquiring, validating, and preparing data that feeds cutting-edge quantitative … Comfortable using the Linux command line for file manipulation, automation, and system monitoring. Experience with financial datasets (e.g. Refinitiv, S&P, Bloomberg) and ETL pipeline management is highly desirable. Prior exposure to supporting systems in a production trading environment is a strong advantage. Why Apply? You'll join a More ❯

Data Production Engineer Location: London, United Kingdom Salary: Competitive + Excellent Benefits Our client, a leading global trading firm, is seeking a talented Data Production Engineer to join their highly collaborative Data team. Data is central to their success, powering one of … the unique opportunity to work directly with live trading teams, automate processes, explore vast datasets, and engage with key external stakeholders such as data vendors, brokers, and exchanges. You'll play a hands-on role in acquiring, validating, and preparing data that feeds cutting-edge quantitative … Comfortable using the Linux command line for file manipulation, automation, and system monitoring. Experience with financial datasets (e.g. Refinitiv, S&P, Bloomberg) and ETL pipeline management is highly desirable. Prior exposure to supporting systems in a production trading environment is a strong advantage. Why Apply? You'll join a More ❯

Data Engineer - Join One of the UK's Most Exciting Tech Start-ups Location: London (Hybrid) Salary: £40,000-£65,000 + Equity Our client, one of the UK's fastest-growing and most exciting tech start-ups, is looking for a talented Data Engineer to … align data strategies with app development Work with internal stakeholders to shape and meet business data needs Maintain documentation, monitor pipeline performance, and resolve issues as they arise About You Strong problem-solving skills, demonstrated through academic or professional experience In-depth understanding of data … processing frameworks such as Airflow, TensorFlow, or Spark is advantageous Willingness to gain working knowledge of backend development (e.g., Python with Django) for pipeline integration Familiarity with data versioning, quality management, and CI/CD pipelines Experience with cloud platforms (e.g., AWS or Azure) and data More ❯

We use advance techniques to prevent erroneous payments and to protect Amazon shareholders. We are seeking a BIE to support our automation and data needs. The ideal candidate thrives in a fast-paced environment, relishes working with large transactional volumes and big datasets, and is passionate about data … to mid-size BI solutions or components of larger solutions. Their primary sphere of influence extends within their immediate team, where they deliver data-driven solutions that directly inform team business decisions. The core technical requirements demand proficiency in SQL and data manipulation, along with the … Python, Java, or R). PREFERRED QUALIFICATIONS - Master's degree, or Advanced technical degree. - Knowledge of data modeling and data pipeline design. - Experience with statistical analysis, co-relation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

to Move to Skip to Content Link Select how often (in days) to receive an alert: The job you're considering The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest … back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service) Your role We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest More ❯

London should be possible for everyone in our team. The role We are looking for a Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle … to advance the Trudenty Trust Network. A bit more on what you'll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle … Develop and maintain ETL processes for data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced machine learning algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

Overview: 3 contract data engineers to supplement existing team during implementation phase of new data platform. Main Duties and Responsibilities: Write clean and testable code using PySpark and SparkSQL scripting languages, to enable our customer data products and business applications. Build and manage data … a structured, trackable and safe manner. Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain. Data Analyse, profile and plan work, aligned with project priorities. Perform reviews of code, refactoring where necessary. Deploy code in a structured, trackable and safe … agile framework at Chambers. Skills and Experience: Excellent understanding of Data Lakehouse architecture built on ADLS. Excellent understanding of data pipeline architectures using ADF and Databricks. Excellent coding skills in PySpark and SQL. Excellent technical governance experience such as version control and CI/CD. More ❯

Data Engineer – Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … the client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions … data from legacy systems into modern infrastructure, reporting and analytics. The key responsibilities for the post include; Design and develop a modern data warehouse (Azure or Snowflake), capable of ingesting data from multiple sources and that can store and organise large volumes of data. More ❯

What you'll be doing: We are seeking an experienced and visionary Head of Data Engineering to lead our dynamic Data Engineering Team. The successful candidate will oversee a team of approximately 40 Data Engineers, ensuring the delivery of high-quality data solutions and driving the strategic direction of our Data Engineering efforts. Key Responsibilities: Lead and manage a team of 40 Data Engineers, providing mentorship, guidance, and career development. Develop and implement data engineering strategies that align with the company's goals and … objectives. Oversee the design, development, and maintenance of scalable data pipelines and architectures. Collaborate with cross-functional teams, including data scientists, analysts, and IT, to ensure seamless data integration and utilization. Ensure data quality, integrity, and security across all data More ❯

Business Intelligence Engineer, Amazon Fresh DESCRIPTION Do you enjoy transforming data into actionable insights and taking a data-driven approach to solving complex business problems? Amazon Fresh is looking for a pro-active Business Intelligence Engineer with strong technical and analytical skills. We are currently looking … in automation and robotics projects. Develop complex queries for ad-hoc requests and projects, as well as ongoing reporting. Deep dive into large data sets to answer key business questions using SQL, Excel, and other data manipulation languages. Maintain data integrity, perform QA Audits …/BI space. PREFERRED QUALIFICATIONS Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central More ❯

Business Intelligence Engineer (In Stock), Amazon Fresh Job ID: Amazon EU SARL (UK Branch) Do you enjoy transforming data into actionable insights and taking a data-driven approach to solving complex business problems? Amazon Fresh is looking for a pro-active Business Intelligence Engineer with strong … in automation and robotics projects. Develop complex queries for ad-hoc requests and projects, as well as ongoing reporting. Deep dive into large data sets to answer key business questions using SQL, Excel, and other data manipulation languages. Maintain data integrity, perform QA Audits …/BI space. PREFERRED QUALIFICATIONS Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central More ❯

Information Security. The role: This role sits within the Group Enterprise Systems (GES) Technology team. The right candidate would be an experienced Microsoft data warehouse developer (SQL Server, SSIS, SSAS) who can work both independently and as a member of a team to deliver enterprise-class data … platforms. This role will primarily involve working on Actuarial Reserving systems change initiatives and Production support. What you'll be doing as a Data Warehouse Developer: Work closely with internal and external delivery teams, external vendors, infrastructure, and 3rd party application teams to uphold and evolve common standards. … Collaborate with data modellers and data analysts to implement and produce data models. Build and maintain automated pipelines to support data solutions across BI and analytics use cases. Work with Enterprise-grade technology, primarily SQL Server 2019 and potentially Azure technologies. Build More ❯

Business Intelligence Engineer (In Stock), Amazon Fresh Do you enjoy transforming data into actionable insights and taking a data-driven approach to solving complex business problems? Amazon Fresh is looking for a pro-active Business Intelligence Engineer with strong technical and analytical skills. We are currently … in automation and robotics projects. Develop complex queries for ad-hoc requests and projects, as well as ongoing reporting. Deep dive into large data sets to answer key business questions using SQL, Excel, and other data manipulation languages. Maintain data integrity, perform QA Audits …/BI space. PREFERRED QUALIFICATIONS: Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central More ❯

Job Title: Senior Data Analyst Location: Wembley Position Type: Full-time About Flannery Plant Hire: Flannery Plant Hire is a leading provider of plant hire and specialist attachments to the construction industry across the UK and Ireland. With a comprehensive fleet of innovative machinery, we pride ourselves on … delivering exceptional customer service and meeting our clients' project requirements. Job Description: We are looking for a skilled and experienced Senior Data Analyst to join our team, as we expand on our data and analytics space, to fully exploit our data and help drive … data-driven decision-making. This role requires a hands-on approach to data analytics, working across multiple stakeholders and managing complex datasets to provide valuable insights. Key Responsibilities Develop and maintain dashboards and reports in Power BI to support business needs. Write and optimize SQL queries More ❯

product operating model, involving strategic programmes to deliver innovative technology and business solutions supporting our global growth. ASOS recognizes the transformative potential of data and technology in driving business success. The Digital Data Engineering team provides high-quality, scalable data solutions across the ASOS … Digital Domain, promoting best practices, modern technologies, and team education. As a Data Engineer, you will be hands-on with critical projects, enabling digital platforms to leverage data effectively while ensuring continuous improvement, adherence to best practices, and team development through pairing. You will have the … opportunity to solve problems and innovate across various ASOS Data engineering projects. What you'll be doing: Develop solutions using Microsoft Azure and Databricks: Prioritize simplicity and maintainability, ensure thorough testing, automate deployments, and implement appropriate monitoring. Optimize Data pipelines, frameworks, and systems: Facilitate easier development More ❯

Data Engineer - Consultancy - Up to £600 per day (Inside IR35) - 6 Month Contract - Remote Overview: Join a leading consultancy, delivering innovative data-driven solutions for global clients. You'll play a key role in developing and supporting enterprise-grade data platforms and services, ensuring … high-quality data pipelines and enabling smarter business decision-making. Key Responsibilities: Design and develop homogenous data repositories for enterprise reporting and analytics. Ingest data from SQL databases, REST APIs, Kafka streams and other sources. Apply data cleansing rules to ensure high … data quality standards. Model data into a single source of truth using Kimball methodology (star schema, snowflake, etc.). Develop high-quality code following DevOps and software engineering best practices, including testing and CI/CD. Monitor and maintain business-critical pipelines, reacting to and resolving More ❯

Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We're recruiting on behalf of a leading fashion brand based in London that's recognised for combining creativity with cutting-edge technology. They're … on the lookout for a talented Data Engineer to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across the business. The Role As a Data Engineer, you'll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You'll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately More ❯

experience by taking appropriate course corrections based on the recommendations made by our systems. The BIE plays a crucial role, building and analyzing data systems, spotting important business patterns, creating metrics that measure success, and developing ways to validate findings. The BIE will work closely with the Transportation … for the business. Key job responsibilities Manage and execute entire projects or components of large projects from start to finish, including project management, data gathering and manipulation, synthesis and modeling, problem-solving, and communication of insights and recommendations. Contribute to the design, implementation, and delivery of complex BI … Python, Java, or R). PREFERRED QUALIFICATIONS Master's degree or advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis and correlation analysis. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Data Pipeline Technology Engineering team, you will have the opportunity to significantly influence your career trajectory and embark on a journey where you can redefine the … boundaries of possibility. You will be instrumental in the development of our data pipeline applications on AWS, working closely with business and product teams to create robust data transformation (ETL) functionalities that cater to intricate business requirements. Your proficiency will steer our shift to the … make custom configuration changes in one to two tools to generate a product at the business or customer request. Update logical or physical data models based on new use cases. Produce architecture and design artifacts for complex applications while ensuring design constraints are met by software code development. More ❯

Data Solutions Architect Hybrid - Inside IR35 We're looking for a seasoned Data Solutions Architect with deep expertise in the Lloyd's of London Market and a strong background in Snowflake and ETL/data transformation tools. As a Data Architect, you … ll lead the design, development, and deployment of enterprise-grade data architecture using Snowflake and a modern suite of data tools. You'll work at the intersection of IT and business, collaborating closely with stakeholders to create solutions that unlock the full value of data-driving decision-making and business growth across the organisation. Key Responsibilities Architecture Design: Design and maintain enterprise data architecture models, data flows, and integrations using Snowflake. Data Governance: Manage data collection, storage, transformation, and protection across systems. Database Development: Create More ❯