201 to 225 of 1,521 Data Pipeline Jobs in London

able to work extremely effectively in a matrix organization, and have the ability to break complex problems down into steps that drive programs. Key job responsibilities - Perform deep data analysis, document findings and insights, and communicate to business stakeholders. - Empower technical and non-technical internal customers to self-serve data pull and data analysis … needs. - Be the expert on the data used and generated by the team's products. Act as Subject Matter Expert when it comes to data questions. - Derive insights from data; Synthesize data into succinct narrative and bridges to enable business and leadership to make investment and strategy decisions - Develop and automate market … tools such as Quick Sight, Tableau, Power BI or other BI packages - Fluency in SQL and ETL PREFERRED QUALIFICATIONS - Knowledge of data modeling and data pipeline design - Masters degree in Business, Engineering, Statistics, Computer Science, Data Science, Mathematics or related field - Experience with at least one statistical programming language such as Python working More ❯

We do this by providing client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with expertise in Azure and Power … BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we’d love to hear from you. Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus on data manipulation and engineering. A genuine interest in data science and a drive to expand your skillset More ❯

We do this by providing client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with expertise in Azure and Power … BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we’d love to hear from you. Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus on data manipulation and engineering. A genuine interest in data science and a drive to expand your skillset More ❯

performing, and secure. Key Responsibilities Depending on your experience level, your role will include: Senior Developer Collaborate with traders and researchers to build high-performance trading systems Design data pipelines and ingest financial data from diverse sources Build monitoring and dashboard tools for real-time system health Increase test coverage and automate build/deployment workflows …/or Python) Strong background in hedge fund, asset management, or financial markets Solid DevOps skills: CI/CD, containerisation, source control (e.g. Git) ETL experience with financial data (including tick data) SQL and database systems knowledge Familiarity with cloud (Azure ideal, others acceptable) Excellent communication skills - confident with stakeholders and leadership What You'll Get … are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-notice. LNKD1_UKTJ Seniority level Seniority level Mid-Senior level Employment type Employment type Temporary Job function Job function Engineering and Information More ❯

Lloyd's (Syndicate 1856) underwriting a diverse range of Property, Commercial and Speciality (re)insurance products from Cargo and Marine to Political Violence, Terror and War. We combine data, intelligent automation and human expertise to make smart decisions, fast. ERS is the UK's largest specialist motor insurer with an A+ rating. We recognise that for some, motor … leader within the pricing function. Key responsibilities Technical Pricing Infrastructure & Capability Building: Architect and implement a state-of-the-art pricing technology platform for syndicate 1856 Design scalable data pipelines and analytical frameworks to support complex pricing models Collaborate closely with IT teams to deliver robust, automated pricing solutions Establish technical standards and best practices for pricing model … reporting capabilities Design calculation engines for Risk Prices and Market prices with flexible loadings Build bespoke analytical tools to support underwriting decision-making Cross-Functional Collaboration: Partner with Data teams to ensure optimal data architecture and quality Work closely with Divisional Actuaries to share insights and align methodologies Collaborate with underwriters to translate business requirements into More ❯

Data Lead Senior Data Engineer/Scientist Judge.me Role: Data Lead Senior Data Engineer/Scientist Location: Remote with hybrid option (2 days in Shoreditch office near Old Street) Salary: £90-115k (includes comprehensive benefits package) Our Mission: Fixing Trust in Commerce For a decade, we've been on a mission … buyer reviews Organic Growth : We've achieved 40% year-over-year growth purely through word of mouth-no paid marketing or sales teams needed The Opportunity As our Data Lead, you'll lead the development of our Trust Optimisation Platform-a critical initiative to unlock insights from our vast review dataset to help merchants improve their e-commerce … infrastructure to transform review data into actionable merchant insights NLP/ML Development : Create models that analyse review content, identify trust patterns, and establish merchant benchmarks Pipeline Architecture : Build scalable systems that efficiently process our extensive review and merchant data Cross-Functional Collaboration : Work with product and design teams to translate data More ❯

Senior Data Engineer London (Hybrid) We are Manufacturing the Future! Geomiq is revolutionizing traditional manufacturing by providing engineers worldwide with instant access to reliable production methods through our digital platform. As the UK's leading Digital Manufacturing Marketplace, we offer an AI-powered B2B MaaS (Manufacturing as a Service) solution, seamlessly connecting buyers and suppliers to drive efficiency … Engineers, and Procurement teams, all of whom are involved in creating the world's most innovative products. See our platform in action! About the role: As a Senior Data Engineer at Geomiq, you will play a central role in shaping our data infrastructure and operations. Your primary focus will be on establishing a robust foundation that … between systems Experience with Google Cloud Platform (GCP) is highly preferred.(Experience with other cloud platforms like AWS, Azure can be considered.) Familiarity with data pipeline scheduling tools like Apache Airflow Ability to design, build, and maintain data pipelines for efficient data flow and processing Understanding of data warehousing More ❯

We are seeking an experienced and dynamic Data Engineer to join our team. This critical role will focus on designing and implementing automated data solutions, driving operational efficiency, and enhancing data scalability across the organization. The ideal candidate will possess a deep understanding of data engineering principles, experience in developing flexible and … scalable data frameworks, and a commitment to best practices in data management. Location : London, UK Key Responsibilities: Collaborate with stakeholders to devise solutions and designs for upcoming projects associated with EMEA/LATAM regions and any 360 expansion initiatives. Evaluate project requirements and develop architecture designs that support the specific needs of these regions and expansion … ecosystem. Develop optimized automated data pipelines and workflows to streamline data integration, transformation, and availability. Ensure efficient monitoring and notification systems for data pipeline success or failure to enhance operational efficiency. Sourcing data from multiple applications, profiling, cleansing and conforming to create master data sets for analytics use. Create More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so we can provide the More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK Our AWS Professional Services consultants deliver IT infrastructure and application architecture guidance, lead proof-of-concept projects, perform enterprise portfolio assessments, review operational best practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners to address security … and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking for technical architects to collaborate with our customers and partners on key engagements, while helping our … tuning skills using Unix profiling tools and SQL - Experience leading large-scale data warehousing and analytics projects, including using AWS technologies - Redshift, S3, EC2, Data-pipeline and other big data technologies - Linux/UNIX including to process large data sets. Our inclusive culture empowers Amazonians to deliver the best results for More ❯

FULLY REMOTE DATA ENGINEER POSITION: UK BASED APPLICANTS ONLY/WE DO NOT PROVIDE VISAS Talent Hero is a speed and quality driven recruiting agency, dedicated to placing the best UK GB remote professionals in remote positions in U.S.A US businesses . Candidates who apply through Talent Hero, once vetted, we contact hundreds of USA businesses to place … you in a role with the right pay and responsibilities. And you stay in our data base for when you look for a job in the future! This role is an excellent opportunity for skilled professionals who are keen to make a substantial impact in a rapidly evolving environment. If you possess a strong background in data … a rare opportunity to turn down. You will have the chance to work on diverse projects, collaborate with talented individuals, and play a key role in ensuring that data-driven objectives are accomplished. We are looking for Data Engineers who value creativity, problem-solving, and a commitment to excellence. Responsibilities Design, develop, and maintain scalable data More ❯

Data Product Owner 📍 London (Hybrid: 2 days remote per week) 💼 Permanent | Excellent salary & benefits package 🚀 Own the data. Drive the insight. We’re partnering with a major UK organisation to recruit a Data Product Owner who will play a key role in building out their enterprise data capabilities — enabling better customer experiences, advanced analytics … and insight-led decision making across the business. This is a hands-on role with huge scope: you’ll work across data platforms, engineering, governance, and business teams to deliver data products that drive measurable outcomes. The Role Lead the development of data platforms: data warehouses, lakes, CDPs, analytics solutions. Act as … the central link between business, data science, engineering, and governance functions. Manage the data product backlog, translating requirements into deliverable features. Oversee data pipelines, modelling, ETL/ELT processes, APIs, and cloud data platforms. Ensure data quality, governance, compliance and regulatory standards (GDPR, CCPA). Use BI and analytics platforms More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python - it's for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. … particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). More ❯

Source Greater London, England, United Kingdom Data Engineer ML and AI Source Greater London, England, United Kingdom Direct message the job poster from Source Source helps professional services firms understand what really matters when facing decisions of vital importance. We provide insights and resources to enable firms to make informed and strategic choices in critical situations. Our focus … is on delivering valuable and actionable intelligence to help businesses achieve their objectives. Role Description Join our innovative team at Source as a Data Engineer specialising in Machine Learning and AI. This critical role offers an exciting opportunity to help drive the technical direction and implementation of our ML/AI data engineering initiatives, transforming our … existing data pipelines and qualitative/quantitative data into AI-ready and machine learning augmented assets. You will work closely with our Senior Data Engineer and the Head of Technology, to design, build, and maintain robust and scalable data infrastructure. You will assist in preparing our data for advanced analytics More ❯

Social network you want to login/join with: Data Engineer – Private Capital | London | Hybrid, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: We are supporting a fast … growing, high-performing investment firm as they expand their lean, agile technology team. This newly created role sits at the intersection of data engineering and business intelligence — offering real ownership, front-to-back exposure, and close interaction with the business. The team is small, collaborative, and strategically embedded within the firm’s data-driven decision-making … opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist with modernising and automating More ❯

can research and purchase anything they might want online. We set big goals and are looking for people who can help us reach and exceed them. The CPT Data Engineering & Analytics (DEA) team builds and maintains critical data infrastructure that enhances seller experience and protects the privacy of Amazon business partners throughout their lifecycle. We are … looking for a strong Data Engineer to join our team. The Data Engineer I will work with well-defined requirements to develop and maintain data pipelines that help internal teams gather required insights for business decisions timely and accurately. You will collaborate with a team of Data Scientists, Business Analysts and other … Engineers to build solutions that reduce investigation defects and assess the health of our Operations business while ensuring data quality and regulatory compliance. The ideal candidate must be passionate about building reliable data infrastructure, detail-oriented, and driven to help protect Amazon's customers and business partners. They will be an individual contributor who works effectively More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary More ❯

clients to answer crucial questions, such as how to target audiences, maximise attention across platforms, enhance audience experience, and demonstrate or increase audience value. We are recruiting a Data Engineer for one of our flagship accounts, Out Of Home – Route. Your work will be essential for the Route project's success. Building robust and scalable infrastructure and being … the linchpin between the data platform and data science teams in an ‘advisory-like’ role will enable data scientists to focus on research and innovation in synthetic data, enhancing data-driven solutions for clients and Ipsos. You will often support the productionisation and scaling of local ML models, guiding the … data science teams and providing the guardrails as they develop and iterate. What will I be doing? As a Data Engineer on the ground-breaking Route project, you'll develop and maintain the data infrastructure for a first-of-its-kind synthetic travel survey, generating audience figures for Out-of-Home media in Great More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary More ❯

Contract Opportunity: Senior AWS Machine Learning Data Engineer Location: London | Duration: 6 Months (Extension Possible) | Start Date: ASAP Rate: Up to £600 a day (Inisde IR35) Are you a cloud-native data engineer with a passion for building intelligent systems? I'm looking for a Senior AWS Machine Learning Data Engineer to a cutting … edge team on a contract basis, working on high-impact ML solutions that scale. About the Role: In this role, you'll lead the design and implementation of data pipelines and ML infrastructure on AWS. You'll collaborate with data scientists, architects, and product teams to deliver production-grade ML systems across a variety of domains … from predictive analytics to real-time personalization. ? What You'll Do: Architect and build scalable, secure, and maintainable data pipelines on AWS (Glue, Lambda, Step Functions, S3, Redshift, etc.) Operationalize machine learning models in production environments using SageMaker or custom deployment frameworks Automate and optimize ETL/ELT processes for structured and unstructured data Integrate CI More ❯

About The Role Are you ready to kickstart your career in data engineering? At Arco, the UK's leading integrated health and safety experts, we're on the lookout for a passionate and driven Junior Data Engineer to join our dynamic Data & Analytics team. This is your chance to grow, learn, and make a … real impact in a fast-paced, data-driven environment. As a Junior Data Engineer, you'll play a key role in designing, developing, and maintaining scalable and reliable data pipelines and infrastructure. Working closely with senior engineers and cross-functional teams, you'll help deliver clean, accessible, and high-quality data that … drives critical business decisions. This is the perfect opportunity for someone with a foundational understanding of data engineering concepts who's eager to take their skills to the next level. Key responsibilities include: Assisting in the development and maintenance of data pipelines for collecting, transforming, and storing data from multiple sources. Supporting data More ❯

Senior Data Analyst – Real Estate Investment Firm 📍 London, UK (Hybrid – 3 days in office) 🕒 Full-time | Real Estate Investment Firm 💰 Salary: Up to £60,000 per year + benefits Are you passionate about transforming complex data into meaningful insights that drive global strategy? A leading real estate investment firm is looking for a Senior Data Analyst to join their Global Programs team and play a key role in delivering data-driven solutions across international operations. 🔍 What You’ll Do: Design and deliver enterprise, regional, and local dashboards and reporting tools Uncover actionable insights from operational data through advanced analytics and storytelling Collaborate across departments (Tech, Finance, Operations) to improve … data infrastructure Build and automate data pipelines for cross-functional business reporting Ensure data quality, compliance, and adherence to governance standards Support and execute data migrations within ERP systems as part of transformation and integration projects 🧠 What You Bring: 5+ years of experience in data analytics or reporting Strong skills More ❯

Senior Data Analyst – Real Estate Investment Firm 📍 London, UK (Hybrid – 3 days in office) 🕒 Full-time | Real Estate Investment Firm 💰 Salary: Up to £60,000 per year + benefits Are you passionate about transforming complex data into meaningful insights that drive global strategy? A leading real estate investment firm is looking for a Senior Data Analyst to join their Global Programs team and play a key role in delivering data-driven solutions across international operations. 🔍 What You’ll Do: Design and deliver enterprise, regional, and local dashboards and reporting tools Uncover actionable insights from operational data through advanced analytics and storytelling Collaborate across departments (Tech, Finance, Operations) to improve … data infrastructure Build and automate data pipelines for cross-functional business reporting Ensure data quality, compliance, and adherence to governance standards Support and execute data migrations within ERP systems as part of transformation and integration projects 🧠 What You Bring: 5+ years of experience in data analytics or reporting Strong skills More ❯

continue to direct the firm's day-to-day operations. Purpose of Position Pantheon is undergoing a multi-year programme to build out a new best in class Data Platform using cloud native technologies hosted in Azure. We require an experienced and passionate hands-on Senior Data Engineer to design and implement new data pipelines for adaption to business and/or technology changes. This role will be integral to the success of this programme and establishing Pantheon as a data-centric organisation. You will be working with a modern Azure tech stack and proven experience of ingesting and transforming data from a variety of internal and external … Azure Powershell/CLI Azure Key Vault ARM/Terraform scripts to deploy infrastructure services. Essential Experience Experience in designing and building data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant More ❯

Job Description: Core-Asset Consulting is delighted to be partnering with a highly respected financial service firm to recruit a Data Engineer for a permanent position based in Newcastle.This is a fantastic opportunity to join an organisation with a clear commitment to innovation and insight-led decision-making. As a Data Engineer, you will play a … critical role in transforming complex operational data into meaningful insights.Working across analytics, data science, and development teams, you will design and implement robust data pipelines, optimise data models, and ensure high-quality, reliable outputs that drive strategic business decisions. Essential Skills/Experience: Strong proficiency in T-SQL and experience developing complex … queries and procedures. Expertise in Spark and PySpark for scalable data processing. Solid understanding of OLTP and OLAP architectures and data modelling principles. Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage. Sound knowledge of ETL/ELT best practices. Strong analytical and More ❯