Data Pipeline Jobs in London

76 to 100 of 186 Data Pipeline Jobs in London

Lead Data Engineer

London Area, United Kingdom
Tredence Inc
About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project more »
Posted:

Head of Business Intelligence

London Area, United Kingdom
The React Hub
Title: Head of Business Intelligence and Analytics Company Description: A leading company in the property sector with a strong focus on innovation and data driven decision making seeks a highly experienced professional to lead its Business Intelligence and Analytics team. Job Summary: We are searching for a talented … to spearhead our Business Intelligence and Analytics team. You will play a pivotal role in driving organizational growth and development by transforming raw data into actionable insights that inform strategic decision-making across various departments. Responsibilities: In this role, you'll find yourself equally split between hands-on … team with 50% devoted to hands-on tasks and 50% to management and leadership responsibilities' Oversee the construction and maintenance of a central data repository, ensuring alignment with organizational needs and data strategy. Collaborate with the data engineering team to gather and transform data more »
Posted:

Azure Data Platform Engineer - Fixed Term Contract

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Data Engineer - Azure Databricks - Fixed Term Contract

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
Xcede
LEAD DATA ENGINEER London x2 days a month in office OVERVIEW Xcede are delighted to be partnered with one of the UK's most impactful HealthTech brands. The organisation have won numerous awards for their data-led approach to designing an impactful B2C product that has … entirely disrupted their domain and outperformed their competitors. With a well-established analytics, data science, and data engineering function already in place, the team is looking for a Lead Data Engineer to come in act primarily as a Principal IC while also helping with … management of junior engineers (we'd like to see some experience of this). RESPONSIBILITIES Manage and assist a team of data engineers. Design and continue to build essential data infrastructure for the organisation alongside data pipelines & ETLs. Collaborate with data scientists more »
Posted:

Lead Data Engineer

London Area, United Kingdom
FullCircl
since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »
Posted:

Data Scientist - Lead Generation & Prospecting

London, United Kingdom
LHH Recruitment
Data Scientist - Lead Generation & Prospecting Contract Role - Inside IR35 via umbrella Our client, a London based Financial Services/Payements Solutions provider is seeking a Data Scientist to join the team on contract with experience within new business/prospecting - Please only aply if you have … demonstrable experience in these areas. Responsibilities: Utilise advanced data analytics and machine learning techniques to identify high-value prospects and generate leads in the payments industry. Design and implement propensity models to predict potential client engagement and conversion rates, optimising our prospecting strategies. Analyse transactional and financial data … or Master's degree in Statistics, Mathematics, Computer Science, Finance, or a related field. Experience working with Salesforce from a data/pipeline management perspective along with Snowflake Data Connectors a plus. If you are a results-oriented Data Scientist with a passion more »
Employment Type: Contract
Rate: £450 - £500/day Paid via umbrella
Posted:

Senior AWS Data Engineer

London Area, United Kingdom
Xcede
Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Burns Sheehan
Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data pipelines, ensure data quality, and automate reporting processes. Your work will support decision-making and contribute to strategic goals, making a significant impact across the company. What you'll be doing... You will gather data from various departments and tools, integrating it into a more »
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support … further growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain … support and expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise more »
Posted:

Head of BI and Analytics

London, United Kingdom
Hays
I am currently working with a leading real estate company based in London. They are committed to leveraging data-driven insights to enhance our decision-making processes and drive business growth. As the Head of Business Intelligence and Analytics, you will play a pivotal role in shaping our … data strategy, driving actionable insights, and optimising our business operations. You’ll lead a team of talented analysts and collaborate closely with cross-functional stakeholders to ensure data-driven excellence across the organisation. Responsibilities:Develop and execute the company’s BI and analytics roadmap, aligning with … strategic goals.Lead the design, implementation, and maintenance of data pipelines, data warehouses, and reporting solutions.Manage a team of BI analysts, data engineers, and data scientists.Collaborate with business leaders to identify key performance indicators (KPIs) and create dashboards and visualisations usingPower BI.Utilise SQL more »
Salary: £ 80 K
Posted:

Data Team Lead

London Area, United Kingdom
InterEx Group
About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will more »
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding … existing data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from … must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
DATAHEAD
Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's … offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the more »
Posted:

Senior BI Developer - London - £75,000

London, United Kingdom
Nigel Frank International
I am working with a hugely successful, global organisation who are looking to add a Senior BI Developer to their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure Stack including leveraging Databricks in order … to deliver on its goal of becoming truly data driven. In this role you will be responsible for the BI and data engineering lifecycle across the business supporting the global data needs of various business functions. This role is a split between data engineering and data analytics and you will take a prominent role on a number of exciting projects. You will be joining a business that values its people at the centre of everything they do. They are looking to expand their close-knit data team more »
Employment Type: Permanent
Salary: £65000 - £75000/annum
Posted:

Developer (Python & Azure)

London Area, United Kingdom
Mastek
be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »
Posted:

Senior Cloud Data Engineer – Snowflake / Azure

London Area, United Kingdom
OFS
A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting more »
Posted:

Product Analytics Lead

London, United Kingdom
Checkout.com
analytics for one of Checkout.com’s product verticals, collaborating closely with a cross-functional leadership group. You'll manage a squad of Product Data Scientists and Analytics Engineers and own end-to-end analytics delivery, from how we instrument the data to delivering data … basis for setting our company objectives. As a leader in this group, you'll have a wider support network of Analytics Engineers, Product Data Scientists, and Data Product Managers.How you’ll make an impactYou'll manage a team of Product Data Scientists and Analytics … Engineers that defines, measures, and presents metrics, delivers data pipelines and self-serve analytics, and ultimately enables actionable insights.You'll be responsible for delivering analytics for a product vertical. As part of your role, you'll scope the work, implement the delivery, mentor others, and set an example more »
Salary: £ 70 K
Posted:

Data Engineer - Azure Data Factory, Databricks, Power BI

City of London, London, United Kingdom
Nigel Frank International
A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »
Employment Type: Permanent
Salary: £60000 - £75000/annum
Posted:

Data Engineering Manager

Greater London, England, United Kingdom
Eames Consulting
Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities … Lead and mentor a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to more »
Posted:

Senior Data Engineer – Ecommerce - £765 (Inside IR35) – Contract

London Area, United Kingdom
Ventula Consulting
Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The … role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and more »
Posted:

Data Support Engineer

London, England, United Kingdom
iO Associates - UK/EU
infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. … Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »
Posted:

Senior Data Engineer

London, United Kingdom
Hybrid / WFH Options
Change Digital
Are you an experienced Senior Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days … site. Preferred skills: Experience with Azure and Databricks Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »
Employment Type: Permanent
Salary: £50000 - £75000/annum
Posted:

Senior Solutions Architect

London Area, United Kingdom
Matchtech
needs of the business, within the broader context of overall business and technology strategy. Preference will be given to candidates with experience in data and information management/strategy, and scientific solutions and services, as well as experience working on a broad range of projects. You will be … solutions architecture skills and experience Knowledge and experience of implementing large and medium scale data storage , archiving , transformation and data pipeline solutions with a focus on scientific data Knowledge and experience of various forms of data storage and processing and data … Experience working in a science organisation or with Science R&D Knowledge of TCP/IP networking, HTTP/REST, APIs and other data transfer mechanisms such as SSH, SFTP, VPN links Knowledge and experience with MS Azure solution architectures (esp. IaaS, PaaS and SaaS based solutions) Experience more »
Posted:

Data Engineer

London Area, United Kingdom
Vallum Associates
We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements … into actionable technical solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and more »
Posted:
Data Pipeline
London
10th Percentile
£52,500
25th Percentile
£62,500
Median
£75,000
75th Percentile
£101,250
90th Percentile
£120,000