1 to 24 of 24 Lead Data Engineer Jobs in London

Our client who is a house hold UK name branded business are urgently looking for a Lead Data Engineer to lead a small team of data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for senior data engineers looking to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for data engineering processes. Requirements … Previous experience managing a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent communication and leadership abilities. Additional Information: This role offers more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will … of the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills: - Demonstrable experience … in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office In accordance with the Employment more »

Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental in their migration over to Azure alongside installing best practises in the data engineering team. This is an excellent opportunity for a Lead Data Engineer who is looking to work for a rapidly not for profit organisation who are currently in the … process of a huge cloud migration and improving the data engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step more »

Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an … start-up who provide real-time insights and emerging trends in private markets . They partner with investment firms and corporations to provide actionable data and intelligence on private companies. They are massively successful and growing steadily, and are on the look-out for a Lead Data Engineer to join the team! Specifically, they're looking for: Extensive experience as a Data Engineer using AWS Very strong ability in DBT and Redshift Proven experience working in an autonomous, start-up environment . Expert ability with PostgreSQL , ELT , unstructured data , and MongoDB . more »

Lead Data Engineer (Java/Python/AWS/Glue/Dremio). Investment Management. £160,000 - £170,000 + 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office. CANNOT SPONSOR CANNOT SPONSOR My client is a top tier multi asset investment … management house based in Central London. The Data Office team is playing a key role in helping build the future of financial services, working together with business partners to create client experiences that are changing the way people invest. You will work with smart, talented people across our business. … of view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform whilst managing a small squad of 3-5 Data more »

Lead Data Engineer with Palantir Foundry Remote (UK & Europe) Contract NOTE:- The Resource Needs to work In European Time Zone Description: Total experience of 7+ years in Data Engineering and must have at least 3 years of experience in Palantir Foundry. Strong experience with Palantir Data Engineering features such as, Code Repo, Code Workbook, Pipeline Build, migration techniques, Data Connection and Security setup. Design, develop Data Pipelines, and have excellent skills in PySpark and Spark SQL, hands on with code Build and deployment in Palantir. Must lead a team of … Willingness to mentor the team and onboard in new technologies. Work with Solution Architect, Product Owner, and Business users to understand the requirements to lead and deliver the products. Adopt and innovate new solutions in Palantir Platform. more »

Lead Data Engineer - Circa £100k DOE - West London Are you someone that has big ideas? Do you like to implement change that can help all teams stick and work together? Are you the sort of person who can take legacy and bring into 2024? If you like … spending time fixing it, they want to spend time upgrading it. If you are comfortable working closely with DevOps and Engineering and running a data team or you have ambitions to do so read more. At the heart of this company is the data they sell, a unique … would be helpful. Expect in the next 12 - 24 months this will be a company investing tech and delivering technical change for the better. Lead Data Engineer - Circa £100k DOE - West London more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. … As the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on … exciting projects and modernising their data function. If you are currently an Lead Data Engineer with experience in ETL, Azure, Managing/Mentoring and keen to work for a large Not for Profit then this is the perfect opportunity for you! Skills that are required for more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily in … their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has many hands-on more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office About … be the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. About Data at Cera Data has a critical role to play in two … distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about service users' health, covering more »

Lead Data Engineer - Snowflake/DBT/Python - ecommerce - £95k Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering … end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage … the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders … Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office in more »

Roles and Responsibilities: • Analyse and organize raw data • Build data systems, pipelines, and data products. • Evaluate business needs and objectives • Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modelling • Build algorithms and prototypes • Combine raw … information from different sources • Explore ways to enhance data quality and reliability • Identify opportunities for data acquisition • Develop analytical tools and programs • Collaborate with data scientists and architects on several projects • Automate Tasks • Create Models and Identify Patterns Key Skills: • Previous experience as a data engineer or in a similar role • Technical expertise with data models, data mining, data migration, Data warehousing and segmentation techniques (GCP). • Big query, big tables and Compute engine in GCP. • Knowledge of programming languages Python, R, and java. • Machine learning will be added advantage. • Hands more »

LEAD DATA ENGINEER £100,000 - £120,000 HYBRID - LONDON This new position is great for someone who is excited by companies with a great start-up culture and the opportunity to have a clear business impact. You would be going in to take ownership of this FinTech … are now looking to take a modern approach to how they use data. THE ROLE You would play a core role in using this data to map out their continued growth. Entering this role you will interact with the C-suite and decipher how best to grow their capabilities. more »

Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's insurer … size offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … implemented from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the business more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team … is committed to transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on … enhancing infrastructure scalability and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy more »

are not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL … PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate … document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is … expertly modelled, ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science … credit risk, and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong more »

Lead Data Engineer £80,000 - £100,000 DOE Mainly remote, some travel may be required Blue Wolf Digital are partnered with a boutique consulting firm who are looking to grow significantly this year due to some greenfield project wins. I'm looking for an experienced Lead Data Engineer to play a pivotal role in building state-of-the-art Databricks and Snowflake Lakehouse solutions from scratch. If you have experience with Azure, Databricks or Snowflake, SQL, ETL, and a passion for consulting, please get in touch. Key Responsibilities: Design, develop, and maintain cutting … edge Databricks or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize SQL queries for data extraction and analysis. Stay updated more »

Vertex Search is representing a fast-growing financial services firm that is now looking to make a Senior Data Engineering hire, the first role of its kind into the business with huge scope for impact and influence. The nascent data engineering team will collaborate with internal teams around … the business with a focus on data engineering, pipelines, tooling and services. Key Responsibilities: Data Engineering: Design and develop data services across various business functions Data Pipelines: Design and develop data pipelines for extracting, transforming, and loading data into appropriate storage systems. Data Tools and Services: Develop data tools and services to discover, understand, and utilize data effectively. Best Practice: Advise on and contribute to the development of data governance and management practices. Collaborate across teams to understand requirements and deliver data solutions. Skills and Experience: Required: 7+ more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. … development methodology; think strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … 8+ years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

Keen on testing your data engineering skillset in an autonomous role? You will be leading a developing engineering team at a market-leading trading firm, crafting your own data processes, datawarehouses and pipelines from scratch, whilst acting as the connector between stakeholders and mountains of raw data. Every … ideal opportunity expert T-SQL developers who are comfortable with deploying the MSBI stack, particularly SSIS, SSRS and PowerBI. Having exposure to Python for data manipulation and AWS or Azure is also a big plus. You will be using your expertise to shape your team, your projects and the … company’s data dictionary, quickly becoming a fundamental piece of the company’s plans. The day-to-day will incorporate a mixture of hands-on and leadership responsibilities, giving you the control over the direction that you and your team take. You’ll need to come from a strong more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used … a culture of excellence and delivering outstanding technical solutions to their internal functions and customers. This role will be perfect for someone who has lead experience or someone who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience … as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud-based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL more »