1 to 25 of 78 Lead Data Engineer Jobs in the UK

Lead Data Engineer - Python/SQL/Azure My client, a London Market Specialty Insurance company are currently recruiting for a Lead Data Engineer to join their team on a Permanent basis. This is a great opportunity for an experienced Data Engineer to be an integral part of leading a team that is building a new data function for a fantastic client who are moving to a more data driven environment. This opportunity is based in London (requiring 2-3 days onsite) and is paying up to … per annum Key Skills Strong commercial experience with Python/SQL/PySpark Knowledge of converting business requirements to engineering processes Azure environment - Data Bricks & Data Factory Industry experience with Insurance would be highly desirable The processing and use by us of your personal data is in more »

Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental in their migration over to Azure alongside installing best practises in the data engineering team. This is an excellent opportunity for a Lead Data Engineer who is looking to work for a rapidly not for profit organisation who are currently in the … process of a huge cloud migration and improving the data engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step more »

Job Title: Technical Lead Data Engineer Location: Edinburgh, Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £70,000 - £85,000 The Role: Lead the Data team to deliver ETL processes, build and maintain data pipelines, enhance scalability, performance, maintainability, configurability … and usability Be involved in the entire life-cycle of the Data Strategy, including idea creation, deployment, and longer term updates and enhancements Support the product and Software Development Managers in prioritisation, scoping and leading delivery of Data Strategy features in the exciting world of Future State Architecture … Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Able to zero-in on bugs without looking at the code Technical Lead Data Engineer Requirements: Good SQL and NoSQL experience Expert-level ability in TSQL development Integrations utilising more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team … is committed to transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on … enhancing infrastructure scalability and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy more »

Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an … start-up who provide real-time insights and emerging trends in private markets . They partner with investment firms and corporations to provide actionable data and intelligence on private companies. They are massively successful and growing steadily, and are on the look-out for a Lead Data Engineer to join the team! Specifically, they're looking for: Extensive experience as a Data Engineer using AWS Very strong ability in DBT and Redshift Proven experience working in an autonomous, start-up environment . Expert ability with PostgreSQL , ELT , unstructured data , and MongoDB . more »

are not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … We provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed … us do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The more »

Lead Data Engineer Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and diversity at … all levels. They have a new opportunity for a Lead Data Engineer – this function is still relatively young in this region, and they’re looking for a thought leader in the industry to come in to this blank page and help write a new story. The person … Experienced in designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Experience of leading teams, mentoring junior team members more »

Our client are a tech for good business dedicated to promoting transparency in the corporate world they are seeking a highly skilled and experienced Lead Data Engineer. You will be the first hire in the Data Engineering team allowing you to take the drivers seat regarding the … direction taken by the data team to follow. Key Responsibilities: Platform Development: Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources. Collaboration: Work with cross-functional teams to understand data platform requirements and deliver solutions that meet business needs. Optimisation: Enhance data storage and retrieval systems for high performance and data integrity. Quality Assurance: Implement and maintain a data quality and observability framework to ensure data accuracy, completeness, and consistency. Documentation: Develop and maintain comprehensive more »

Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering end to end data requirements and designing data pipelines/warehouses … to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data structures. Assess the commercial potential of our client’s data and more »

Lead Data Engineer – Blockchain Remote across Europe, hybrid options – London office Up to £120k Lead the charge as a Data Engineer in the Blockchain realm! This role offers remote opportunities across Europe, with hybrid options available in our London office. Earn up to £120k … while making a meaningful impact in the Web3 infrastructure. Our mission? To introduce unprecedented transparency and depth to Web3 infrastructure data, reshaping interactions with blockchain technologies worldwide. As a key player in our team, you'll craft and maintain robust data pipelines and APIs, facilitating seamless connections across … our systems. Your mastery of Python and SQL will be pivotal in handling and analyzing vast data volumes. Requirements: Proficient Python skills, ideally showcased through an active GitHub profile. Previous experience in Web3 is essential, you have to have worked in a Web3 company before to be considered. STEM more »

Lead Data Engineer with Palantir Foundry Remote (UK & Europe) Contract NOTE:- The Resource Needs to work In European Time Zone Description: Total experience of 7+ years in Data Engineering and must have at least 3 years of experience in Palantir Foundry. Strong experience with Palantir Data Engineering features such as, Code Repo, Code Workbook, Pipeline Build, migration techniques, Data Connection and Security setup. Design, develop Data Pipelines, and have excellent skills in PySpark and Spark SQL, hands on with code Build and deployment in Palantir. Must lead a team of … Willingness to mentor the team and onboard in new technologies. Work with Solution Architect, Product Owner, and Business users to understand the requirements to lead and deliver the products. Adopt and innovate new solutions in Palantir Platform. more »

longest-serving active bulk annuity provider, and a market-leading, multi-award-winning business. Job Description We have an exciting new opportunity for a Lead Data Engineerto join us. The role holder will belead in all technical aspects of the data engineering projects whilst working closely with … needed. Applying knowledge of technology options and survey external market landscape for solution insights, direction, and vendors, as required. Identifying issues and risks and lead their resolution as required. Identifying and implement opportunities for innovation and continuous improvement in existing services. Qualifications Who we're looking for: Degree in … scripting & automation Good knowledge of CI\CD automation NoSQL Database Technology such as MongoDB CDC and streaming technologies such as Qlik Replicate & Kafka Basic data architecture principles, solutioning and ETL experience and containerisation Knowledge of database structures such as relational and dimensional modelling and design Designing and developing streaming more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL … PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate … document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL … PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate … document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. … As the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on … exciting projects and modernising their data function. If you are currently an Lead Data Engineer with experience in ETL, Azure, Managing/Mentoring and keen to work for a large Not for Profit then this is the perfect opportunity for you! Skills that are required for more »

Job title: Lead Data Engineer Client: Elite Quant Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a … Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with more »

Job title: Lead Data Engineer Client: Elite Quant Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a … Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help build data … allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Your role at more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help build data … allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Your role at more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross-functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other … similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience more »

Role – Lead Data Engineer Skills – Leadership/Python/Any Cloud Location – Manchester Work Pattern – Once every 2 weeks in the office Salary – up to £80,000 plus benefits package including a significant Bonus. The Company We are looking for Data Engineer to join a … very well-established company and data team. They have a huge amount of data, it’s one of the strategic pillars of the company and they are heavily investing in a new system, which will be a vast improvement. This role will focus on exploring solutions to maintain … improve, and scale their use of data. They do an awful lot with data, it’s a huge asset to the business and they have a large number of people who have access to their data systems for analytical and insight purposes. The Role This is an amazing more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders … Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office in more »

Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k Hybrid model – 3 days in the office per week. There is NO sponsorship on offer for this role, so you must be eligible to work in the UK My clients newly formed Data & Analytics team is … playing a pivotal role in driving our data-driven transformation. They are a diverse group of passionate individuals with expertise across various data and analytics domains. Currently transitioning from a program-based structure to a steady-state operation, and we're excited to embrace Agile methodologies to optimize … our efficiency and effectiveness. We are seeking a highly motivated and skilled Lead Data Engineer to join our growing Data & Analytics team. In this role, you will play a pivotal role in supporting the ambition to fully realise the benefits of a Lakehouse platform deployed within more »

Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k Hybrid model – 3 days in the office per week. There is NO sponsorship on offer for this role, so you must be eligible to work in the UK My clients newly formed Data & Analytics team is … playing a pivotal role in driving our data-driven transformation. They are a diverse group of passionate individuals with expertise across various data and analytics domains. Currently transitioning from a program-based structure to a steady-state operation, and we're excited to embrace Agile methodologies to optimize … our efficiency and effectiveness. We are seeking a highly motivated and skilled Lead Data Engineer to join our growing Data & Analytics team. In this role, you will play a pivotal role in supporting the ambition to fully realise the benefits of a Lakehouse platform deployed within more »