26 to 36 of 36 Permanent Lead Data Engineer Jobs in London

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with clients … gathering requirements, creating the appropriate structure for data in ERA data warehouses and develop robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident … using the full suite of Google data products, IAC, CI/CD, Spark and Kafka. Our core toolbox includes Google Cloud Big Data technologies, Scala, Java & Python, Jenkins amongst others. We value first principles reasoning to select the right tools and processes for our clients' requirements, and we more »

be critical.0-12 months you’ll deliverHands on development on Nexus PlatformResponsible for the code quality and simplicity in the systemLeading a team of data engineers and working with data designers within an Agile frameworkBuilding knowledge of all data resources within ND and prototype new data … you’ll bringProficiency in technologies such as Spark (SQL and/or Scala), Kafka.Experience in Scala programming languageAnalytical and problem-solving skills, applied to data solutionProficiency with traditional database SQL technologiesExperience with integration of data from multiple data sourcesExperience of CI/CD best practicesAnd would love … or learn:Experience of ETL technologiesAWS exposure (Athena, Glue, EMR, Step functions)Experience of relational database technologies (MS SQL Server, Redshift, Aurora)Experience with data solution BAU processes (ETL, table refresh etcAbout NewDay We help people move forward with credit, and help our colleagues to move their careers forward more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used … a culture of excellence and delivering outstanding technical solutions to their internal functions and customers. This role will be perfect for someone who has lead experience or someone who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience … as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud-based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL … PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate … document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is … expertly modelled, ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science … credit risk, and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong more »

Lead Data Engineer £80,000 - £100,000 DOE Mainly remote, some travel may be required Blue Wolf Digital are partnered with a boutique consulting firm who are looking to grow significantly this year due to some greenfield project wins. I'm looking for an experienced Lead Data Engineer to play a pivotal role in building state-of-the-art Databricks and Snowflake Lakehouse solutions from scratch. If you have experience with Azure, Databricks or Snowflake, SQL, ETL, and a passion for consulting, please get in touch. Key Responsibilities: Design, develop, and maintain cutting … edge Databricks or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize SQL queries for data extraction and analysis. Stay updated more »

Vertex Search is representing a fast-growing financial services firm that is now looking to make a Senior Data Engineering hire, the first role of its kind into the business with huge scope for impact and influence. The nascent data engineering team will collaborate with internal teams around … the business with a focus on data engineering, pipelines, tooling and services. Key Responsibilities: Data Engineering: Design and develop data services across various business functions Data Pipelines: Design and develop data pipelines for extracting, transforming, and loading data into appropriate storage systems. Data Tools and Services: Develop data tools and services to discover, understand, and utilize data effectively. Best Practice: Advise on and contribute to the development of data governance and management practices. Collaborate across teams to understand requirements and deliver data solutions. Skills and Experience: Required: 7+ more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. … development methodology; think strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … 8+ years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

Keen on testing your data engineering skillset in an autonomous role? You will be leading a developing engineering team at a market-leading trading firm, crafting your own data processes, datawarehouses and pipelines from scratch, whilst acting as the connector between stakeholders and mountains of raw data. Every … ideal opportunity expert T-SQL developers who are comfortable with deploying the MSBI stack, particularly SSIS, SSRS and PowerBI. Having exposure to Python for data manipulation and AWS or Azure is also a big plus. You will be using your expertise to shape your team, your projects and the … company’s data dictionary, quickly becoming a fundamental piece of the company’s plans. The day-to-day will incorporate a mixture of hands-on and leadership responsibilities, giving you the control over the direction that you and your team take. You’ll need to come from a strong more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services … the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

Join us in leading the charge as a Data Engineer in the exciting realm of blockchain technology! This role offers remote opportunities across Europe, with hybrid options available in our vibrant London office. With a competitive salary of up to £130k, you'll have the chance to make … and depth to Web3 infrastructure data. As a key player in our team, you'll play a pivotal role in crafting and maintaining robust data pipelines and APIs, enabling seamless connections across our systems. Responsibilities: Develop and maintain robust data pipelines and APIs to facilitate seamless connections across … our systems. Utilize your mastery of Python and SQL to handle and analyze vast data volumes effectively. Collaborate closely with cross-functional teams to drive innovation and ensure data quality and reliability. Requirements: Proficient Python skills, demonstrated through an active GitHub profile. Previous experience in Web3 is essential more »