151 to 175 of 293 Data Lake Jobs

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance Tuning : Partitioning, caching, Spark job optimization Cloud Architecture : Infrastructure-as-code, monitoring, automation Finance Domain More ❯

Job Description: We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud technologies and ETL processes. The ideal candidate will have a deep understanding of data architecture, data modeling, and data integration to support scalable and high-performance data solutions. Key … Responsibilities: Design and implement end-to-end Azure-based data solutions using services such as Azure SQL Database, Data Factory, Synapse Analytics, Data Lake, DevOps, and Storage. Develop and optimize ETL processes using Informatica for data integration and migration across UNIX and Windows environments. More ❯

Job Description: We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud technologies and ETL processes. The ideal candidate will have a deep understanding of data architecture, data modeling, and data integration to support scalable and high-performance data solutions. Key … Responsibilities: Design and implement end-to-end Azure-based data solutions using services such as Azure SQL Database, Data Factory, Synapse Analytics, Data Lake, DevOps, and Storage. Develop and optimize ETL processes using Informatica for data integration and migration across UNIX and Windows environments. More ❯

s how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams … to ensure seamless data flow and accessibility, supporting data-driven decision-making. Our systems are designed to handle large volumes of data, maintain quality and integrity, and provide robust APIs for fast, ergonomic data retrieval. About the Role In this role you will: Collaborate with cross-functional teams to deliver data … trading Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more More ❯

Are you ready to take ownership of a growing Data & BI function? This is a fantastic opportunity for a hands-on leader to shape and evolve a modern Microsoft data platform, deliver insightful analytics, and mentor a small team while remaining close to the technology.We’re looking for someone who thrives at the intersection of strategy … turning complex datasets into impactful Power BI dashboards that drive decision-making.What you’ll be doing Lead the design, optimisation, and ongoing evolution of a cloud-based Azure data estate. Build and maintain SQL models, queries, and stored procedures to deliver accurate, performant datasets. Develop and manage ETL/ELT pipelines using Azure Data Factory and … Deep expertise in Microsoft SQL Server, including T-SQL, indexing, and performance tuning. Proven experience with the Azure data stack (Data Factory, Data Lake Gen2, SQL MI, Power BI, Purview). Strong Power BI skills (advanced DAX, Power Query/M). Solid understanding of data modelling, ETL design, and relational More ❯

Are you ready to take ownership of a growing Data & BI function? This is a fantastic opportunity for a hands-on leader to shape and evolve a modern Microsoft data platform, deliver insightful analytics, and mentor a small team while remaining close to the technology in a product manufacturing business on the outskirts of Norwich. We … turning complex datasets into impactful Power BI dashboards that drive decision-making.What you’ll be doing Lead the design, optimisation, and ongoing evolution of a cloud-based Azure data estate. Build and maintain SQL models, queries, and stored procedures to deliver accurate, performant datasets. Develop and manage ETL/ELT pipelines using Azure Data Factory and … Deep expertise in Microsoft SQL Server, including T-SQL, indexing, and performance tuning. Proven experience with the Azure data stack (Data Factory, Data Lake Gen2, SQL MI, Power BI, Purview). Strong Power BI skills (advanced DAX, Power Query/M). Solid understanding of data modelling, ETL design, and relational More ❯

Our financial services client is seeking a Database Developer for an exciting direct hire opportunity. DUTIES:Design and develop ETL processes to transform a variety of raw data, flat files and excel spreadsheets into SQL databases. Develop and optimize queries, stored procedure, functions, views, and automation scripts using SQL, TSQL, Python, C#, and/or Powershell. Utilize data management best practices and in-depth usage of Microsoft SSIS & SSRS to accomplish business initiatives. Create and maintain a complex reporting structure including data storage systems, data sets, reports and dashboards using SQL queries, stored procedures, and programming languages such as R and Python. Evaluate business requests for data and reports to … such as Git, Bitbucket or similar central repository tools Familiarity with NoSQL Databases. Familiarity with JIRA preferred. Preferred experience with Azure: Data Factory, Databricks, Data Lake Storage, Analysis Services, and API - PySpark. Ability to multi-task in a fast-paced environment. Ability to prioritize tasks and projects using a browser-based tracking system. Ability to More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of … data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows • Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

The Position: The R&D Data Excellence Lead drives the vision, strategy, and execution of data excellence across the R&D organization. This role ensures that data is standardized, governed, and leveraged for advanced insights across scientific, clinical, safety, and regulatory domains. The role serves as a strategic advisor to R&D leadership, overseeing … enterprise-aligned data infrastructure, data architecture, and standards to accelerate discovery, development, and decision-making. The role partners closely with enterprise I&T to ensure all data initiatives are scalable, compliant, and interoperable. Responsibilities: Define and execute the R&D-wide data and analytics strategy aligned to R&D 2.0 transformation goals … and PD&C objectives Serve as a strategic advisor to R&D leadership on opportunities to improve pipeline productivity and operational efficiency using data Establish and govern data standards, metadata management, lineage, and ontologies across R&D domains Ensure compliance with enterprise data governance and facilitate its application across R&D data More ❯

The Position: The R&D Data Excellence Lead drives the vision, strategy, and execution of data excellence across the R&D organization. This role ensures that data is standardized, governed, and leveraged for advanced insights across scientific, clinical, safety, and regulatory domains. The role serves as a strategic advisor to R&D leadership, overseeing … enterprise-aligned data infrastructure, data architecture, and standards to accelerate discovery, development, and decision-making. The role partners closely with enterprise I&T to ensure all data initiatives are scalable, compliant, and interoperable. Responsibilities: Define and execute the R&D-wide data and analytics strategy aligned to R&D 2.0 transformation goals … and PD&C objectives Serve as a strategic advisor to R&D leadership on opportunities to improve pipeline productivity and operational efficiency using data Establish and govern data standards, metadata management, lineage, and ontologies across R&D domains Ensure compliance with enterprise data governance and facilitate its application across R&D data More ❯

The Position: The R&D Data Excellence Lead drives the vision, strategy, and execution of data excellence across the R&D organization. This role ensures that data is standardized, governed, and leveraged for advanced insights across scientific, clinical, safety, and regulatory domains. The role serves as a strategic advisor to R&D leadership, overseeing … enterprise-aligned data infrastructure, data architecture, and standards to accelerate discovery, development, and decision-making. The role partners closely with enterprise I&T to ensure all data initiatives are scalable, compliant, and interoperable. Responsibilities: Define and execute the R&D-wide data and analytics strategy aligned to R&D 2.0 transformation goals … and PD&C objectives Serve as a strategic advisor to R&D leadership on opportunities to improve pipeline productivity and operational efficiency using data Establish and govern data standards, metadata management, lineage, and ontologies across R&D domains Ensure compliance with enterprise data governance and facilitate its application across R&D data More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Title: GCP -Data Engineer. Location: Philadelphia PA (Can submit who are willing to relocate) GCP Data Engineer - GCP Dataflow and Apache Beam (Key skills) Primary Skills- PySpark, Spark, Python, Big Data, GCP, Apache Beam, Dataflow, Airflow, Kafka and BigQuery GFO, Google Analytics Javascript is Must Strong Experience with Dataflow and BigQuery A person should … have leading the team or responsible for team as a lead or senior Job Description: 10+ years' experience as a data warehouse engineer/architect designing and deploying data systems in a startup environment Mastery of database and data warehouse methodologies and techniques from transactional databases to dimensional data modeling, to wide … deformalized data marts Deep understanding of SQL-based Big Data systems and experience with modern ETL tools Expertise in designing data warehouses using Google Big Query Experience developing data pipelines in Python A firm believer in data-driven decision-making, and extensive experience developing for high/elastic scalable, 24x7x365 More ❯

Together with our clients, you will develop superior digital and technology concepts and architecture solutions as well as support technical implementations actively and on site, applying your sound Data/Cloud technical know-how, your understanding of business contexts, along with your analytical and conceptual skills. As you acquire experience, you will be responsible for owning the delivery … working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment • Experience with at least one of the … IT implementation projects • Technical architecture, code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific field, information technology, or business More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯