126 to 150 of 249 Permanent Data Lake Jobs

We are Looking for Enterprise Data Industry Consultant – Insurance Job Summary Enterprise Data Industry Consultant with 15+ years of expertise in data architecture and transformation, specializing in Property & Casualty (P&C) and commercial insurance domain. The ideal candidate will combine deep technical expertise with strong stakeholder management capabilities and executive-level advisory and presentation … skills to deliver transformational data solutions This strategic role involves advising client executives and leaders in design and implementation of enterprise-scale data solutions using AWS cloud technologies for complex data modernization initiatives and driving data-driven decision making across insurance operations. Technical Expertise and experience including Data Consultant : Enterprise … Database Technologies : Advanced expertise in PostgreSQL and Databricks or Snowflake for data warehousing and analytics AWS Cloud Platform : Expert proficiency in S3, Glue, Lambda, data lake implementation, and cloud infrastructure management Insurance Domain Knowledge P&C Insurance Operations : Deep understanding of policy administration, claims processing, underwriting, and rating systems Actuarial Understanding : Familiarity with risk assessment More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … effective use of AI tooling in your development process A growth mindset and eagerness to work in a fast-paced, mission-driven environment Good understanding of data lake architecture, medallion architecture, and data warehouse concepts. Good understanding of cloud architectures and technologies, including Docker and Kubernetes Good data modelling skills, and experience applying More ❯

Job Description: We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud technologies and ETL processes. The ideal candidate will have a deep understanding of data architecture, data modeling, and data integration to support scalable and high-performance data solutions. Key … Responsibilities: Design and implement end-to-end Azure-based data solutions using services such as Azure SQL Database, Data Factory, Synapse Analytics, Data Lake, DevOps, and Storage. Develop and optimize ETL processes using Informatica for data integration and migration across UNIX and Windows environments. More ❯

Job Description: We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud technologies and ETL processes. The ideal candidate will have a deep understanding of data architecture, data modeling, and data integration to support scalable and high-performance data solutions. Key … Responsibilities: Design and implement end-to-end Azure-based data solutions using services such as Azure SQL Database, Data Factory, Synapse Analytics, Data Lake, DevOps, and Storage. Develop and optimize ETL processes using Informatica for data integration and migration across UNIX and Windows environments. More ❯

s how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams … to ensure seamless data flow and accessibility, supporting data-driven decision-making. Our systems are designed to handle large volumes of data, maintain quality and integrity, and provide robust APIs for fast, ergonomic data retrieval. About the Role In this role you will: Collaborate with cross-functional teams to deliver data … trading Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more More ❯

Are you ready to take ownership of a growing Data & BI function? This is a fantastic opportunity for a hands-on leader to shape and evolve a modern Microsoft data platform, deliver insightful analytics, and mentor a small team while remaining close to the technology.We’re looking for someone who thrives at the intersection of strategy … turning complex datasets into impactful Power BI dashboards that drive decision-making.What you’ll be doing Lead the design, optimisation, and ongoing evolution of a cloud-based Azure data estate. Build and maintain SQL models, queries, and stored procedures to deliver accurate, performant datasets. Develop and manage ETL/ELT pipelines using Azure Data Factory and … Deep expertise in Microsoft SQL Server, including T-SQL, indexing, and performance tuning. Proven experience with the Azure data stack (Data Factory, Data Lake Gen2, SQL MI, Power BI, Purview). Strong Power BI skills (advanced DAX, Power Query/M). Solid understanding of data modelling, ETL design, and relational More ❯

Are you ready to take ownership of a growing Data & BI function? This is a fantastic opportunity for a hands-on leader to shape and evolve a modern Microsoft data platform, deliver insightful analytics, and mentor a small team while remaining close to the technology in a product manufacturing business on the outskirts of Norwich. We … turning complex datasets into impactful Power BI dashboards that drive decision-making.What you’ll be doing Lead the design, optimisation, and ongoing evolution of a cloud-based Azure data estate. Build and maintain SQL models, queries, and stored procedures to deliver accurate, performant datasets. Develop and manage ETL/ELT pipelines using Azure Data Factory and … Deep expertise in Microsoft SQL Server, including T-SQL, indexing, and performance tuning. Proven experience with the Azure data stack (Data Factory, Data Lake Gen2, SQL MI, Power BI, Purview). Strong Power BI skills (advanced DAX, Power Query/M). Solid understanding of data modelling, ETL design, and relational More ❯

Our financial services client is seeking a Database Developer for an exciting direct hire opportunity. DUTIES:Design and develop ETL processes to transform a variety of raw data, flat files and excel spreadsheets into SQL databases. Develop and optimize queries, stored procedure, functions, views, and automation scripts using SQL, TSQL, Python, C#, and/or Powershell. Utilize data management best practices and in-depth usage of Microsoft SSIS & SSRS to accomplish business initiatives. Create and maintain a complex reporting structure including data storage systems, data sets, reports and dashboards using SQL queries, stored procedures, and programming languages such as R and Python. Evaluate business requests for data and reports to … such as Git, Bitbucket or similar central repository tools Familiarity with NoSQL Databases. Familiarity with JIRA preferred. Preferred experience with Azure: Data Factory, Databricks, Data Lake Storage, Analysis Services, and API - PySpark. Ability to multi-task in a fast-paced environment. Ability to prioritize tasks and projects using a browser-based tracking system. Ability to More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of … data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows • Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Title: GCP -Data Engineer Location: Philadelphia PA (Can submit who are willing to relocate) GCP Data Engineer - GCP Dataflow and Apache Beam (Key skills) Primary Skills- PySpark, Spark, Python, Big Data, GCP, Apache Beam, Dataflow, Airflow, Kafka and BigQuery GFO, Google Analytics Javascript is Must Strong Experience with Dataflow and BigQuery A person should … have leading the team or responsible for team as a lead or senior Job Description: 10+ years' experience as a data warehouse engineer/architect designing and deploying data systems in a startup environment Mastery of database and data warehouse methodologies and techniques from transactional databases to dimensional data modeling, to wide … deformalized data marts Deep understanding of SQL-based Big Data systems and experience with modern ETL tools Expertise in designing data warehouses using Google Big Query Experience developing data pipelines in Python A firm believer in data-driven decision-making, and extensive experience developing for high/elastic scalable, 24x7x365 More ❯

Together with our clients, you will develop superior digital and technology concepts and architecture solutions as well as support technical implementations actively and on site, applying your sound Data/Cloud technical know-how, your understanding of business contexts, along with your analytical and conceptual skills. As you acquire experience, you will be responsible for owning the delivery … working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment • Experience with at least one of the … IT implementation projects • Technical architecture, code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific field, information technology, or business More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

The Swift Group is a privately held, mission-driven and employee-focused services and solutions company headquartered in Reston, VA. Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training. Founded in 2019, Swift supports Civilian, Defense, and Intelligence Community customers across the country and around the globe. We are a looking for a … Subject Matter Expert-level Data Engineer to join our dynamic team in Herndon, VA to designing data models, building data warehouses and data lakes, automating data pipelines and working with datasets of all sizes. Responsibilities: Optimize overall data/information flow by reducing redundancy and enabling accessibility within … security boundaries. Apply data extraction, transformation and loading (ETL) techniques to connect large data sets from a variety of sources Create data collection frameworks for structured and unstructured data Create cyber and operational analytic tools for consumers that assist them in building and optimizing downstream products inclusive of constructing dataset procedures that More ❯