701 to 725 of 2,469 Data Lake Jobs

Data Engineer - Microsoft Fabric, high wycombe Client: Agile Location: high wycombe, United Kingdom Job Category: Other Virtual job fairs - EU work permit required: Yes Job Views: 5 Posted: 31.05.2025 Expiry Date: 15.07.2025 Job Description: About Agile Solutions Agile Solutions GB Ltd is focused on deriving true value from … make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role: We are seeking a highly experienced Senior Data Architect with deep domain expertise in insurance , particularly within the London Market and specialty insurance sectors. This role is pivotal in designing and implementing … scalable, secure, and high-performance data architectures, including medallion architecture , across cloud platforms such as AWS , Databricks , and Snowflake . Design and implement enterprise-grade data architectures , with a focus on medallion architecture (bronze, silver, gold layers). Lead the development of data pipelines … data lakes , and data warehouses using AWS , Databricks , and Snowflake . Collaborate with business stakeholders, data engineers, and analysts to translate business requirements into scalable data solutions. Ensure data governance, security, and compliance across all data platforms. Provide More ❯

bank with a long-standing reputation for excellence, innovation, and client service. With a strong presence in London, are looking to expanding there data engineering capabilities to support critical business functions, regulatory reporting, and data-driven decision-making. Role Overview They are seeking a highly skilled … Design, build, and maintain robust data pipelines using AWS services (Glue, Lambda, Step Functions, S3, etc.) Develop and optimize data lake and data warehouse solutions using Redshift, Athena, and related technologies Collaborate with data scientists, analysts, and business stakeholders to understand … AWS ) Strong proficiency with Python and SQL Extensive hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Familiarity with DevOps practices and infrastructure-as-code (e.g., Terraform, CloudFormation) Solid understanding of data More ❯

of experience in designing ETL/data pipelines using Microsoft Synapse; Excellent knowledge of data warehouse/data lake and data lakehouse design; Excellent knowledge of relational database systems applied to data warehouse; Excellent knowledge of non-relational database … the context of AI-based solutions (e.g. RAG) is considered an asset; Excellent knowledge of access rights management in datawarehouse/data lake(segregation of access at row level based on user roles); Excellent knowledge of business intelligence reporting tools Excellent knowledge of SQL; Excellent knowledge of … online analytical data processing (OLAP) and data mining tools; Good knowledge of Python and Apache Spark; Good knowledge of cloud-based design; Knowledge of R would be considered an asset; Knowledge of Microsoft Power BI would be considered an asset; Knowledge of Microsoft Azure would be More ❯

Description We are a forward-thinking company that recently launched an innovative Petcare Platform, poised to revolutionize how we utilize real-time event data within our operational and analytical ecosystems. As we continue to grow, we are excited to enhance our data capabilities and processes, bridging … Cloud Platform to deliver cutting-edge solutions. To support this ambitious journey, we are looking for two experienced Principal Engineers to join our Data Platforms team within the Engineering function. The Opportunity: As a Principal Engineer, you will play a pivotal role in defining and driving key technical … Experience building and/or deploying Customer Data Platforms, data streaming architectures for real-time analytics, cloud data lake/warehousing or semantic modelling Working knowledge of deploying and/or using MLOps tooling/frameworks (open source or cloud-native) or data More ❯

Data Analyst/Developer (You must have Fabric skills to be considered for this role) Power Bi | Power BI| Azure | Fabric | DAX | Business Intelligence | BI | SQL My client based in Surrey are looking to recruit an experienced Data Analyst/Developer for their internal IT team. … You can work from home 1 days a week. Summary: The Data Analyst will take full ownership of data analytics across the organization, driving Business Intelligence with a data-centric approach. Collaborating with stakeholders, this role will involve managing the entire data … and provide meaningful data to aid their business decisions. Working with IT team for development and maintenance of Azure Data Lake functionality. Responsible for integrating with 3rd party systems and developing new systems and reports as needed. Design, develop, and implement BI dashboards from various More ❯

and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit . Job Title: Azure Data Engineer Location: Irving, Texas Duration: Fulltime Job Summary: Key Responsibilities: Job Title Desired Skills 1 Possess a minimum of 5 years of experience in … data engineering and … development 2 Strong experience in designing and implementing data solutions using Azure data services Azure Databricks Azure Data Lake Azure Synapse Analytics Azure Data Factory 3 Have a strong background in Retail CPG domain 4 Proficiency in SQL TSQL and data More ❯

Summary Digital Futures is looking for aspiring data engineering consultants to join our Future Talent Programme. The Future Talent Programme offers a unique entry point for individuals looking to start their career in technology. The programme begins with immersive training at the Digital Futures Academy, where trainees gain … to-one mentoring and group project work. Certification – As part of your graduation from the Digital Futures Academy, you will achieve the AWS Data Engineer Associate certification. The cost of your certification is covered by Digital Futures. Employment – Once your deployment has been secured, we will offer you … technology team at one of the world’s leading companies, applying your skills to exciting, innovative and impactful projects. Your immersive training The Data Engineering pathway at the Digital Futures Academy covers the key technical skills and concepts needed to be successful in your first role in data. More ❯

Summary Digital Futures is looking for aspiring data engineering consultants to join our Future Talent Programme. The Future Talent Programme offers a unique entry point for individuals looking to start their career in technology. The programme begins with immersive training at the Digital Futures Academy, where trainees gain … to-one mentoring and group project work. Certification – As part of your graduation from the Digital Futures Academy, you will achieve the AWS Data Engineer Associate certification. The cost of your certification is covered by Digital Futures. Employment – Once your deployment has been secured, we will offer you … technology team at one of the world’s leading companies, applying your skills to exciting, innovative and impactful projects. Your immersive training The Data Engineering pathway at the Digital Futures Academy covers the key technical skills and concepts needed to be successful in your first role in data. More ❯

Date: 17.07.2025 col-wide Job Description: Job Description Redhill - 3 days office based A successful global organisation is seeking an experienced BI and Data Developer to provide project and support expertise business wide. In this role you will be responsible for the design, development, and implementation of ETL … pipelines as data warehouse models, working collaboratively with various IT divisions. You will also participate in the data and reporting requirement-gathering activities, pre-project boards, ensuring data is secure and reliable, managing incidents (MARVAL, Service NOW), and JIRA queue, evaluate and maintain 3rd … dimensions, and measures, and SCD Proven capability with Oracle, SQL, PL/SQL Proven expertise in big data concepts, Data Lake, Data Vault, NoSQL databases, Amazon S3, and external files. Understanding of Python, Spark & Machine Learning and REST API This is a responsible More ❯

Job Description Lead Data Engineer Location: London A Lead Data Engineer is sought after by a leading workplace pensions provider to run … their expanding data engineering team in their London City office. The team has recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture, and a wide range of AWS tools (S3, Glue, Step Functions … etc.). With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning) and a requirement to design, build, and implement robust ETL pipelines for effective integration with the wider business. As More ❯

Engineer within this team, you should have: Extensive years of KDB experience Extensive years of experience in the financial industry Understanding of large data platforms/Data lakes Some other highly valued skills may include: Experience with KDB data migration to AWS Experience with … be based out of our Canary Wharf Office. Purpose of the role To build and maintain systems that collect, store, process, and analyze data, such as data pipelines, data warehouses, and data lakes, ensuring data is accurate, accessible, and secure. … Accountabilities Build and maintain data architecture pipelines for data transfer and processing. Design and implement data warehouses and data lakes managing data volume, velocity, and security. Develop processing and analysis algorithms suitable for data complexity and volume. Collaborate More ❯

Vacancy: Senior Data Engineer & Team Lead - Lead a team and transform the future of streaming data Are you an experienced Data Engineer with leadership qualities and a passion for large-scale data infrastructure? Do you enjoy working with cutting-edge technologies to … process streaming and broadcast data? Then this challenging role in the media and advertising industry is perfect for you! About the Organization You'll join an innovative technology company that tracks streaming and broadcast video worldwide with proprietary data and technology. The company is on a … such as Apache Spark or similar Advanced knowledge of cloud-based data infrastructure (AWS, GCP, or Azure) and modern data lake architectures Strong skills in data modeling, database design, and query optimization for relational and non-relational databases Hands-on experience with Apache More ❯

/Engineer Fixed-term contract role - 6 months (extendable) We are seeking a highly skilled Scala Engineer with a passion for building scalable, data-intensive systems . In this role, you will design, develop, and optimize high-performance data pipelines, working closely with Big Data … with Apache Spark, Kafka, Flink, and other distributed data frameworks to process massive amounts of data. Develop and maintain data lake and warehouse solutions using technologies like Databricks Delta Lake, Apache Iceberg, or Apache Hudi. Write clean, maintainable, and well-documented code. Optimize query … experience in software development with Scala Hands-on experience with Apache Spark (batch & streaming) using Scala. Experience in developing and maintaining data lake and warehouses using technologies like Databricks Delta Lake, Apache Iceberg, or Apache Hudi . Experience working with open-source data formats More ❯

its 12,000+ professionals, is committed to continuing the Group's 170-year heritage of building sustainable communities. Overview : We are seeking a Data Governance coordinator who will focus on the organizational aspects of data governance within our data Lakehouse environment. This individual will … needed. - Ensure alignment between developers and business counterparts regarding data management practices. - You will work together with data governance developer, datalake operations team and business adoption team. Qualifications: - Bachelor or masters degree in Operations Research, or Information Management related fields of study - Proven experience in data … . - Excellent organizational, communication, and interpersonal skills. - Experience with or knowledge of data management tools and technologies is a plus (e.g., AWS Lake Formation, data catalogs). - Certified Data Management Professional (CDMP) certification is a strong plus. Desired Skills: - Ability to work independently More ❯

About Agile Solutions Agile Solutions GB Ltd focuses on deriving value from customer data by helping manage, monetize, leverage, and optimize its use. We offer advice, support, and delivery services across various industries, covering Data Strategy, Governance, Security, Data Platform Modernisation, Cloud, and Customer … to create tangible business benefits through our Agile Information Management framework, which measures performance and ensures value delivery. Summary We seek a proactive Data Engineer with experience in Microsoft Fabric to join our growing team. You will develop and optimise data pipelines and solutions supporting analytics … analysis. Strong SQL and data modelling skills. Experience with modern ELT/ETL tools within Microsoft ecosystem. Understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualization. Familiarity with DevOps practices related to data More ❯

operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. Job Description Do you have what it takes to turn raw data into actionable insights and drive innovation? As a team, we transform our client’s businesses using a combination of strategic thinking, customer-centric service … an inclusive community for the curious, generous, pragmatic and committed digital practitioner. You'll have: Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Perform tasks such as writing scripts … looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools, cloud technologies and approaches and while we have a More ❯

Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless … some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end … Azure Data Factory Azure Databricks Azure SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong More ❯

Job Description Principal Enterprise Data Architect Location: Leeds once a month About the Role We are seeking a highly skilled Principal Enterprise Data Architect to drive the next five years of our clients data strategy. This role is crucial in shaping how they utilise … data efficiently, transitioning from traditional data warehouses to data lakes and developing a common data platform for forecasting and operational efficiencies using AI and GenAI. You will be at the heart of transforming transactional data, leveraging AWS technologies, and enhancing … decision-making capabilities across the enterprise. Key Responsibilities Strategic Leadership: Define and implement a comprehensive data strategy, ensuring high-scale transactional data (handling terabytes of data) is optimized for business performance. Data Architecture Expertise: Lead the architectural design of data More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced AWS Databricks Data Architect to join their team. They are a leader within the consulting space and are experiencing growth, backed by a large multi-equity firm aiming to strengthen their financial … Your role will include: Designing and implementing effective architectural solutions around AWS serverless technologies (S3, Lambda, Athena, Kafka) and Databricks, including Data Lake and Data Warehousing. Assessing database implementation procedures to ensure GDPR and data compliance. Guiding and influencing technology teams and stakeholders … data modeling and Kinesis. Understanding of SQL and database management. Hands-on experience with Data Warehouse and Data Lake technologies, preferably on AWS. Benefits include: Hybrid work (2 days in London) 28 days holiday plus bank holidays Private medical health insurance Pension scheme More ❯

DATA ENGINEER LONDON BASED £35,000-40,000 PER ANNUM This UK-based software firm is searching for a … new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in GCP. You will also be responsible for building new data pipelines in Python. THE COMPANY The company works within the Adtech … the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using GCP. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as More ❯

DATA ENGINEER LONDON BASED £35,000-40,000 PER ANNUM This UK-based software firm is searching for a … new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in GCP. You will also be responsible for building new data pipelines in Python. THE COMPANY The company works within the Adtech … the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using GCP. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as More ❯

Social network you want to login/join with: Data Engineer - Microsoft Fabric, northampton col-narrow-left Client: Agile Location: northampton, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: About Agile … make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data More ❯

Social network you want to login/join with: Data Engineer - Microsoft Fabric, plymouth col-narrow-left Client: Agile Location: plymouth, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: About Agile … make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data More ❯