1 to 25 of 307 Data Lake Jobs

of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. FS Technology Consulting - AI and Data - Data Engineer - Senior Consultant/Manager - Dublin/Cork/Limerick/Galway General Information Location: Dublin, Cork, Limerick, or Galway. Available for VISA Sponsorship: No Business … Platforms: Microsoft: Experience with Azure Data Factory for orchestrating data workflows. Proficiency in Azure Synapse Analytics and SQL Server. Familiarity with Azure Data Lake Storage (Gen2) and Azure Blob Storage. Knowledge of Power BI integration and data modelling Understanding of Azure Functions and Logic Apps for automation. Snowflake: Strong SQL skills … based transformations. Understanding of role-based access control, data masking, and time travel features. Databricks: Hands-on experience with Apache Spark and Databricks Runtime. Proficiency in Delta Lake for ACID-compliant data lakes. Experience with Structured Streaming and Auto Loader. Familiarity with MLflow, Feature Store, and Model Registry. Use of Databricks notebooks for collaborative development More ❯

Senior BI Architect Birmingham Reporting into the CTI as a key member of our newly formed Data Engineering team, the Senior BI Architect will lead the design, development, and ongoing … enhancement of data and reporting infrastructure. You will be the strategic owner of our Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role combines technical leadership, agile delivery, and stakeholder engagement to drive data-driven decision … data platform Manage the BI function and ensure alignment with business goals Platform Ownership & Governance Administer and govern the Azure Fabric Platform, including: Azure Data Lake & Data Warehouse (storage) Azure Data Factory (data integration) Databricks (data transformation and modelling) Power BI (analytics and dashboards) Ensure data More ❯

Sr Data Architect, Data Lake & Analytics, ProServe SDT North Are you a Data Analytics specialist? Do you have Data Warehousing and/or Hadoop/Data Lake experience? Do you like to solve the most complex and high scale (billions + records) data challenges in the … businesses through cloud computing adoption? Do you like to work on-site in a variety of business environments, leading teams through high impact projects that use the newest data analytic technologies? Would you like a career path that enables you to progress with the rapid adoption of cloud computing? At AWS, we are hiring the best Data … Science, Engineering, Mathematics or a related field 8+ years of experience of IT platform implementation in a highly technical and analytical role. 5+ years' experience of Data Lake/Hadoop platform implementation, including 3+ years of hands on experience in implementation and performance tuning Hadoop/Spark implementations Ability to think strategically about business, product, and technical More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

the Role We re working with a market-leading organisation that s undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you ll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … is used across Finance, Operations, and Commercial functions. What You ll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory … Oversee the migration from legacy tools (Domo, Vecta) to the new Power BI ecosystem. What You ll Bring Technical Skills Strong hands-on experience with Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Advanced skills in data modelling (conceptual, logical, physical) and SQL for complex transformations. Proven ability to design More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory … Oversee the migration from legacy tools (Domo, Vecta) to the new Power BI ecosystem. What You'll Bring Technical Skills Strong hands-on experience with Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Advanced skills in data modelling (conceptual, logical, physical) and SQL for complex transformations. Proven ability to design More ❯

a common purpose and forge ways forward together. Make it better. We create fulfilling purpose-driven careers by learning from the world and each other. POSITION TITLE Analytics Data Modeler Lead POSITION LOCATION This position is available to Virginia residents as Richmond or Lynchburg, VA Hybrid in-office applicants or remote applicants residing in states/locations under … Island, South Carolina, South Dakota, Tennessee, Texas, Virginia, Washington DC, Vermont, West Virginia or Wisconsin. This role is not eligible for employment visa sponsorship. YOUR ROLE The Analytics Data Modeler plays a vital role in transforming raw data into meaningful business insights. This professional is responsible for designing, developing, and maintaining robust data models … that empower organizations to make informed decisions based on accurate and accessible information. Working at the intersection of business needs, data architecture, and advanced analytics, the Analytics Data Modeler ensures that data flows seamlessly and can be leveraged to derive actionable intelligence. What you will be doing Data Modeling and Design: Develop More ❯

Embark on a transformative journey as an Enterprise Data Architect. At Barclays, our vision is clear: to define, direct and govern the bank's target data architecture (inc. shared data environment, data model and standards) in support of business strategy, ensuring that data is accurate, secure and accessible to meet … as an Enterprise Data Architect, you should have experience with: Developing architectural solutions and patterns using latest data engineering approaches, for example data lake, events, API Ability to logically model financial data Excellent written communications skills with experience using structured design languages, for example UML, Archimate or equivalent Some other highly … valued skills may include: Good stakeholder management skills up to C-level execs Understanding of data governance and data management processes and best practice You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Beneifts Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … like PostgreSQL, MySQL, or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … like PostgreSQL, MySQL, or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. More ❯

Data Solution Architect - Conceptual Data Models, Data Vault 2.0, Azure Up to £800 per day (Inside IR35) London/Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Conceptual Data Modelling, Solution Architecture specifically within Data, exceptional stakeholder management skills and experience of implementing Data Vault 2.0 to join a business-critical Programme ASAP.Your CV will need to clearly state how you are involved in the process of leading/managing/maintaining/uplifted/improving Conceptual Data Models, as well as where you have implemented Data … leading/managing/maintaining/uplifted/improving Conceptual Data Models) Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Advocate for positive personal participation in workshops, and demonstrate More ❯

Harvey Nash is now inviting candidates to apply for the role of Solution Data Architect, an initial 6-month contract working inside of IR35, fully remote. This is a critical role that will lead the ongoing development of our Business Data logical model and support key strategic initiatives. Key Responsibilities Lead the ongoing development and evolution … of the Business Data logical model. Collaborate closely with teams responsible for physical model development. Support ongoing design work and delivery of inflight activities using Microsoft information architecture. Contribute to ERP implementation projects and data migration activities. Ensure data governance and compliance standards are maintained throughout all initiatives. Core Requirements Data Modelling … Server, Azure SQL Database, and other enterprise database platforms Cloud Architecture: Experience with Azure data services (Azure Data Factory, Azure Synapse, Azure Data Lake) Data Governance: Understanding of data quality, data lineage, and metadata management principles. ETL/ELT Processes: Experience designing and implementing data More ❯

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize … workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely … Architecture: Deep applied understanding of data platform selection and differentiation, including relational, non-relational (streaming, document, graph, timeseries), and analytics (data warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in More ❯

Overview JOB TITLE: Senior Software Engineer (GCP) - Risk Data Lab LOCATION: London HOURS: 35 hours, full time WORKING PATTERN: Hybrid, 40% (or two days) in the above office location About this opportunity Become a part of our digital transformation journey and help us modernise our data environment! As a GCP Senior Software Engineer you will be … responsible for modernising our data stack by designing, developing and maintaining data pipelines, data solutions and data infrastructure on our Strategic Data Mesh Platform. You will collaborate with cross-functional teams to ensure the efficient flow of processing of data while serving data products to a … working in GCP, with particular focus on Cloud storage and Big Query; GCP Professional Data Engineer certification Experience delivering on data warehousing, data lake or data lakehouse concepts Experience working with containerisation (GKE), Terraform, CI/CD automated code integration and deployment pipelines using Jenkins, Gitops and Harbour; In event streaming More ❯

Data Engineer - Azure/GCP, Data Lake, Snowflake Up to £700 per day (Inside IR35) London/Hybrid (1-2 days per week hybrid working ) 6 months I am currently working with an instantly recognisable, high profile client who urgently require a Data Engineer with expertise in Azure/GCP and Data Lakes to join a major transformation programme, whilst expanding Data sources and identifying more Data sources to help produce more metrics to drive Data capability across the entire organisation, helping bridge the gap between Data Engineering and Security. Key Requirements: Proven experience as a Data Engineer in a … InfoSec/Risk teams Understanding of Data Management frameworks (DCAM, DMBOK) Working knowledge of GraphQL/Data Bricks/Snowflake/Oracle Data Lake/Synapse in Azure/Big Query in GCP Previous experience of working with Medical/Healthcare Data Immediate availability If you're interested in this role More ❯

Data Architect – Azure/Data Lake/Fabric Location: Central London (Hybrid, 2 days per week onsite) Contract: Initial 3 months, likely extension to 12 months Day Rate: £600 per day (Outside IR35) Overview We are seeking a skilled Data Architect to join a large-scale data warehousing project with a … architecture within a complex, enterprise-scale environment. Key Responsibilities Design and implement robust data architecture solutions on Microsoft Azure . Develop and optimise MSFT Data Lake and MSFT Fabric infrastructure to support enterprise-level data processing and analytics. Collaborate with data engineers, analysts, and stakeholders to define best practices and ensure … from design to deployment. Skills & Experience Proven experience as a Data Architect on large-scale data projects. Strong expertise in Microsoft Azure , Data Lake , and Fabric technologies. Hands-on experience with data modelling, governance, and architecture frameworks. Excellent stakeholder communication and collaboration skills. Prior experience within higher education or large, data More ❯

Data Architect – Azure/Data Lake/Fabric Location: Central London (Hybrid, 2 days per week onsite) Contract: Initial 3 months, likely extension to 12 months Day Rate: £600 per day (Outside IR35) Overview We are seeking a skilled Data Architect to join a large-scale data warehousing project with a … architecture within a complex, enterprise-scale environment. Key Responsibilities Design and implement robust data architecture solutions on Microsoft Azure . Develop and optimise MSFT Data Lake and MSFT Fabric infrastructure to support enterprise-level data processing and analytics. Collaborate with data engineers, analysts, and stakeholders to define best practices and ensure … from design to deployment. Skills & Experience Proven experience as a Data Architect on large-scale data projects. Strong expertise in Microsoft Azure , Data Lake , and Fabric technologies. Hands-on experience with data modelling, governance, and architecture frameworks. Excellent stakeholder communication and collaboration skills. Prior experience within higher education or large, data More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA … processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure … DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA … processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure … DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA … processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure … DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema More ❯

Data Solution Architect Associate Director Basic Information Location : Dublin Business Area : Consulting Description and Requirements When you join KPMG Ireland, you are joining a community of over 4,200 employees who collectively work together, both in person and virtually, to achieve their full potential. We are known as an organisation that encourages you to come as you are … the work you enjoy, but also through the global connections you make, the lifelong learning you accomplish, and the chance to make your mark. Are you our next Data Solution Architect? We are currently seeking to hire a Data Solution Architect at Associate Director level to join our Dublin Data & AI team. We are … AI, and business intelligence use cases. Proven experience in designing architectures for structured, semi-structured, and unstructured data , leveraging technologies like Databricks, Snowflake, Apache Kafka , and Delta Lake to enable seamless data processing and analytics. Hands-on experience in data integration , including designing and optimising data pipelines (batch and streaming) and More ❯

As the digital arm for the world's largest food and beverage company, Nestlé IT & Digital Americas harnesses the power of data, analytics, and innovative technology to deliver transformative solutions and business resiliency for Nestlé businesses and iconic brands from Purina® to Nescafé®.We’re innovators, strategic collaborators, value multipliers, and digital business leaders committed to delivering results … individuals to join, stay, and advance their careers within Nestlé. This position is not eligible for Visa Sponsorship. Position Summary: Join Nestlé USA as the Senior Director for Data Strategy & Data Fabric, where you will play a pivotal role in shaping our data vision and strategy! You will spearhead the development of Azure Data Fabric's strategic capabilities, driving alignment across internal and external data sources. Your leadership will be crucial in advancing our Data Management organization, overseeing capability investments, financial management, and forging key data partnerships that empower business analytics and foster innovation in critical areas such as Strategic Revenue Management, Digital Marketing, and Connected More ❯