1 to 25 of 567 Data Lake Jobs

of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. FS Technology Consulting - AI and Data - Data Engineer - Senior Consultant/Manager - Dublin/Cork/Limerick/Galway General Information Location: Dublin, Cork, Limerick, or Galway. Available for VISA Sponsorship: No Business … Platforms: Microsoft: Experience with Azure Data Factory for orchestrating data workflows. Proficiency in Azure Synapse Analytics and SQL Server. Familiarity with Azure Data Lake Storage (Gen2) and Azure Blob Storage. Knowledge of Power BI integration and data modelling Understanding of Azure Functions and Logic Apps for automation. Snowflake: Strong SQL skills … based transformations. Understanding of role-based access control, data masking, and time travel features. Databricks: Hands-on experience with Apache Spark and Databricks Runtime. Proficiency in Delta Lake for ACID-compliant data lakes. Experience with Structured Streaming and Auto Loader. Familiarity with MLflow, Feature Store, and Model Registry. Use of Databricks notebooks for collaborative development More ❯

Duration: 6 Month Job Description: The Senior Developer will be part of the Enterprise Risk Business Technology Office. This role will be responsible for supporting our organization's data-driven initiatives, specifically designing and building a data warehouse solution. This position requires strong experience in data analysis, modeling and engineering with the ability to … to work independently and in a team environment Experience: 5 years' extensive knowledge and experience in the Data technologies for Data Analytics, Data Lake/Mart/Warehouse, Databases SQL/NoSQL (DB2, Mongo, Postgres), Big Data Technologies (Spark or PySpark), ETL (Informatica, Talend), REST API, Integration/EAI technologies like … database technologies such as DB2, PostgreSQL, Snowflake Knowledge of data warehousing and business intelligence concepts including data mesh, data fabric, data lake, data warehouse, and data marts Skills: Python PySpark Informatica SQL Education: Bachelor's degree in computer science, information technology or related field; advanced studies/ More ❯

Senior BI Architect Birmingham Reporting into the CTI as a key member of our newly formed Data Engineering team, the Senior BI Architect will lead the design, development, and ongoing … enhancement of data and reporting infrastructure. You will be the strategic owner of our Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role combines technical leadership, agile delivery, and stakeholder engagement to drive data-driven decision … data platform Manage the BI function and ensure alignment with business goals Platform Ownership & Governance Administer and govern the Azure Fabric Platform, including: Azure Data Lake & Data Warehouse (storage) Azure Data Factory (data integration) Databricks (data transformation and modelling) Power BI (analytics and dashboards) Ensure data More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

are paid on a bi-weekly basis and have the option to access up to 70% of their earned wages on demand, any day of the week. *The Data Engineer III* translates data and information analytic requirements into an information systems data repository/business intelligence system that supports end user data … of full-time professional experience with progressive responsibility in modern data platform design, API integration, real-time streaming, and message brokering, in addition to data lake/warehouse solution design and development, is required. Experience must include: * Three years of experience writing SQL; * Extensive background building and delivering data warehouse or data lake solutions using Oracle and/or Microsoft technologies such as Oracle Autonomous Data Warehouse, Azure Data Lake, Data Factory, Microsoft Fabric Synapse Analytics, and Power BI; * Two years of experience leading technology-based projects and experience with large databases or data warehouses in an online production environment. More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Arcitecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

the Role We re working with a market-leading organisation that s undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you ll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … is used across Finance, Operations, and Commercial functions. What You ll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory … Oversee the migration from legacy tools (Domo, Vecta) to the new Power BI ecosystem. What You ll Bring Technical Skills Strong hands-on experience with Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Advanced skills in data modelling (conceptual, logical, physical) and SQL for complex transformations. Proven ability to design More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory … Oversee the migration from legacy tools (Domo, Vecta) to the new Power BI ecosystem. What You'll Bring Technical Skills Strong hands-on experience with Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Advanced skills in data modelling (conceptual, logical, physical) and SQL for complex transformations. Proven ability to design More ❯

modelling with considerations in challenging and verifying data quality and accuracy. Lead the addition of new data sources to the Data Lake from 3rd party sources. Assisting with understanding internal customer requirements, technical design, and estimation. Lead ETL, common data structures and business intelligence architectures. Operate in a support … degree in Computer Science, or related Information Technology subject. 3+ years experience working with cloud infrastructure and data modelling (SQL database, data warehouse, SQL servers, datalake storage and lakehouses, structured and unstructured data) Significant experience working with Azure Data Factory and LogicApps creating pipelines ingesting data from multiple sources Advanced … T-SQL skills and Python essential Experience of Azure cloud stack services – Dynamics D365, Databases, Warehouses, Storage, Datalake, Power Automate, Data Factory, Visual Studio, Devops, Power BI, MS Fabric Strong interest in analytics, data architecture and modelling. Experience of enterprise software, Azure Cloud apps, databases, data models. Understanding of Business Intelligence services and data More ❯

modelling with considerations in challenging and verifying data quality and accuracy. Lead the addition of new data sources to the Data Lake from 3rd party sources. Assisting with understanding internal customer requirements, technical design, and estimation. Lead ETL, common data structures and business intelligence architectures. Operate in a support … degree in Computer Science, or related Information Technology subject. 3+ years experience working with cloud infrastructure and data modelling (SQL database, data warehouse, SQL servers, datalake storage and lakehouses, structured and unstructured data) Significant experience working with Azure Data Factory and LogicApps creating pipelines ingesting data from multiple sources Advanced … T-SQL skills and Python essential Experience of Azure cloud stack services – Dynamics D365, Databases, Warehouses, Storage, Datalake, Power Automate, Data Factory, Visual Studio, Devops, Power BI, MS Fabric Strong interest in analytics, data architecture and modelling. Experience of enterprise software, Azure Cloud apps, databases, data models. Understanding of Business Intelligence services and data More ❯

Embark on a transformative journey as an Enterprise Data Architect. At Barclays, our vision is clear: to define, direct and govern the bank's target data architecture (inc. shared data environment, data model and standards) in support of business strategy, ensuring that data is accurate, secure and accessible to meet … as an Enterprise Data Architect, you should have experience with: Developing architectural solutions and patterns using latest data engineering approaches, for example data lake, events, API Ability to logically model financial data Excellent written communications skills with experience using structured design languages, for example UML, Archimate or equivalent Some other highly … valued skills may include: Good stakeholder management skills up to C-level execs Understanding of data governance and data management processes and best practice You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well More ❯

client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. The technical focus is all Microsoft, primarily Azure so any Fabric experience would be very beneficial. Our … transformation being driven by technology. Skills & experience required: Experience leading a BI function Expertise in Azure BI architecture and Cloud services Hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities Experience in leading a BI team and a … business through the development and transition to a Data Lake/Factory/Warehouse Technical BI background Benefits: Generous and achievable bonus scheme 4% Pension Life Insurance 3 x salary 25 days annual leave plus statutory - 1 x extra day every year for the first 3 years Blue Light Card Medicash - includes discounted gym memberships etc. If More ❯

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … create high-quality data assets that are stable, scalable and re-useable. Experience developing and deploying data pipelines within an AWS S3 Data Lake using VS Code, Glue, Lambda, Git Hub and Terraform Experience with/understanding of a wide variety of analytics tools such as SQL, Alteryx, AWS Sagemaker, Quicksight, Tableau and … PowerBI Desirable: Experience using Lake Formation Experience with AWS Kinesis/Firehose for real-time data pipelines Experience of rail, airline or leisure industry Experience with data warehousing and AWS Redshift Why Join? This is a unique opportunity to join a forward-thinking organisation investing heavily in its data capability. You’ll be More ❯

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … create high-quality data assets that are stable, scalable and re-useable. Experience developing and deploying data pipelines within an AWS S3 Data Lake using VS Code, Glue, Lambda, Git Hub and Terraform Experience with/understanding of a wide variety of analytics tools such as SQL, Alteryx, AWS Sagemaker, Quicksight, Tableau and … PowerBI Desirable: Experience using Lake Formation Experience with AWS Kinesis/Firehose for real-time data pipelines Experience of rail, airline or leisure industry Experience with data warehousing and AWS Redshift Why Join? This is a unique opportunity to join a forward-thinking organisation investing heavily in its data capability. You’ll be More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to 75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to 75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Beneifts Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

senior leaders/technologists across the company and customer community. Northrop Grumman Defense Systems Sector Strategic Deterrent Systems Division is seeking an NG Fellow 1 SDS Division Chief Data Engineer who will play an instrumental role in developing, evolving, and leading technological strategy in this skill area for the broader organization .This position will be located in Roy … Utah. This role may offer a competitive relocation assistance package. General responsibilities may include but are not limited to: Develop and execute a comprehensive data strategy, aligned with the organization's goals, and focuses on digital engineering, digital thread, and advanced analytics across weapon system design, manufacturing, and sustainment. Oversee the design, implementation, and maintenance of scalable data infrastructure, to include data creation/collection, storage, management, integration and analysis, and data serving through modern technology. Lead and govern the use of the Program data infrastructure and capabilities to ensure seamless data flow and traceability across engineering, supply chain, and operational systems to include functional allocated and product More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data … pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data … You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as More ❯