1 to 25 of 495 Permanent Data Lake Jobs

of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. FS Technology Consulting - AI and Data - Data Engineer - Senior Consultant/Manager - Dublin/Cork/Limerick/Galway General Information Location: Dublin, Cork, Limerick, or Galway. Available for VISA Sponsorship: No Business … Platforms: Microsoft: Experience with Azure Data Factory for orchestrating data workflows. Proficiency in Azure Synapse Analytics and SQL Server. Familiarity with Azure Data Lake Storage (Gen2) and Azure Blob Storage. Knowledge of Power BI integration and data modelling Understanding of Azure Functions and Logic Apps for automation. Snowflake: Strong SQL skills … based transformations. Understanding of role-based access control, data masking, and time travel features. Databricks: Hands-on experience with Apache Spark and Databricks Runtime. Proficiency in Delta Lake for ACID-compliant data lakes. Experience with Structured Streaming and Auto Loader. Familiarity with MLflow, Feature Store, and Model Registry. Use of Databricks notebooks for collaborative development More ❯

Duration: 6 Month Job Description: The Senior Developer will be part of the Enterprise Risk Business Technology Office. This role will be responsible for supporting our organization's data-driven initiatives, specifically designing and building a data warehouse solution. This position requires strong experience in data analysis, modeling and engineering with the ability to … to work independently and in a team environment Experience: 5 years' extensive knowledge and experience in the Data technologies for Data Analytics, Data Lake/Mart/Warehouse, Databases SQL/NoSQL (DB2, Mongo, Postgres), Big Data Technologies (Spark or PySpark), ETL (Informatica, Talend), REST API, Integration/EAI technologies like … database technologies such as DB2, PostgreSQL, Snowflake Knowledge of data warehousing and business intelligence concepts including data mesh, data fabric, data lake, data warehouse, and data marts Skills: Python PySpark Informatica SQL Education: Bachelor's degree in computer science, information technology or related field; advanced studies/ More ❯

Senior BI Architect Birmingham Reporting into the CTI as a key member of our newly formed Data Engineering team, the Senior BI Architect will lead the design, development, and ongoing … enhancement of data and reporting infrastructure. You will be the strategic owner of our Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role combines technical leadership, agile delivery, and stakeholder engagement to drive data-driven decision … data platform Manage the BI function and ensure alignment with business goals Platform Ownership & Governance Administer and govern the Azure Fabric Platform, including: Azure Data Lake & Data Warehouse (storage) Azure Data Factory (data integration) Databricks (data transformation and modelling) Power BI (analytics and dashboards) Ensure data More ❯

Summary As a Senior Data Engineer on the Data Engineering team, you will provide expert leadership in Snowflake cloud data warehouse modeling, design, deployment, and maintenance of the data engineering framework that supports the enterprise's data needs both internally and externally. You will play a key role in advancing … data analytics initiatives by designing, building, and managing data ingestion, transformation, and maintenance processes to ensure the delivery of accurate and reliable data across Snowflake and on-premises environments. Additionally, you will drive continuous improvement of data engineering operations by innovating and developing self-service automation tools that enhance efficiency and simplify … data from multiple data sources, such as SQL, NoSQL, other platform APIs, and load into a centralized data warehouse/data lake to facilitate unified reporting Extensive experience working in Snowflake's data cloud environment Working knowledge and understanding Snowflake's features for data engineering, analytics, AI More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

modelling with considerations in challenging and verifying data quality and accuracy. Lead the addition of new data sources to the Data Lake from 3rd party sources. Assisting with understanding internal customer requirements, technical design, and estimation. Lead ETL, common data structures and business intelligence architectures. Operate in a support … degree in Computer Science, or related Information Technology subject. 3+ years experience working with cloud infrastructure and data modelling (SQL database, data warehouse, SQL servers, datalake storage and lakehouses, structured and unstructured data) Significant experience working with Azure Data Factory and LogicApps creating pipelines ingesting data from multiple sources Advanced … T-SQL skills and Python essential Experience of Azure cloud stack services – Dynamics D365, Databases, Warehouses, Storage, Datalake, Power Automate, Data Factory, Visual Studio, Devops, Power BI, MS Fabric Strong interest in analytics, data architecture and modelling. Experience of enterprise software, Azure Cloud apps, databases, data models. Understanding of Business Intelligence services and data More ❯

modelling with considerations in challenging and verifying data quality and accuracy. Lead the addition of new data sources to the Data Lake from 3rd party sources. Assisting with understanding internal customer requirements, technical design, and estimation. Lead ETL, common data structures and business intelligence architectures. Operate in a support … degree in Computer Science, or related Information Technology subject. 3+ years experience working with cloud infrastructure and data modelling (SQL database, data warehouse, SQL servers, datalake storage and lakehouses, structured and unstructured data) Significant experience working with Azure Data Factory and LogicApps creating pipelines ingesting data from multiple sources Advanced … T-SQL skills and Python essential Experience of Azure cloud stack services – Dynamics D365, Databases, Warehouses, Storage, Datalake, Power Automate, Data Factory, Visual Studio, Devops, Power BI, MS Fabric Strong interest in analytics, data architecture and modelling. Experience of enterprise software, Azure Cloud apps, databases, data models. Understanding of Business Intelligence services and data More ❯

Embark on a transformative journey as an Enterprise Data Architect. At Barclays, our vision is clear: to define, direct and govern the bank's target data architecture (inc. shared data environment, data model and standards) in support of business strategy, ensuring that data is accurate, secure and accessible to meet … as an Enterprise Data Architect, you should have experience with: Developing architectural solutions and patterns using latest data engineering approaches, for example data lake, events, API Ability to logically model financial data Excellent written communications skills with experience using structured design languages, for example UML, Archimate or equivalent Some other highly … valued skills may include: Good stakeholder management skills up to C-level execs Understanding of data governance and data management processes and best practice You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well More ❯

client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. The technical focus is all Microsoft, primarily Azure so any Fabric experience would be very beneficial. Our … transformation being driven by technology. Skills & experience required: Experience leading a BI function Expertise in Azure BI architecture and Cloud services Hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities Experience in leading a BI team and a … business through the development and transition to a Data Lake/Factory/Warehouse Technical BI background Benefits: Generous and achievable bonus scheme 4% Pension Life Insurance 3 x salary 25 days annual leave plus statutory - 1 x extra day every year for the first 3 years Blue Light Card Medicash - includes discounted gym memberships etc. If More ❯

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … create high-quality data assets that are stable, scalable and re-useable. Experience developing and deploying data pipelines within an AWS S3 Data Lake using VS Code, Glue, Lambda, Git Hub and Terraform Experience with/understanding of a wide variety of analytics tools such as SQL, Alteryx, AWS Sagemaker, Quicksight, Tableau and … PowerBI Desirable: Experience using Lake Formation Experience with AWS Kinesis/Firehose for real-time data pipelines Experience of rail, airline or leisure industry Experience with data warehousing and AWS Redshift Why Join? This is a unique opportunity to join a forward-thinking organisation investing heavily in its data capability. You’ll be More ❯

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … create high-quality data assets that are stable, scalable and re-useable. Experience developing and deploying data pipelines within an AWS S3 Data Lake using VS Code, Glue, Lambda, Git Hub and Terraform Experience with/understanding of a wide variety of analytics tools such as SQL, Alteryx, AWS Sagemaker, Quicksight, Tableau and … PowerBI Desirable: Experience using Lake Formation Experience with AWS Kinesis/Firehose for real-time data pipelines Experience of rail, airline or leisure industry Experience with data warehousing and AWS Redshift Why Join? This is a unique opportunity to join a forward-thinking organisation investing heavily in its data capability. You’ll be More ❯

Sr. Epic Data Engineer Perm/FTE Position Prefer local to Atlanta, but open to remote in one of the following state:AL, AR, FL, GA, IL, LA, MI, NH, NC, OH, PA, SC, TN, TX, VA, or WI Our client, a large healthcare provider, is seeking a dynamic and experienced Senior Epic Data Engineer to … join this team. This role is responsible for designing, developing, and implementing data architecture solutions using the Epic Clarity & Caboodle stack. The Senior Data Engineer will play a key leadership role by mentoring junior engineers, collaborating with cross-functional teams, and contributing to the ongoing evolution of our enterprise data architecture. The ideal candidate … Experience Requirements: Minimum 6 years of experience with: SQL and NoSQL database systems ETL/ELT tools (including SSIS and SSAS) Data warehousing and data lake architecture Data modeling and governance in on-prem and cloud environments Experience with: Epic Rev Cycle, Clinical Data Models & Access Data Models - specifically More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL … . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data … A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to 75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to 75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Beneifts Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … Responsibilities Design, build, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory, Databricks, and related tools. Expand the existing data lake and warehouse to include new domains such as supply chain, marketing, finance, and customer data. Develop and optimise ETL/ELT processes to integrate data from diverse … a Data Engineer (6+ years), ideally within a large-scale or global organisation. Strong expertise in the Azure data ecosystem, including: Azure Data Lake/Data Lakehouse Azure Data Factory/Synapse Pipelines Databricks Azure SQL Database or Synapse Analytics Solid understanding of data warehousing principles, ETL More ❯

senior leaders/technologists across the company and customer community. Northrop Grumman Defense Systems Sector Strategic Deterrent Systems Division is seeking an NG Fellow 1 SDS Division Chief Data Engineer who will play an instrumental role in developing, evolving, and leading technological strategy in this skill area for the broader organization .This position will be located in Roy … Utah. This role may offer a competitive relocation assistance package. General responsibilities may include but are not limited to: Develop and execute a comprehensive data strategy, aligned with the organization's goals, and focuses on digital engineering, digital thread, and advanced analytics across weapon system design, manufacturing, and sustainment. Oversee the design, implementation, and maintenance of scalable data infrastructure, to include data creation/collection, storage, management, integration and analysis, and data serving through modern technology. Lead and govern the use of the Program data infrastructure and capabilities to ensure seamless data flow and traceability across engineering, supply chain, and operational systems to include functional allocated and product More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data … pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data … You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data … pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data … You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯