1 to 25 of 551 Permanent Data Lake Jobs

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

Job Description - Data Product Architect (15830) Data Product Architect Luton/Hybrid COMPANY When it comes to innovation and achievement there are few organisations with a better track record. Join us and you'll be able to play a big part in the success of our … stakeholders within and outside IT, the Architecture function ensures that a common technology architecture framework is defined and adopted across the organisation. The Data Product Architecture (DPA) team are responsible for both shaping the longer-term direction of Data Architecture used by the easyJet business functions … warehousing, data management etc. Familiarity with patterns, practices, and frameworks of Enterprise Architecture. Familiarity with AWS Cloud technologies and concepts like Lake House Architecture and Databricks. Extensive Data modelling experience from conceptual to logical models. Taking long term ownership of the data More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database • MongoDB • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) • A collaborative team player, approachable, self-efficient and influences a positive work environment • Demonstrates curiosity • Resilient in More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database. • MongoDB. • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.). • A collaborative team player, approachable, self-efficient and influences a positive work environment. • Demonstrates curiosity. • Resilient More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

We are looking for an experienced Cloud Data Architect to join our Data (Migration) team and drive the architecture, design, and implementation of customers modern data platforms. The ideal candidate will have extensive experience migrating traditional data warehouse technologies, including Teradata, Oracle … BW, Hadoop to modern cloud data platforms like Databricks, Snowflake, Redshift, Bigquery, or Microsoft fabric. You will be responsible for leading data platform migrations and the design and development of scalable data solutions that support our organization's strategic goals. Data Architecture … and Strategy: Lead the development and implementation of data architecture strategies that align with business objectives. Design and oversee the architecture of enterprise data warehouses, data lakes, and big data platforms. Establish best practices and standards for data modeling, integration More ❯

the cornerstone of our business. Our business model focuses on integrity, loyalty, and trust. Position Overview The MCICOM G9 Installations Analytics Support Junior Data Engineer will support the G9's Installation Analytics, Future Data Environment, and Common Output Levels of Service (COLS) program and to further … develop an ecosystem in which data is collected, stored, and processed for strategic analysis supportive of the Installations portfolio. This will include, but is not limited to, leveraging technologies to periodically update, manage, and utilize data effectively to support strategic decisions. Essential Job Function Authoritative and … non-authoritative data sources: Gather, assemble, analyze, and update authoritative and non-authoritative data, draw conclusions, develop, and utilize appropriate data collection techniques and data normalization to produce valid and reliable findings and analysis, and provide recommended solutions to improve data More ❯

the cornerstone of our business. Our business model focuses on integrity, loyalty, and trust. Position Overview The MCICOM G9 Installations Analytics Support Senior Data Engineer will support the G9's Installation Analytics, Future Data Environment, and Common Output Levels of Service (COLS) program and to further … develop an ecosystem in which data is collected, stored, and processed for strategic analysis supportive of the Installations portfolio. This will include, but is not limited to, leveraging technologies to periodically update, manage, and utilize data effectively to support strategic decisions. Essential Job Function Authoritative and … non-authoritative data sources: Gather, assemble, analyze, and update authoritative and non-authoritative data, draw conclusions, develop, and utilize appropriate data collection techniques and data normalization to produce valid and reliable findings and analysis, and provide recommended solutions to improve data More ❯

the cornerstone of our business. Our business model focuses on integrity, loyalty, and trust. Position Overview The MCICOM G9 Installations Analytics Support Senior Data Engineer will support the G9's Installation Analytics, Future Data Environment, and Common Output Levels of Service (COLS) program and to further … develop an ecosystem in which data is collected, stored, and processed for strategic analysis supportive of the Installations portfolio. This will include, but is not limited to, leveraging technologies to periodically update, manage, and utilize data effectively to support strategic decisions. Essential Job Function Authoritative and … non-authoritative data sources: Gather, assemble, analyze, and update authoritative and non-authoritative data, draw conclusions, develop, and utilize appropriate data collection techniques and data normalization to produce valid and reliable findings and analysis, and provide recommended solutions to improve data More ❯

the cornerstone of our business. Our business model focuses on integrity, loyalty, and trust. Position Overview The MCICOM G9 Installations Analytics Support Senior Data Scientist will support the G9's Installation Analytics, Future Data Environment, and Common Output Levels of Service (COLS) program and to further … develop an ecosystem in which data is collected, stored, and processed for strategic analysis supportive of the Installations portfolio. This will include, but is not limited to, leveraging technologies to periodically update, manage, and utilize data effectively to support strategic decisions. Essential Job Function Authoritative and … non-authoritative data sources: Gather, assemble, analyze, and update authoritative and non-authoritative data, draw conclusions, develop, and utilize appropriate data collection techniques and data normalization to produce valid and reliable findings and analysis, and provide recommended solutions to improve data More ❯

The consultant will lead and coordinate the end-to-end delivery of data-driven use cases into a modern data lake environment, bridging business, IT, and data engineering teams. They will play a key role in ensuring the quality, governance, and strategic alignment … of all data initiatives across multiple domains. The environment includes the migration to a cloud-based Data Lake (Azure), the rollout of governance frameworks such as Azure Purview, and the scaling of data-driven use cases in areas like Finance, Operations, and HR. … focused on data delivery and data quality Oversee the provisioning of source data into the data lake in line with architecture standards Safeguard data governance, metadata management, and compliance practices Document data flows, definitions, and outputs clearly More ❯

The consultant will lead the architecture, coordination, and delivery of scalable data-driven solutions within a modern cloud-based data lake environment (Azure). They will play a strategic role in shaping the data architecture, guiding implementation teams, and aligning technical solutions with … business needs. The environment involves the migration to a cloud-native Azure Data Lake, implementation of data governance frameworks like Azure Purview, and other overarching projects. The selected consultant will work closely with business stakeholders, data engineers, and governance teams to architect robust … enterprise standards and data strategy. Responsibilities Design and oversee end-to-end architecture of data pipelines and data lake integrations Define and enforce architectural standards and best practices across data projects Coordinate multidisciplinary teams to deliver structured, secure, and governed data More ❯

OVERVIEW: We are seeking for a talented Data Scientist/Data Engineer who is passionate about supporting National Security missions. The ideal candidate appreciates partnering with our customer and a group of intelligence and cybersecurity experts to analyze and integrate data sources and produce … custom analytics. GENERAL DUTIES: Engages and collaborates with mission partners to determine new ways to improve data discoverability, search quality, and analytic capabilities and visualization. Mines complex datasets, evaluates its utility for mission requirements, resolves data sharing issues, and enables system/data collaboration. … Interprets data studies and product reviews concerning new and existing data sources. Identifies data conversion options, data formats, data types and data extensions compatible with specific structured/unstructured data analytics. Develops data triage More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

Job summary The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal … Factory and other ETL tools. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. Take ownership of the data engineering … and other ETL tools. 4. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric. 5. Take ownership of the data More ❯

With Confluent, organizations can harness the full power of continuously flowing data to innovate and win in the modern digital world. We have a purpose that drives us to do better every day - we're creating an entirely new category within data infrastructure - data streaming. This technology will allow every organization to create experiences and use the power of data in ways that profoundly impact the way we all live. This impact is our purpose and drives us to do better every day. One Confluent. One team. One Data … join our Global Specialist Solutions Engineering team-a group dedicated to solving complex, real-time data challenges and optimizing Data Lake, Data Warehouse, and Data Analytics architectures. As a trusted technical advisor, you will collaborate closely with product management and engineering More ❯

Job Purpose and Background in summary CDP's Data Team are looking for a skilled, enthusiastic and communicative Solution Data Architect who is passionate about designing data solutions to drive companies, investors, and governments to build a thriving economy which works for people and … runs the world's only independent environmental disclosure system. As the founder of environmental reporting, we believe in transparency and the power of data to drive change. Partnering with leaders in enterprise, capital, policy and science, we surface the information needed to enable Earth-positive decisions. We helped … and regions disclose their environmental impacts in 2024. Financial institutions with more than a quarter of the world's institutional assets use CDP data to help inform investment and lending decisions. Aligned with the ISSB's climate standard, IFRS S2, as its foundational baseline, CDP integrates best-practice More ❯

Amazon Music is awash in data! To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build … and maintain automated self-service data solutions, data science models and deep dive difficult questions that provide actionable insights. We also enable measurement, personalization and experimentation by operating key data programs ranging from attribution pipelines, northstar weblabs metrics to causal frameworks. (ii) delivering exceptional … technologies like Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda. Your team will manage the data exchange store (Data Lake) and EMR/Spark processing layer using Airflow as orchestrator. You'll build our data university and partner with Product, Marketing, BI More ❯

healthcare, hospitality, telecom and other industries, helping our clients to implement technology and business transformations. Currently, N-iX seeks a dynamic VP of Data Consulting to join our CTO Office. This pivotal role combines technical consulting with team leadership, ensuring our team's capability to handle diverse data projects for Fortune 500 clients. Key Responsibilities: Develop and execute the Data Consulting GTM strategy, focusing on data services and data consulting offering (data platforms, data lakes, data warehouses, data governance, data strategy, data reporting and analytics, etc) Scale and manage a high-performing team of data architects, business analysts and engineers to deliver advanced data solutions to various clients Drive team activities, including marketing lead generation, technical pre-sales, project estimation, and short More ❯

Data Architect (Journeyman) Redstone Arsenal/Huntsville AL IPT Associates (IPTA) is passionate about providing our customers with technical solutions that satisfy their business needs. Through collaborative interactions with customers, team members, subject matter experts (SMEs), technical leaders, and partners we design practical solutions that solve real problems … Ability to solve challenging technical business problems Self-directed professionals Hunger to continually learn and grow We are looking to hire a Senior Data Architect to join our Enterprise IT Support Services Team supporting the Army Aviation and Missile Center (AvMC), Redstone Arsenal. AvMC is the Army's … the best technology today and tomorrow. Responsibilities: Translating business needs into long-term architecture solutions. Designing, developing, and maintaining the organization's future data architecture, including creating and implementing data models, data dictionaries, and data flow diagrams. Developing and implementing cloud-based More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯