51 to 75 of 416 Data Lake Jobs

environment that’s empowering, collaborative, and full of opportunities to turn today’s challenges into tomorrow’s solutions.Job DescriptionWavestone is seeking a Data Architect or Data Engineer to support the design and delivery of innovative data solutions for clients operating in complex, regulated environments … including Banking, Insurance, Wealth & Asset Management, and Life Sciences.In this client-facing role, you will work with business and technology stakeholders to define data architectures, build scalable data platforms and pipelines, and establish strong data governance practices. You will help organisations unlock the value ...

Bank House, Birmingham, LondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 467117-en\_GB## **Who You'll Be Working With**As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … strong understanding of data warehousing, dimensional modelling, and lakehouse concepts.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage/ADLS Gen2, Microsoft Fabric (OneLake, Workspaces, Capacity), Azure Synapse and/or SQL, and Azure Data Factory.* Excellent problem-solving ...

data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi … security features (IAM, KMS, RBAC). Knowledge of Azure data engineering tools (ADF, Azure DB, Azure Synapse, Azure Data Lake, Azure Monitor) for hybrid migration scenarios. Proficiency with cloud automation/orchestration tools such as Terraform and Airflow. Strong analytical skills to assess data ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard. The role will involve ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark, and SQL to design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have … Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

transformation, and integration processes. Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments. Business Logic Development: Implement business logic, calculations, and data processing solutions using Python. Collaboration: Work closely with business stakeholders … analytical and problem-solving skills. Excellent stakeholder management and communication skills. Highly Desirable: Experience with Spark/PySpark. Familiarity with Azure Data Lake, Snowflake, or similar platforms. Knowledge of orchestration tools like Airflow or Azure Data Factory. Exposure to financial services environments. Experience supporting large ...

team you'll be working with:We are seeking a detail-oriented and capable Data Migration Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud-based data … especially AWS GluePython/PySparkSQL querying and validationYAML configuration (desirable)Experience testing or supporting:ETL/ELT pipelinesData migration processesFamiliarity with:Data lake/Lakehouse concepts (e.g., Apache Iceberg)Distributed processing frameworks (e.g., Spark)Basic understanding of:ETL vs ELT approachesCloud-based data architecturesExposure ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data … support analytics, reporting, and domain-owned data products.Primary Skills• Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.• Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka.• Experience integrating legacy data sources such as DB2 (mainframe ...

DescriptionSenior Data and AI EngineerMake Power for GoodRES is the world's largest independent renewable energy company. Our mission is simple: a future where everyone has access to affordable, zero-carbon energy. The problems we're solving are among the most important of our generation — and the people … BringAzure Fabric data platform — deep expertise across Azure Data Factory, Synapse, Microsoft Fabric, Purview, Unity Catalogue, and Data Lake/Lakehouse architectures.Python — advanced proficiency including open-source data libraries, frameworks, and production pipeline development.SQL — expert-level for data modelling ...

DescriptionSenior Data and AI EngineerMake Power for GoodRES is the world's largest independent renewable energy company. Our mission is simple: a future where everyone has access to affordable, zero-carbon energy. The problems we're solving are among the most important of our generation — and the people … BringAzure Fabric data platform — deep expertise across Azure Data Factory, Synapse, Microsoft Fabric, Purview, Unity Catalogue, and Data Lake/Lakehouse architectures.Python — advanced proficiency including open-source data libraries, frameworks, and production pipeline development.SQL — expert-level for data modelling ...

DescriptionSenior Data and AI EngineerMake Power for GoodRES is the world's largest independent renewable energy company. Our mission is simple: a future where everyone has access to affordable, zero-carbon energy. The problems we're solving are among the most important of our generation — and the people … BringAzure Fabric data platform — deep expertise across Azure Data Factory, Synapse, Microsoft Fabric, Purview, Unity Catalogue, and Data Lake/Lakehouse architectures.Python — advanced proficiency including open-source data libraries, frameworks, and production pipeline development.SQL — expert-level for data modelling ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

consult and define the people we want to join us on our journey.Responsible for extending and supporting the data lake and data warehouse that underpin reporting and analytics solutions within the corporate Digital team by ingesting, integrating and transforming data from multiple sources.The … Data Engineer will work collaboratively with data architects, analysts, business SMEs, Digital project teams and technology partners to translate business and data requirements into reliable, scalable and maintainable technical solutions. This role will also support the transition of data engineering deliverables into ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

seeking an experienced Enterprise Data Architect to join a major transformation programme within a complex enterprise environment. You will be responsible for defining and delivering the organisation’s data architecture strategy, enabling improved decision-making, operational efficiency, and governance across key business functions including Finance, Procurement … Property, and Asset Management. Working closely with Enterprise Architecture and Data & AI teams, you will design scalable data models, integration patterns, and governance frameworks that support the full asset lifecycle and future business growth. Key Responsibilities Design end-to-end data architecture across ...

Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients.Location: London, United Kingdom (Hybrid)Scope: UK-Based Role with Global Client & Delivery RemitReporting … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake.Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data quality ...

Position: Senior Data Engineer Sector: Automotive Location: Gothenburg, Sweden Position Type: Contract or Permanent *Applicants MUST have proof of immediate, on-going and valid eligibility to work full time in Sweden* About the company Contechs are recruiting on behalf of their client who builds on a strong legacy … team, we are looking for an individual who shares our passion for technology and possesses a customer focused mindset. You will join the Data Solutions and Products team as part of a Cloud Platform and Data. The team is now aiming to build and operate a strategic ...

pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence – all powered by advanced technology, data, AI and digital innovation. Clients value Baringa’s collaborative approach and the way its teams integrate seamlessly – all working with a shared understanding … . What you will be doing Defining and implementing on premise or cloud architectures, (e.g. a cloud data warehouse, data lake or data platform) to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

team you'll be working with:We are seeking an accomplished and detail-oriented Lead Data Migration Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data … validating:End-to-end ETL/ELT pipelinesData migration workflowsFamiliarity with:Apache Iceberg and Lakehouse architecturesDistributed processing frameworks (e.g., Apache Spark)Data lake environmentsUnderstanding of:ETL vs ELT design patternsMigration performance tuningExperience with version control and CI/CD tools desirableWho we are:We’re a business ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

within large-scale, complex environments. Strong experience designing modern cloud-based data platforms using AWS. Experience designing enterprise-scale Data Lake and Lakehouse architectures. Strong knowledge of Amazon S3 storage strategies, including Bronze, Silver and Gold data layer architectures. Experience designing scalable data … designs and supporting artefacts and design scalable ingestion patterns supporting databases, APIs and file-based integrations. You be involved with defining Data Lake and Lakehouse architecture using Amazon S3, supporting Bronze, Silver and Gold data layers, as well as design transformation, orchestration and processing patterns ...