1 to 25 of 459 Data Lake Jobs in England

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data* Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools.In addition to these core skills, you should have specialist experience in one or more of the following ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

Role: Senior Data Migration Engineer Location: Sheffield (3 days a week) Employment: Fulltime Role Overview We are seeking an experienced Data Migration Specialist to deliver complex enterprise data migration projects. The successful candidate will have strong SQL and Azure Data Engineering expertise … analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding ...

Role Overview We are looking for an experienced Data Architect with strong expertise in Data Modelling, Data Warehousing, Data Lakes, ETL, and Enterprise Data Platforms, along with deep knowledge of the Pharma/Life Sciences domain, particularly … maintain enterprise data architectures, data models, schemas, and integration frameworks. Develop scalable data warehouse, data lake, and cloud-based data solutions. Lead data migration, ETL/ELT, data quality, and data integration initiatives. ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

responsible for turning raw transport business unit data into actionable insights. This includes feeding the overarching Arrive Group Data Lake, developing Business Intelligence (BI) SaaS offerings for public transit authorities (B2G), and exploring AI capabilities to drive quality and operational efficiency. Core Responsibilities Generic Responsibilities … will create operational dashboards for internal monitoring and client-facing dashboards that translate complex transit data into actionable insights. Data Lake Integration: Lead the integration of the BU Transport's data streams into the global Arrive Group Data Lake, ensuring ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice. Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous. Understanding of data governance, security, access control, data quality and data lifecycle ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

Senior Data Engineer Who we areArtefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud … optimise task efficiency. Strong communication and interpersonal skills. Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse. Preferred Qualifications: Certifications in Azure, AWS, or GCP.Certifications in Databricks, Snowflake or similar technologies. Experience ...

business objectives, enterprise architecture standards and regulatory requirements Architecting and delivering modern data platforms leveraging Azure technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/… solutions within a regulated environment Deep expertise in the Microsoft Azure Data Platform, including services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale ...

business objectives, enterprise architecture standards and regulatory requirements Architecting and delivering modern data platforms leveraging Azure technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/… solutions within a regulated environment Deep expertise in the Microsoft Azure Data Platform, including services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale ...

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. … leading large scale data engineering projects. Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse. Demonstrated experience with Infrastructure as Code tooling such as Terraform Why Joining Artefact? Build the Future ...

Data Engineering Lead Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: Birmingham Description We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This … experience with Microsoft Azure data technologies, including: Azure Data Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable ...

Perform data profiling, root cause analysis, and data quality assessments. Develop and optimise data warehouse, data lake, and lakehouse solutions. Produce source-to-target mappings, transformation rules, and technical documentation. Support data governance, security, and compliance requirements. Work collaboratively … Functions Amazon QuickSight Strong practical experience with: Microsoft Fabric Strong knowledge of: ETL and ELT design patterns Data Warehousing Data Lake and Lakehouse architectures Data Profiling Data Quality Management Data Validation and Reconciliation Additional Information We pride ourselves ...

Data Engineer - Warrington Data Engineer with excellent experience in data engineering, data development, data integrations, SQL, Python, data warehousing, & Azure data platforms is required by a leading company near Warrington. Any experience with Snowflake, Kimball, Databricks … schema design. * Experience building and maintaining ETL/ELT processes. Desirable Skills: * Databricks experience. * Azure Data Platform technologies, Azure Data Lake, Azure Analysis Services. * Snowflake, ThoughtSpot. * Knowledge of Kimball and Inmon data warehousing methodologies. * Exposure to AI-assisted development tools and modern ...