76 to 100 of 385 Data Lake Jobs in England

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

Responsibilities Design, deliver, and support Data, AI, and automation solutions, including analytics, models, dashboards, and related platforms. Own the roadmap for trusted data foundations across BIS and divisions, covering master/reference data, data quality, governance, cataloguing, traceability, and access controls. Provide … data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately ...

Senior Data Engineer Department: Services Employment Type: Permanent Location: Remote, UK Description We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible … Data Factory, Azure Databricks). Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance … pipelines using Azure Data Factory and Databricks. Implement data models and analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data lakes, and integration solutions. Define and maintain data standards, frameworks, and best practices. Ensure the organisation's data architecture aligns with strategic business objectives. Lead data migration and transformation initiatives. Leadership & Management Provide technical leadership and mentoring to Data Engineers ...

real business value. You'll play a key role in expanding our Microsoft Fabric capability, supporting the evolution of our enterprise data lake, and helping prepare EWR for the next generation of AI-powered decision making. What you’ll be doing Working closely with our Azure Data … Create engaging and insightful Power BI dashboards that support operational and strategic decision making. Help develop and mature EWR's enterprise data lake, ensuring data is governed, accessible and AI-ready. Support the development of Fabric Data Agents , Microsoft Foundry solutions ...

Title: Senior Data Platform Engineer - Compliance Assurance Contract: 12 Months Location: Chester -3 days per week onsite Rate: Highly Competitive Status: Inside IR35 Working pattern: Fulltime About the role We are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable … Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real … data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ...

seeking an experienced Enterprise Data Architect to define and lead the organisation's target-state data architecture, ensuring our data landscape supports business growth, operational excellence, regulatory compliance, and future AI-driven innovation. This is a strategic role at the heart of our data … management, finance, CRM, analytics, and AI platforms. Working closely with senior technology and business leaders, you will help shape a scalable and sustainable data ecosystem that reduces integration complexity, improves data accessibility, and enables advanced analytics and predictive capabilities. What you will do? As our Enterprise ...

JOIN OUR TALENT NETWORK At Mariner, we're continuously building our network of talented Data Engineering professionals for upcoming client engagements across various industries, including healthcare, government, energy, utilities, financial services, and enterprise technology. If you're passionate about designing scalable data solutions, modernizing data platforms, and enabling data-driven decision-making, we'd love to connect with you for current and future opportunities. WHAT YOU’LL BE DOING IN THE ROLE: As a Data Engineering Specialist, you may be responsible for: Designing, building, and maintaining scalable data ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You’ll work with a modern, cutting‐edge data stack and play a key role in shaping data … design within a modern cloud‐based environment Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

About the role As a Data Engineer at Tecknuovo, you will design, build and maintain reliable data solutions that enable our customers to make better use of their data. Working as part of multidisciplinary delivery teams, you will turn complex requirements into scalable data … solutions using Databricks or Snowflake, alongside AWS and/or Azure cloud platforms. You will have experience delivering new data lake patterns or helping to transform existing data lake environments, with a strong understanding of how to build scalable, secure and maintainable ...

Powering Progress strategy on the journey to net-zero emissions. Achieving this ambition requires uniting Shell's strategic and technical expertise across data, strategy, architecture, and innovation. This integration is essential to drive the transformative shifts needed in IT. As part of this journey, we are seeking … driven architecture (event hub, event bus, Kafka), ELKIntermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQLIntegration experience with Confluent/Kafka, API Management, Logic AppsCI/CD & DevOps: Brings substantial experience ...

global community. Our employees dedicate their time to helping our clients transform their business, from strategy through implementation and business transformation. As a Data Solutions Architect , you will lead the strategy, architecture and delivery of enterprise-scale data and analytics solutions for our clients. Working across … data architecture, software engineering, cloud platforms, analytics engineering and client advisory, you will translate business priorities into secure, scalable, well-governed and cost-effective solutions. You will partner with executive stakeholders, business leaders and technical teams to define data roadmaps and target-state architectures, evaluate technology ...