1 to 25 of 61 Data Lake Jobs in the North of England

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

transformation, storage, and consumption layers. Provide technical leadership for Azure-based data platforms, including Databricks, Data Factory, Data Lake, and analytics solutions. Collaborate with Product Managers, Engineers, Analysts, and business stakeholders to translate requirements into robust technical solutions. Own solution architecture reviews … scale Data & Analytics solutions. Strong expertise in Microsoft Azure services including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Azure SQL, and related data services. Deep understanding of modern data architectures including Data Lakes ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

following: distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front … following:Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front ...

following: distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front … following:Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

Will Be Working With As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that power analytics, AI, GenAI and increasingly agentic systems. You'll work hands‐on with modern data … Specialist tracks (we'd love depth in one of these; you don't need all of them) Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

authority to act as the ultimate point of technical escalation Exposure to a modern Microsoft data environment, including Azure Data Lake, Databricks, Azure SQL and Python The chance to improve data pipelines, medallion architecture, governance, quality and engineering practices Significant visibility across technology … services The ability to engage and influence a diverse range of technical and non-technical stakeholders Strong experience across Azure Data Lake, Databricks, Azure SQL and Python A good understanding of data pipelines, medallion architecture and modern data platform design Knowledge ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Description You will play a critical role as part of a small specialist to design, build and enhance data pipelines using Microsoft Fabric. With strong collaboration and analytical skills, you will work with the business to provide data solutions to meet business needs. Essential Skills: Strong … OLTP and OLAP architectures and data modelling principles. Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage. Sound knowledge of ETL/ELT best practices. Strong analytical and problem-solving skills with a focus ...

Azure-based data solutions Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric Proven experience with infrastructure-as-code using Terraform Experience building CI/CD pipelines via Azure DevOps … Industry Keywords Healthcare Insurance Enterprise Data Platform Advanced Analytics Business Intelligence Tools & Technologies Azure Data Factory Azure Data Lake Azure ML Power BI GitHub #J-18808-Ljbffr ...

government/publications/united-kingdom-security-vetting-clearance-levels Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy … governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks ...

days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you'll blend hands-on engineering … with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client's strategic objectives. Additionally, you'll play ...

Firm PA Consulting Location Manchester, United Kingdom Full-time Benefits Competive Functional areas Data Science Why consider joining our Digital & Data community? Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range of other experts … business needs into scalable, resilient, and secure data solutions. Our tech stack Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe’re looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you’ll blend hands … engineering with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client’s strategic objectives. Additionally ...

edge manufacturing, turning abstract ideas into realities that transform the world for good. Your impact This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...