1 to 25 of 48 Permanent Data Lake Jobs in the North of England

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

following: distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front … following:Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front ...

following: distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front … following:Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

authority to act as the ultimate point of technical escalation Exposure to a modern Microsoft data environment, including Azure Data Lake, Databricks, Azure SQL and Python The chance to improve data pipelines, medallion architecture, governance, quality and engineering practices Significant visibility across technology … services The ability to engage and influence a diverse range of technical and non-technical stakeholders Strong experience across Azure Data Lake, Databricks, Azure SQL and Python A good understanding of data pipelines, medallion architecture and modern data platform design Knowledge ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Azure-based data solutions Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric Proven experience with infrastructure-as-code using Terraform Experience building CI/CD pipelines via Azure DevOps … Industry Keywords Healthcare Insurance Enterprise Data Platform Advanced Analytics Business Intelligence Tools & Technologies Azure Data Factory Azure Data Lake Azure ML Power BI GitHub #J-18808-Ljbffr ...

government/publications/united-kingdom-security-vetting-clearance-levels Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy … governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks ...

days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you'll blend hands-on engineering … with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client's strategic objectives. Additionally, you'll play ...

Firm PA Consulting Location Manchester, United Kingdom Full-time Benefits Competive Functional areas Data Science Why consider joining our Digital & Data community? Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range of other experts … business needs into scalable, resilient, and secure data solutions. Our tech stack Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe’re looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you’ll blend hands … engineering with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client’s strategic objectives. Additionally ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

Corecom Consulting is seeking a Contract Data Engineer to transform a legacy SQL data warehouse into a modern cloud-native AWS platform. … role is Outside IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from ...

strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Why consider joining our Digital & Data community? ð Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams … looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … analytical skills.Proficiency in object orientated programming languages such as Python, Java, or Scala.Contributing to the solution architecture of an enterprise data lake to cater to a client's data storage needs for structured and unstructured data, to enable analytics across global clients using ...

love making it sparkle for millions of Very customers. About the RoleYou'll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation.You'll work across multiple initiatives, partnering with … decision-making. You'll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very.You'll help drive the future of data engineering at Very by:Providing technical leadership across multiple teams and initiatives.Designing scalable ...

love making it sparkle for millions of Very customers. About the Role You’ll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You’ll work across multiple initiatives … decision-making. You’ll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very. You’ll help drive the future of data engineering at Very by: Providing technical leadership across multiple teams and initiatives. ...

technology, process, and structure to make a lasting impact.At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies.Based out of any of our UK offices, this ...