1 to 25 of 62 Data Lake Jobs in the North of England

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...

Role: Senior Data Migration Engineer Location: Sheffield (3 days a week) Employment: Fulltime Role Overview We are seeking an experienced Data Migration Specialist to deliver complex enterprise data migration projects. The successful candidate will have strong SQL and Azure Data Engineering expertise … analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding ...

Salesforce Data 360 solutions in line with approved architecture, delivery standards and user stories. You’ll create and maintain Data Lake Objects, Data Model Objects, data streams, mappings, transformation logic and customer data models. • You’ll support the implementation … least 3+ years in understanding of customer data concepts including data ingestion, data streams, Data Lake Objects, Data Model Objects, identity resolution, unified profiles, segmentation and activation. • You’ll have at least 3+ years of experience building Salesforce solutions ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a key role in designing, building and maintaining a modern data environment that supports analytics, reporting and wider business decision-making. The role will focus on developing scalable data pipelines, robust data models and reliable data platforms, ensuring that data is accurate, accessible, secure and fit for purpose. This position will ...

digital content and software solutions—helping universities and colleges deliver an outstanding student experience, drive world‐class research, and enable transformational change. Our Data and Intelligence portfolio plays a vital role in everything we do. It provides the insight, analysis and evidence base that underpins our negotiations … making across the sector. In this role, you’ll contribute to a team that: Supports major licensing and negotiation activity through high‐quality data analysis, insight and intelligence Collects, processes and curates trusted datasets, enabling access to high‐quality data products for Jisc and our partners ...

Central, everything starts with our people. As one of the UK’s leading motor and home insurers, we use smart technology, data and great service to make insurance fast, fair and simple for over 1.4 million customers. We’re proud to create an environment where people feel supported … self‐testing pipelines that proactively identify processing issues or discrepancies You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Title: Senior Data Platform Engineer - Compliance Assurance Contract: 12 Months Location: Chester -3 days per week onsite Rate: Highly Competitive Status: Inside IR35 Working pattern: Fulltime About the role We are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable … Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs ...

workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets … Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets … Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...

driven by continuous improvement with a focus on great results for our customers. About the role We are looking for an experienced Data Engineer to join our Applications and DevOps team based at our Head Office on the Gateshead Quayside. As a Data Engineer … services. Experience building and maintaining data pipelines, lakehouses, and data transformations using Microsoft Fabric, Azure Data Lake, Azure Synapse, or related Azure services. Knowledge of CI/CD pipelines, version control, and DevOps practices related to data engineering. Proficiency ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

will Design and build scalable data pipelines using Databricks, PySpark, SQL, AWS Glue and Lambda. Develop and manage Data Lake solutions using Bronze, Silver, and Gold data architectures. Implement batch and real-time data processing using Spark Structured Streaming and Auto … PySpark, SQL, and Apache Spark Strong experience designing and delivering cloud-based data platforms and lakehouse architectures Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and performance tuning Experience building batch and streaming data pipelines Strong knowledge of data modelling ...

Data Manager (Data Governance) Location: Manchester (Hybrid) Contract Duration: 6 Months Working Hours: 37.5 hours per week We are looking for a proactive Data Manager to join a global travel leader's Data Governance team. This role is pivotal in supporting … years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting ...

Data Manager (Data Governance) Location: Manchester (Hybrid) Contract Duration: 6 Months Working Hours: 37.5 hours per week We are looking for a proactive Data Manager to join a global travel leader's Data Governance team. This role is pivotal in supporting … years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting ...

Title: Data Engineer Location: Liverpool, UK Salary: £65,000 - £70,000 per annum, depending on experience Job Type: Permanent, Full Time Working Hours: 37.5 hours per week, Monday to Friday, 9am to 5:30pm We are seeking a talented and experienced Data Engineer to join … innovative and collaborative Database and AI Team. In this role, you will play a key part in shaping our data strategy and driving business success. Your skills will contribute directly to our forward-thinking initiatives. At Acorn we value and prioritise innovation, teamwork, and continuous development. Key part ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...