1 to 25 of 30 Contract Data Lake Jobs

Data Architect & Data Lead – EPR Implementation & Digital Transformation (NHSHealthcare) Reports To: Programme Director/Chief Technology Officer Job Purpose: The Data Architect & Data Lead will be responsible for designing, building, and leading the data architecture and strategy for EPR implementation … digital transformation programmes within the NHS. This role will ensure robust data modelling, migration, repository management, and reporting solutions to support clinical and operational Key Responsibilities: 1. Data Architecture & Strategy Develop and maintain the overall data architecture for EPR and related digital transformation initiatives ...

Azure Data Factory, Azure Synapse, and other Azure services. Manage and optimize data storage solutions, including Azure Data Lake Storage and Azure SQL Data Warehouse. Develop and maintain data models and overall data architecture to enable advanced … experience with proficient SQL skills Experience of designing and implementing data solutions on Azure utilising Azure Blob Storage, Azure Data Lake Storage, Azure SQL Database and Azure Synapse Analytics Experience using Azure Data Lake Experience developing pipelines, analytics platforms and/ ...

workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance … Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

summary Working within the Data Engineering team which delivers and maintains data transfer pipelines between clinical/operational source systems and the Christie Central Data Repository (CCDR) enabling the delivery of high-quality business and complex clinical reporting structures from disparate systems. … seeking an experienced Data Architect with a strong background in data modelling and extensive experience of modern mainstream data platforms. This role will support the Data Engineering modernisation programme focused on automating data integration and building robust data ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Days Onsite per week) Job Description Looking for L3 Data Engineer | Support | Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

client is seeking an experienced Data Architect to lead the design and delivery of enterprise-grade Azure data solutions . This role will focus on building scalable, secure, and cost-optimised architectures that support ingestion, storage, modelling, and analytics across complex data landscapes. Data … landscapes and provide modernisation or migration strategies. Azure Data Platform Expertise Design and implement solutions using: Azure Data Lake Storage Gen2 Azure Synapse Analytics Azure Databricks Azure Data Factory Azure SQL/Managed Instance Azure Cosmos DB Azure Event Hub/ ...

Details Role/Job Title: Data Architect Work Location: Dublin, Ireland Role Type: Contracting Mode of Working: Hybrid/Office based The Role The Data Architect will lead the assessment and design of customer's data landscape to enable seamless integration with … Skills/Knowledge/Experience Technical Expertise: Strong knowledge of SAP S/4HANA, SAP Analytics Cloud, SAP Datasphere, and large data lake (e.g., Snowflake MDH). Experience with ETL tools, APIs, and data integration frameworks. Proficiency in data modeling and architecture design. ...

know Snowflake) Key Responsibilities: * Candidate will have extensive working knowledge on PostgreSQL, Snowflake and Greenplum databases. * Snowflake internals and integration with other data processing technologies. * Data lakes, data structures and data models suited to Snowflake architecture. * Snowflake modelling - roles, schemas and databases. … Experience of building data ingestion pipelines with tools like Informatica, Talend etc. * Effective management of data from various sources like JSON, XML, CSV etc. * Expertise in Patroni for HADR and streaming replication. * Strong knowledge of Postgres/Greenplum database backup and recovery strategies. * Proven experience ...

troubleshooting Familiar with the Agile. Well communication. Good English listening and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk … work with and manage stakeholders Desirable skills/knowledge/experience: Ability to prepare and process datasets for Power BI usage Experience with One Lake, Azure Data Lake, and distributed computing environments Understanding of financial regulations such as GDPR, SOX etc. Spark application performance tuning Knowledge ...

What you'll be doing Own the architecture for the AI/Data platform Design how Azure, Microsoft Fabric, Data Lake, ML tooling and governance all fit together Ensure scalable, secure, well-governed architecture aligned to regulatory expectations Define integration patterns with Legacy platforms … MLOps and cloud security teams Provide architectural assurance across partner and internal workstreams What you'll need Strong Azure background (Fabric, Data Lake, ADF, Databricks a plus) Deep experience designing enterprise data/AI platforms Understanding of AI governance, privacy, lineage and auditability Ability ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data … Power BI (Desktop, Service, DAX). Expertise in Data Modelling and Schema creation. Strong experience with Databricks and Azure Data Lake design. Proficiency in SQL, ETL frameworks, and database management systems. Analytical mindset with proven problem-solving abilities. Excellent communication, coaching, and teamwork skills ...

Technical Business Analyst (BA) and Architect to drive enterprise-scale digital transformation initiatives. This role combines business analysis, solution architecture, cloud architecture, and data architecture, acting as a bridge between business stakeholders and technology teams. Key Responsibilities: Business Analysis (BA): - Engage with stakeholders to gather and document business … initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm, Terraform - Ensure ...

Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high-quality, test-driven code … pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. Use Docker to manage consistent development, testing, and deployment environments. Build configurable, parameter-driven code ...

Senior Data Engineer Summer-Browning Associates is currently supporting our central government client, who is seeking a Senior Data Engineer for an initial three-month assignment with the option to extend. Location: Hybrid working - London, Bristol, Manchester, Birmingham, Newcastle, Exeter, Cambridge, Southampton The ideal candidate will … hold an active security clearance and strong experience in Data Engineering, with the following skills and qualifications: Proficiency in the Microsoft BI Stack, including Azure SQL, Fabric, Synapse Analytics, and Power BI. Experience in developing data products such as data warehouses, data ...

Azure Data Engineer (Databricks) - Must be SC Cleared (Outside IR35) Contract: 6 months Location: Newcastle Upon Tyne (2-3 days onsite per week) Expenses: Not reimbursable Domain: Public Sector Clearance: SC Clearance is mandatory Role Overview: We are seeking an experienced Azure Data Engineer with strong … experience as a Data Engineer in Azure environments. Strong hands-on expertise with Databricks and Spark. Knowledge of Azure Data Lake, Azure Synapse, and related services. Experience in Public Sector projects. SC Clearance (must be active). Must be SC Cleared Candidates ideally based ...

mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow, PyTorch … Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient ...

Data Platform Engineer - ADF, Terraform, Synapse, Spark £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Data Platform Engineer with hands on expertise in Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing … Factory (ADF), including network configurations and integration runtime options. Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts. Experience in efficient handling of large-scale data Deep understanding of Azure DevOps pipelines and deploying Terraform (Infrastructure as Code ...

/experience: Experience of programming under Microsoft Azure Cloud Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, DataFrames, and Spark SQL Hands-on experience with lakehouses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with … issues Desirable skills/knowledge/experience: Ability to prepare and process datasets for Power BI usage Experience with OneLake, Azure Data Lake, and distributed computing environments Understanding of financial regulations such as GDPR, SOX etc. Spark application performance tuning Knowledge of Docker/Kubernetes ...