Data Engineer (Azure, Delta Lake, SQL) - O/S IR35 - Hybrid A top specialist IT Consultancy are urgently seeking an experienced Data Engineer to support with a variety of end client projects. The assignment will be outside IR35 and require a 50/50 working … Experienced Data Engineer (7+ Years) Strong Azure data skills, including: Azure Data Factory V2, Azure DataLake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball Datamodelling more »
Knutsford, Cheshire, United Kingdom Hybrid / WFH Options
Experis
you in the role: * Functional/Domain exposure in Banking/Cards/Loans * Exposure of modern architecture patterns (Domain Driven, Event Streaming, DataLakes, API) * Exposure working in DevOps operating model and associated tools (JIRA, GIT, Jenkins, CHEF) * Ability to understand Threat Vectors in cloud environment and more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, DataLake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »