11 of 11 Contract Data Lake Jobs

Senior Data Analyst - 12 month Fixed Term Contract Who are we? Modern Networks Limited is a leading provider of managed IT services, specialising in delivering reliable, scalable, and secure IT solutions tailored to the needs of commercial properties, science parks, and SMEs. Our comprehensive services include IT support, broadband connectivity, telephone systems, and proactive cybersecurity protection. Modern Networks … ensures business continuity through data backup and disaster recovery solutions, optimises performance by managing IT infrastructure, and enhances communications by monitoring and optimising network performance. They also help businesses achieve and maintain compliance with industry regulations and data protection laws. What's the role? We’re looking for a highly skilled Senior Data Analyst … with strong data processing capabilities and a proven track record of translating complex data into meaningful insights. As a Senior Data Analyst, you will play a critical role in shaping and implementing the strategy and architecture of our data platform. You will: Work closely with the wider team to evolve the data More ❯

Data Platforms Product Owner | Technical Data Background | Banking/Cards/Insurance | London (hybrid) | £600/day (Inside IR35) | 6 month initial contract Our London based Financial Services client is looking for a Technical Data Platforms Product Owner to work on a large project. You'll have a solid data/tech … background, preferably in Financial Services. You'll have the ability to write the User Stories for the Data Engineers and tell the Architect what you need in the Data Model - and you'll define the data platforms roadmap. You will also have good experience around ADF, Azure DataBricks, and Snowflake - plus your knowledge will … include ETL processes, Data Governance, Data Warehouses, Data Marts, and Data Lakes. Key Skills & Experience: Product Owner Data Platforms Roadmap User Stories Snowflake Azure Data Factory/Azure Data Bricks Data Models Great Communication skills This role would be based in the City of More ❯

/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long-term, high-impact platform from the ground … Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and ensure code … and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage), and CI/CD pipelines. * Knowledge of Azure More ❯

end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate … systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting tools. Define and document best practices for managing and maintaining robust, scalable data pipelines. Data Governance & Security: Implement and maintain data governance policies using Unity Catalog, ensuring proper organization, access control, and metadata management More ❯

with third-party platforms or frameworks. Looking for ways to improve operations within company to digitize common tasks. Designing, building, maintaining internal cloud applications for the organization. Transferring data and internal processes to cloud architecture. Keeping data leakage and downtime to an absolute minimum. Keeping up to date on best practices in cloud computing and making … like Azure ExpressRoute, Azure Virtual Network, VPN Gateway, or Azure Arc. Knowledge of Azure data services, including Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Databricks, and Azure Synapse Analytics. Experience with data migration and integration strategies. More ❯

scratch both on AWS + GCP , must also have multiple Kubernetes certs (administrator, developer, expert etc).** Our client is looking to migrate its on-prem Hadoop-based data and analytics capability to a Kubernetes-based infrastructure. They already have a Kubernetes platform (the Internal Kubernetes Platform or IKP) but this is focused on the support of microservices … Min 3-4 years of hands on Kubernetes experience Experience with multiple K8S distributions - at least 2 distros. Experience building and deploying clusters Knowledge of GKE Experience with data lakes/data warehousing Strong understanding of Kubernetes security. Able to navigate through CNI and CSI configurations/issues. Experience with Helm charts and Operators, Hands on … Argo Other Skills Required Strong communication skills are essential as is experience of running a technical development/support team. Analytical approach to problem resolution. Enthusiastic about Big Data technologies, needs to be a proactive learner. Comfortable with agile planning methods. Strong communication and stakeholder management skills. Intellectually curios. Willing to try out solutions. Perseverant in the face More ❯

Are you a talented Solutions Architect looking to make your mark in the banking sector? Our client is seeking an enthusiastic and skilled individual to join a critical data remediation programme within the Markets Platform Surveillance Team. This is a fantastic opportunity to contribute to a dynamic environment and enhance the organization's capabilities while navigating a highly … umbrella) What You'll Do: As a Solutions Architect, you will play a pivotal role in improving our CI/CD platform and ensuring the seamless integration of data into our surveillance systems. Your expertise will help shape the future of our data handling and surveillance efforts. Key responsibilities include: Data Integration : Pulling data into the surveillance system from various sources, including data lakes and data warehouses on Google Cloud Platform (GCP). Platform Enhancement : Improving the CI/CD platform using Terraform and ensuring efficient deployment processes. Pipeline Tracking : Utilizing tools like JIRA to track pipelines and manage workflows effectively. Containerization : Implementing containerization solutions to optimize application More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior … Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of More ❯

their London-based office. The client is currently replacing their outward Reinsurance platform and requires support with the delivery and integration of the new system with their enterprise data lake. Job Details: Start date - ASAP Duration - 18 months Rate - £600-£650pd Inside IR35 via Umbrella Location - London Hybrid - 3 days in the office Key requirements: 5+ years experience More ❯

looking to hire an experienced Business Analyst to work on a project to replace their outward Reinsurance platform. The new platform will also need to integrate with new data lakes for both downstream and upstream processing. This is a hybrid role requiring 3 days per week on site in the central London office. Experience required: Extensive experience working More ❯