10 of 10 Remote/Hybrid Data Lake Jobs in the South West

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

Your new company You'll be joining a secure defence programme delivering a central AWS data lake and integration capability across multiple source systems and security classifications. Due to the nature of the programme, applicants must already hold active DV clearance and meet the client's security … ingestion, integration, transformation, governance and security.You will be responsible for: Defining the target architecture and design principles for a secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

concepts, including storage, processing, and modelling. Core requirements include:Databricks - hands-on experience building and managing workloads on the Databricks platform, including Delta Lake, Unity Catalog, and Declarative Automation BundlesPySpark - proficiency in writing and optimising PySpark code for data transformation and processingAzure - solid experience working within … Azure ecosystem, including services such as Azure Data Factory, Azure Data Lake Storage, and Azure DevOpsAzure SQL Server - experience with Azure SQL Server is important, as it forms the foundation of our existing data warehouse. You will be working across both ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates … pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components). Proven ability to take research and prototype environments to enterprise-ready architectures, balancing speed, robustness, and long-term maintainability. Strong background ...

Your new company You will be working for a secure client delivering data engineering capability in a highly regulated environment. The client's identity will remain confidential at this stage. The position requires previous experience of MOD, Defence or secure government data engineering environments involving different … security classifications. Your new role As Senior Data Consultant, you will lead the delivery of secure data ingestion and integration pipelines, translating the Data Architect's designs into working technical capability. This is a technical leadership position combining hands-on delivery oversight, pipeline implementation ...

these can be employed alongside D365 F&OBring extensive experience in defining and delivering technical architecture, environment management, integrations and data strategiesEnsure best practice in every aspect of a technical solution, promoting the use of appropriate design patterns for application extensions, data and integrationsLeading and guiding … integrations, data schemas and complex application extensionsUnderstanding of licensing modelsExperience in environment managementWorking knowledge of Fabric, Synapse and data lake technologiesRelevant experience with multiple full life-cycle implementations of MS D365 F&ODemonstrates knowledge and experience in ERP implementation methodology and principlesEffective time-management, attention ...