24 of 24 Data Lake Jobs in the South West

service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. … architecture, modelling, and governance frameworks. Hands‐on experience building data warehouses and data pipelines. Experience with modern data‐lake technologies — ideally Microsoft Fabric, Azure Data Lake, or similar. Strong knowledge of data integrity, quality tooling, and metadata management. ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

Your new company You'll be joining a secure defence programme delivering a central AWS data lake and integration capability across multiple source systems and security classifications. Due to the nature of the programme, applicants must already hold active DV clearance and meet the client's security … ingestion, integration, transformation, governance and security.You will be responsible for: Defining the target architecture and design principles for a secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

tcs.com or call TCS London Office number 02031552100/+44 204 520 2575 with the subject line: “Application Support Request”. Role: Enterprise Data ArchitectLocation: SwindonContract: PermanentMode of Working: HybridAre you looking to leverage your skills in Data AI We have a great opportunity … Enterprise Data Architect!Careers at TCS: It means moreTCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some ...

concepts, including storage, processing, and modelling. Core requirements include:Databricks - hands-on experience building and managing workloads on the Databricks platform, including Delta Lake, Unity Catalog, and Declarative Automation BundlesPySpark - proficiency in writing and optimising PySpark code for data transformation and processingAzure - solid experience working within … Azure ecosystem, including services such as Azure Data Factory, Azure Data Lake Storage, and Azure DevOpsAzure SQL Server - experience with Azure SQL Server is important, as it forms the foundation of our existing data warehouse. You will be working across both ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQuery Design and deliver automated data pipelines that use orchestration tools such ...

reports and dashboards. Produce weekly KPI reports for senior leadership and the CFO. Support the creation of a centralised reporting and data-lake approach. Ensure data integrity within core systems, including maintaining records and supporting reporting accuracy. Assist with ongoing reporting and systems improvement projects. … financial data. Strong problem-solving skills and the ability to learn new systems quickly. Desirable Experience Power BI. Microsoft Fabric or data lake technologies. Experience in financial reporting or finance systems environments. Relevant degree in Data Analytics, Business, Finance or similar. Ideal Candidate The client ...

opportunity and deliver enduring results, enabling you to build a lasting career.Isn’t it time you joined us Job DescriptionAs a Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop … data-driven solutions for our clients.You will typically lead a team or the solution delivery effort, demonstrating technical excellence through leading by example. You could be providing technical support, leading an engineering team or working across multiple teams as a subject matter expert who is critical ...

Lead Data Engineer £90,000 - £120,000 London or Bristol (1 day a week in office) This is an opportunity to take ownership of a growing Azure-based data platform and play a key role in shaping its future. You will combine hands-on engineering with … architectural decision-making, delivering a modern data environment that supports analytics, reporting, and business-critical applications. THE COMPANY They are a growing organisation investing heavily in data and technology to support continued expansion. Their data platform is central to business operations, reporting, and digital ...

Manager to own the Group’s data strategy, architecture and governance for data platforms spanning data lake, warehouse and analytics tooling. You will lead the technical build, ensure data integrity and enable data-driven decision making across … subsidiaries through strong data governance. The role combines strategic roadmapping with hands-on delivery, requiring collaboration with technology, operations and business stakeholders to drive adoption #J-18808-Ljbffr ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates … pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components). Proven ability to take research and prototype environments to enterprise-ready architectures, balancing speed, robustness, and long-term maintainability. Strong background ...

your technical skills to design, develop, test, monitor and support the infrastructure that forms the foundations of our vital big data platform. You’ll be working on the whole platform stack, up from the bare metal up to customer facing applications. Automation and monitoring will be key requirements … customers to understand their technical needs• Set the choices of software and hardware for our big data platform and data lake• Design, build and deploy core infrastructure ensuring the system is scalable and resilient• Ensure systems are automated, including system build and common maintenance functions ...

Your new company You will be working for a secure client delivering data engineering capability in a highly regulated environment. The client's identity will remain confidential at this stage. The position requires previous experience of MOD, Defence or secure government data engineering environments involving different … security classifications. Your new role As Senior Data Consultant, you will lead the delivery of secure data ingestion and integration pipelines, translating the Data Architect's designs into working technical capability. This is a technical leadership position combining hands-on delivery oversight, pipeline implementation ...

these can be employed alongside D365 F&OBring extensive experience in defining and delivering technical architecture, environment management, integrations and data strategiesEnsure best practice in every aspect of a technical solution, promoting the use of appropriate design patterns for application extensions, data and integrationsLeading and guiding … integrations, data schemas and complex application extensionsUnderstanding of licensing modelsExperience in environment managementWorking knowledge of Fabric, Synapse and data lake technologiesRelevant experience with multiple full life-cycle implementations of MS D365 F&ODemonstrates knowledge and experience in ERP implementation methodology and principlesEffective time-management, attention ...

ability to set team expectations for validating AI outputs for correctness, performance, and security.Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery … such as AWS and frameworks such as S3, Lambdas, Athena, etc.Practical cloud native experience, AWS preferred.Experience building and supporting centralized and de-centralized data architectures such as data lakes and data meshesIn-depth knowledge of the financial services industry and their IT systems.J.P. Morgan ...

team expectations for validating AI outputs for correctness, performance, and security. Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices. Proficient … frameworks such as S3, Lambdas, Athena, etc. Practical cloud native experience, AWS preferred. Experience building and supporting centralized and de-centralized data architectures such as data lakes and data meshes In-depth knowledge of the financial services industry and their IT systems. #J ...

technical architecture, solutioning, and engineering alignment of a large-scale Wealth Management platform. You will work across applications, UI services, APIs, integrations, data, databases, AI/ML, AWS Cloud, infrastructure, Kubernetes, Docker, DevOps, security, performance, scalability, and cost optimization. You are expected to be hands-on, technically deep … Kafka), WebSockets, and Salesforce integration patterns. Containers & DevOps: Drive containerized architecture (Docker/Kubernetes) and embed complete CI/CD/DevSecOps lifecycles. Data & AI Architecture: Provide technical direction across RDBMS, NoSQL, Data Lakes, and AI/ML capabilities (LLM integration, RAG, vector databases). Performance ...