1 to 25 of 30 Data Lake Jobs in the South West

service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. … architecture, modelling, and governance frameworks. Hands‐on experience building data warehouses and data pipelines. Experience with modern data‐lake technologies — ideally Microsoft Fabric, Azure Data Lake, or similar. Strong knowledge of data integrity, quality tooling, and metadata management. ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

Your new company You'll be joining a secure defence programme delivering a central AWS data lake and integration capability across multiple source systems and security classifications. Due to the nature of the programme, applicants must already hold active DV clearance and meet the client's security … ingestion, integration, transformation, governance and security.You will be responsible for: Defining the target architecture and design principles for a secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … technologies. About you Technical Skills Strong experience with: Azure Data Factory (ADF). Azure Databricks. Azure Synapse Analytics. Azure Data Lake Storage (ADLS). Azure SQL Database and SQL Server. Microsoft Fabric (preferred). Advanced SQL development and performance tuning skills. Experience with Python, PySpark ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Role: Senior Data Engineer - Databricks Location: Remote - some travel to client site in London Contract: Initial 6 months Rate: £500 to £540 per day Clearance: Must be eligible to obtain SC Clearance This role has been deemed Inside IR35 The Opportunity We are looking for an experienced Senior … commercial experience with Databricks Excellent PySpark, Apache Spark and Spark SQL skills Experience building production-grade ETL/ELT pipelines Strong knowledge of Delta Lake and Lakehouse architecture Experience implementing Medallion/Bronze-Silver-Gold architectures Strong experience with Azure and/or AWS data platforms Knowledge ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

tcs.com or call TCS London Office number 02031552100/+44 204 520 2575 with the subject line: “Application Support Request”. Role: Enterprise Data ArchitectLocation: SwindonContract: PermanentMode of Working: HybridAre you looking to leverage your skills in Data AI We have a great opportunity … Enterprise Data Architect!Careers at TCS: It means moreTCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQuery Design and deliver automated data pipelines that use orchestration tools such ...

reports and dashboards. Produce weekly KPI reports for senior leadership and the CFO. Support the creation of a centralised reporting and data-lake approach. Ensure data integrity within core systems, including maintaining records and supporting reporting accuracy. Assist with ongoing reporting and systems improvement projects. … financial data. Strong problem-solving skills and the ability to learn new systems quickly. Desirable Experience Power BI. Microsoft Fabric or data lake technologies. Experience in financial reporting or finance systems environments. Relevant degree in Data Analytics, Business, Finance or similar. Ideal Candidate The client ...

deliver enduring results, enabling you to build a lasting career. Isn't it time you joined us? Job DescriptionAs a Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQueryDesign and deliver automated data pipelines that use orchestration tools such as Cloud ...

Lead Data Engineer £90,000 - £120,000 London or Bristol (1 day a week in office) This is an opportunity to take ownership of a growing Azure-based data platform and play a key role in shaping its future. You will combine hands-on engineering with … architectural decision-making, delivering a modern data environment that supports analytics, reporting, and business-critical applications. THE COMPANY They are a growing organisation investing heavily in data and technology to support continued expansion. Their data platform is central to business operations, reporting, and digital ...

Manager to own the Group’s data strategy, architecture and governance for data platforms spanning data lake, warehouse and analytics tooling. You will lead the technical build, ensure data integrity and enable data-driven decision making across … subsidiaries through strong data governance. The role combines strategic roadmapping with hands-on delivery, requiring collaboration with technology, operations and business stakeholders to drive adoption #J-18808-Ljbffr ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates … pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components). Proven ability to take research and prototype environments to enterprise-ready architectures, balancing speed, robustness, and long-term maintainability. Strong background ...

your technical skills to design, develop, test, monitor and support the infrastructure that forms the foundations of our vital big data platform. You'll be working on the whole platform stack, up from the bare metal up to customer facing applications. Automation and monitoring will be key requirements … customers to understand their technical needs Set the choices of software and hardware for our big data platform and data lake Design, build and deploy core infrastructure ensuring the system is scalable and resilient Ensure systems are automated, including system build and common maintenance functions ...