151 to 175 of 593 Data Lake Jobs

client is currently recruiting for a Senior Data Engineer to join their team. The Senior Data Engineer will be responsible for designing, developing, and maintaining both legacy and modern cloud-based data platforms and pipelines that enable efficient data collection, processing … maintain timely data availability Contribute to the design, build, and optimisation of data architectures, models, warehouses, and data lake solutions that support reporting, analytics, and AI initiatives. Ensure solutions meet performance, scalability, and reliability standards across legacy and modern cloud platforms. Monitor ...

marketing, or communications there is always a talented team working to maximise the potential of the sport.Role Overview:We are looking for a Data Analyst to join our IT department. Reporting into our IT Systems Manager, this role will maintain, develop and optimisation of data enterprise … capture processesMonitor data quality, integrity and performance across data platformsMaintain medallion architecture layers in a data lake to manage structured and semi-structured dataApply data modelling best practises to support enterprise reporting and analyticsBuilding data transformation logic ...

deploy Databricks resources across environments using Databricks Asset Bundles and GitLab-based CI/CD pipelines. Integrate Databricks with Azure Data Lake Storage and Azure Data Factory for secure, reliable data processing. Optimize Spark workloads, clusters, jobs, and storage patterns for performance, scalability … Apache Spark execution architecture. Advanced proficiency in PySpark, Python, and SQL for large-scale data processing and transformation. Practical experience with Delta Lake, Delta Tables, Unity Catalog, Databricks Jobs, and Databricks Asset Bundles. Proven experience designing and operating production-grade ETL or ELT pipelines on Azure. Hands ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

Data Analyst (Tech Insurance Operations) Role Overview We are seeking a highly analytical and technically capable Data Analyst to support the development of a data-driven claims function. This role will report directly to the Head of Claims and will work closely with TPAs … preferred), using notebooks to analyse and transform data, and leveraging Azure data services such as Azure SQL, Data Lake Storage, and cloud-based data platforms. Experience extracting and analysing data from systems or reporting platforms, including Lloyd’s/ ...

pipelines using Azure DevOps or GitHub Actions. Working with Azure data services , including Data Factory, Storage/Data Lake and emerging AI services. Improving platform reliability, monitoring and observability. Troubleshooting infrastructure and platform issues. Working closely with engineers, architects and data …/CD tooling. Experience with Azure data services such as Data Factory and Azure Storage/Data Lake . Scripting experience with Python, PowerShell or Bash . A genuine interest in automation, self-service and DevOps . A relevant HashiCorp Terraform certification would ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

Project Data Architect Salary: Up to £78,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 06/10/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we'd love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC …/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME ...

Data Architect Inside IR35 Rate: £660 per day Location: Telford (2 days per week onsite) Clearance Required: Active SC Clearance (must be valid prior to start) The Opportunity We're looking for an experienced Data Architect to join a major transformation programme, helping to design … deliver enterprise-scale data and analytics solutions. This is a hands-on architecture role where you'll shape modern data platforms, cloud migration initiatives, data management capabilities, and analytics solutions. You'll work across the full data lifecycle, providing technical leadership from ...

Data Architect Inside IR35 Rate: £660 per day Location: Telford (2 days per week onsite) Clearance Required: Active SC Clearance (must be valid prior to start) The Opportunity We're looking for an experienced Data Architect to join a major transformation programme, helping to design … deliver enterprise-scale data and analytics solutions. This is a hands-on architecture role where you'll shape modern data platforms, cloud migration initiatives, data management capabilities, and analytics solutions. You'll work across the full data lifecycle, providing technical leadership from ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

agility of a local business with the resources of a global enterprise, specialising in Azure to simplify how businesses modernise their IT, data, and analytics. Our strapline "modernisation, simplified..." highlights our mission to make cloud journeys straightforward and effective. Role Overview As a Data Architect … ingestion, transformation, storage, modelling, and reporting Experience with Azure services such as Data Factory, Databricks, Synapse Analytics, Fabric, or Data Lake Storage Strong understanding of data modelling concepts, including logical, physical, dimensional, and analytical models Ability to design practical, maintainable data ...

Senior Fabric Engineer: Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs. Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic … decisions and drive business transformation. Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and PowerBI to build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation ...

platform within a global investment banking environment. The successful candidate will combine strong technical delivery expertise with deep knowledge of trade surveillance, trading data, compliance technology, and financial markets. Key Responsibilities Technology Delivery Leadership Lead end-to-end delivery of the Trade Surveillance technology programme. Define project objectives … milestones, KPIs, governance, and business outcomes. Manage budgets, resources, timelines, risks, dependencies, and vendor relationships. Coordinate cross-functional technology teams including developers, architects, data engineers, testers, infrastructure teams, and business SMEs. Drive project governance and executive stakeholder reporting. Ensure successful delivery across multiple workstreams and jurisdictions. Trade Surveillance ...

that backs your ambition, you won’t just contribute. You’ll make things happen–fast. We are looking for a highly skilled Senior Data Engineer to become part of our core Enterprise Data Engineering team. You will be a senior member of the larger AI, Data and Innovation organization, responsible for designing and expanding enterprise-level data infrastructure that enables the company's internal teams to interact with data comprehensively. The ideal candidate has a strong background in big data processing, pipeline orchestration, and data modeling ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

helping to shape the future of the organisation's data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise If this role is of interest, please apply with ...

Drive the future of analytics and data intelligence by designing architectures that turn raw data into actionable insights at scale. As a Senior Analytics Solutions Architect, you’ll partner with customers to architect end-to-end analytics platforms from data lakes and lakehouses … teams, and elevating the broader analytics community through thought leadership, workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

recruiting on behalf of our client for an experienced Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions. Our client works with organisations operating in complex, secure and highly regulated environments, with a significant focus … public sector and defence. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide other engineers and influence engineering practices. The Role As a Senior Data Engineer, you’ll take a leading role ...

Location: Hybrid - adhoc travel to Marlow office Department: Data Services Monday-Friday Full Time We are looking for an experienced Data Engineer to join our growing Data Engineering team. You will work with Microsoft technologies to design, develop and support enterprise-scale data … Power BI , including dashboards, reporting and semantic models Knowledge of Microsoft Azure technologies such as Azure Data Factory, Azure Data Lake, Azure SQL Database, Azure Synapse Analytics and Azure Functions Experience consuming APIs and working with JSON or XML Knowledge of Python, C# or PowerShell ...