1 to 25 of 26 Data Lake Jobs in the South West

service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. … architecture, modelling, and governance frameworks. Hands‐on experience building data warehouses and data pipelines. Experience with modern data‐lake technologies — ideally Microsoft Fabric, Azure Data Lake, or similar. Strong knowledge of data integrity, quality tooling, and metadata management. ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … technologies. About you Technical Skills Strong experience with: Azure Data Factory (ADF). Azure Databricks. Azure Synapse Analytics. Azure Data Lake Storage (ADLS). Azure SQL Database and SQL Server. Microsoft Fabric (preferred). Advanced SQL development and performance tuning skills. Experience with Python, PySpark ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

that supports planning, performance monitoring and strategic priorities. Key responsibilities will include: Supporting the development and enhancement of the University’s data lake and wider data infrastructure in line with the University Data Strategy. Developing, maintaining and improving forecasting models and dashboards used … analytics solutions. Strong data engineering and data management skills, including experience of data warehousing or data lake environments. Experience of developing forecasts, predictive models, dashboards and reports to support operational or strategic decision-making. A commitment to continuous improvement and delivering ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

hackajob is partnering directly with Made Tech to hire for this role. Description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. … They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Your role at Made Tech As a Senior Data Engineer, you may play one or more roles according to our clients' needs. ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQuery Design and deliver automated data pipelines that use orchestration tools such ...

reports and dashboards. Produce weekly KPI reports for senior leadership and the CFO. Support the creation of a centralised reporting and data-lake approach. Ensure data integrity within core systems, including maintaining records and supporting reporting accuracy. Assist with ongoing reporting and systems improvement projects. … financial data. Strong problem-solving skills and the ability to learn new systems quickly. Desirable Experience Power BI. Microsoft Fabric or data lake technologies. Experience in financial reporting or finance systems environments. Relevant degree in Data Analytics, Business, Finance or similar. Ideal Candidate The client ...

Lead Data Engineer £90,000 - £120,000 London or Bristol (1 day a week in office) This is an opportunity to take ownership of a growing Azure-based data platform and play a key role in shaping its future. You will combine hands-on engineering with … architectural decision-making, delivering a modern data environment that supports analytics, reporting, and business-critical applications. THE COMPANY They are a growing organisation investing heavily in data and technology to support continued expansion. Their data platform is central to business operations, reporting, and digital ...

Manager to own the Group’s data strategy, architecture and governance for data platforms spanning data lake, warehouse and analytics tooling. You will lead the technical build, ensure data integrity and enable data-driven decision making across … subsidiaries through strong data governance. The role combines strategic roadmapping with hands-on delivery, requiring collaboration with technology, operations and business stakeholders to drive adoption #J-18808-Ljbffr ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

London/Bristol About the Role The Principal Software Engineer (Full-Stack, Backend-leaning) is a senior engineer responsible for the backend architecture, data pipelines, and API layer of a new sports technology product, while remaining capable of contributing to frontend development as needed. This role sits within … Lambda for lightweight processing tasks. Data transformation and aggregation layers that normalise tracking outputs, store them in a data lake, and make them available to downstream consumers via clean API contracts. REST and WebSocket APIs that serve both a live data product ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates … pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components). Proven ability to take research and prototype environments to enterprise-ready architectures, balancing speed, robustness, and long-term maintainability. Strong background ...

Teams, Co-Pilot, Power Platform (Power Apps, Power Automate, Power BI and Power Virtual Agent) and other MS365 services. Integrate and manage data sources like Dataverse, SharePoint and SQL. Act as the Technical Authority for any new enterprise-wide applications development (e.g. Dynamics 365), configuration and implementation. … SharePoint, Teams and OneDrive. Hierarchical structured data and SQL programming. Azure Integration services, especially Azure API Management. (desirable) Azure Data Lake, Azure Synapse. (desirable) Dynamics 365 (desirable). #J-18808-Ljbffr ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

team expectations for validating AI outputs for correctness, performance, and security. Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices. Proficient … frameworks such as S3, Lambdas, Athena, etc. Practical cloud native experience, AWS preferred. Experience building and supporting centralized and de-centralized data architectures such as data lakes and data meshes In-depth knowledge of the financial services industry and their IT systems. #J ...