1 to 25 of 43 Data Lake Jobs in the Midlands

driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data* Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools.In addition to these core skills, you should have specialist experience in one or more of the following ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

business objectives, enterprise architecture standards and regulatory requirements Architecting and delivering modern data platforms leveraging Azure technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/… solutions within a regulated environment Deep expertise in the Microsoft Azure Data Platform, including services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale ...

diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … models and capacity planning across heterogeneous data store technologies.Experience of establishing data governance processesExperience of architecting a data lake and solutions that reside within a data lake ecosystemEnterprise Data Architecture experience.Embracing our differences At Kainos, we believe ...

ingestion solutions using Azure Event Hubs, Kafka, Databricks Structured Streaming and Azure Stream Analytics Developing and maintaining modern data platforms, including Delta Lake/Lakehouse architectures on ADLS Gen2, curated datasets, dimensional models and Azure Synapse Dedicated SQL Pools Analysing current business practices, processes and procedures, identifying … with a regulated environment is essential Significant experience with data solution design experience in an MI/BI/Analytics environment (Kimball, lake house, data lake) is essential Significant experience using: Azure Data Factory, Azure Synapse Analytics, Azure SQL, Azure Data ...

platforms. Design data models for operational and analytical use cases, including dimensional modelling, slowly changing dimensions, lakehouse and data-lake patterns. Work with platforms such as Snowflake and relational databases including DB2 and PostgreSQL, applying sound principles for schema design, performance and data … data warehousing, dimensional modelling and slowly changing dimensions. Experience designing and implementing ETL/ELT pipelines and working with data-lake, lakehouse or cloud data Strong data analytics and problem-solving skills, including the ability to profile, interpret and analyse data ...

Head of Data - Hybrid Working | Central Birmingham Competitive Salary + Benefits Lead the Future of Data, Analytics & AI Are you a strategic data leader who still enjoys getting hands-on with technology? Do you want the opportunity to build, shape and lead a modern … data function while driving innovation through AI, analytics and cloud technologies? Our client is looking for an ambitious and forward-thinking Head of Data to join their our growing organisation and help transform the way we use data to drive business performance, client outcomes ...

Department: Transformation & Integration Location: Birmingham Description We are seeking a Data Engineer to join the Data Team and play a key role in the development, operation, and evolution of the Group's Data Platform. This role will be responsible for integrating new data sources into the DataCube platform, developing and supporting data pipelines, delivering new data engineering solutions, and contributing to the ongoing development of the Group's cloud data architecture. The successful candidate will work across a wide range of initiatives, from acquisition integrations ...

platforms. Design data models for operational and analytical use cases, including dimensional modelling, slowly changing dimensions, lakehouse and data-lake patterns. Work with platforms such as Snowflake and relational databases including DB2 and PostgreSQL, applying sound principles for schema design, performance and data … data warehousing, dimensional modelling and slowly changing dimensions. Experience designing and implementing ETL/ELT pipelines and working with data‐lake, lakehouse or cloud data Clear written and verbal communication and the ability to collaborate across technical and non‐technical teams. PREFERRED QUALIFICATIONS ...

following: distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front … following:Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.Front ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data lakes, and integration solutions. Define and maintain data standards, frameworks, and best practices. Ensure the organisation's data architecture aligns with strategic business objectives. Lead data migration and transformation initiatives. Leadership & Management Provide technical leadership and mentoring to Data Engineers ...

vital member of the new team, you will play a pivotal role in the building and maintaining our Azure Data Lake (ADL) as well as developing data pipelines from enterprise systems. The ideal candidate should have a strong background in ADL, Synapse integration, and data … pipelines, as well as integration of 3 rd party data. You will be expected to: Design, implement and maintain Azure Data Lake Storage solutions that effectively store and manage data for enterprise-level analytics Collaborate cross-functionally to integrate Azure Synapse into our data ...

Type: Permanent Location: United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Engineer We have an exciting role for you Data Engineer ! Careers at TCS: It means more TCS is a purpose-led transformation company … maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration, migration, and analytics requirements. Collaborate with stakeholders to understand business needs, troubleshoot data issues, and ensure secure ...

Data Architect Salary: Up to £78,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 06/10/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

Data Architect/Lead Data Engineer - Databricks Worcester | Hybrid working £70,000 - £80,000 plus bonus and benefits Permanent We are recruiting for a newly created Data Architect position within an established technology-led organisation based in Worcester. This is a hands-on role … operating purely at a strategic level. Ideally, your experience will include several of the following: Strong commercial experience with Databricks Unity Catalog, notebooks, Delta Lake or Delta Live Tables Data lakehouse and medallion architecture Advanced data modelling, including relational, dimensional, Data Vault ...

Project Data Architect Salary: Up to £78,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 06/10/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we'd love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC …/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME ...

models and analytics solutions Work extensively with Power BI Integrate internal and third-party systems through APIs Work with Azure Data Lake, SQL Server and SQL Support the existing Synapse environment while it transitions to Fabric Use Azure DevOps, Git and CI/CD to develop … integrated into the wider data and technology environment. Technology environment Data: Microsoft Fabric, Lakehouse, Warehouse, OneLake, Azure Data Lake, Azure Synapse Analytics: Power BI Engineering: SQL Server, SQL, ETL/ELT, API integrations Delivery: Azure DevOps, Git, CI/CD AI: Azure ...

Data Architect Inside IR35 Rate: £660 per day Location: Telford (2 days per week onsite) Clearance Required: Active SC Clearance (must be valid prior to start) The Opportunity We're looking for an experienced Data Architect to join a major transformation programme, helping to design … deliver enterprise-scale data and analytics solutions. This is a hands-on architecture role where you'll shape modern data platforms, cloud migration initiatives, data management capabilities, and analytics solutions. You'll work across the full data lifecycle, providing technical leadership from ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting Synapse solutions where needed during the transition Youll … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing and deploying production solutions Synapse experience is useful rather than mandatory. ...

Barratt Developments plc is seeking an Azure Data Engineer to build and maintain our Azure Data Lake and data pipelines within the Group Data Office. You will collaborate with the Visualization team to support Power BI data model development … role emphasizes design and implementation of ADL/Synapse solutions, API integrations, and adherence to SOLID and TOGAF standards. A strong cloud and data engineering background is required. #J-18808-Ljbffr ...

client, a technology organisation supporting the UK general insurance market, is seeking a Data Architect to define and evolve its enterprise-wide data architecture. This permanent hybrid role will help enable product development, analytics and business transformation by ensuring data is consistent, secure, scalable … across the organisation. The role requires attendance at the Worcester offices for a minimum of two days per week. Key Responsibilities: Define enterprise data architecture principles, standards and strategic roadmaps Design and maintain conceptual, logical and physical data models Guide the effective use of data ...

delivery. What You'll Take On: Joining the BIS domain, you will leverage tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows to provide valuable data for the business . Working as part of a product team … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands-on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

company and, most importantly, consider Open GI to be an inclusive, fun and fulfilling place to work. An overview of the role The Data Architect defines and evolves the organisation's enterprise-wide data architecture to enable the evolving product strategy, analytics, and company-wide transformation. … role ensures data is consistent, secure, scalable, and fit for purpose across the enterprise. Your key responsibilities Define enterprise data architecture principles, standards, and roadmaps. Design and maintain conceptual, logical, and physical data models. Guide use of data platforms (data ...