76 to 100 of 606 Permanent Data Lake Jobs

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … and standards to secure clinical data both in-motion and at-rest. Shape Data Workflows: Utilize Databricks components like Delta Lake, Unity Catalog, and ML Flow to ensure efficient, secure, and reliable data workflows. Key Responsibilities Data Engineering with Databricks: Design … data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … perfect opportunity to develop your career. The difference you'll make: Designing, building, and maintaining our AWS Data Estate. This includes S3 lake formation, Iceburg and extends to our Snowflake platform. Designing AWS-based services and capabilities adopting appropriate modelling techniques following agreed architectures, design standards, patterns More ❯

Overview LEAD DATA ARCHITECT (ARDAP): Bowhead is seeking a Lead Data Architect for the upcoming Army Data and Analytics Platform (ARDAP) effort located at Fort Belvoir, VA. ARDAP's mission is to accelerate Army leader informed decisions and war-fighter mission accomplishment by ensuring … matter experts and IT professionals advising executive level personnel on financial, technical, and other high-level policy areas. Responsibilities Design and implement enterprise data solutions, including data lakes, data warehouses, and ETL pipelines. Provide strong proficiency with data modeling, database design, and … SQL optimization. Demonstrate familiarity with AWS, Azure, or other cloud platforms and their data services. Experience with metadata management, data cataloging, and data governance practices. Lead development and implementation of analytics solutions to solve business problems and optimize mission execution. Provide guidance in applying More ❯

Azure Data Engineer/Consultant – Up to £75K + Bonus Location: Remote (UK-based, with very occasional travel) Salary: Up to £75,000 + bonus Company & role Join one of the UK’s most advanced Microsoft partners, specialising in Azure-led Data & AI solutions. This consultancy … high-performance data platforms using the latest Azure services Champion modern architecture patterns, including Medallion Architecture for structured, efficient data lake design Work closely with Architects and Consultants on end-to-end solutions Stay up to date on Microsoft innovations and contribute to knowledge sharing … delivering data solutions in the Azure ecosystem Deep expertise across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data … programme and is eager to apply their skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data … data-driven workflows. Understanding of ETL concepts and processes. Exposure to modern data platforms such as Azure Data Lake , Databricks , or Microsoft Fabric is a bonus. Analytical Skills: Ability to understand complex data structures and derive actionable insights. Strong problem-solving More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data … programme and is eager to apply their skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data … data-driven workflows. Understanding of ETL concepts and processes. Exposure to modern data platforms such as Azure Data Lake , Databricks , or Microsoft Fabric is a bonus. Analytical Skills: Ability to understand complex data structures and derive actionable insights. Strong problem-solving More ❯

effectively on IT projects. This role will be suited to an IT generalist with salesforce administration experience and an interest to engage in data analysis. About Ecovision: Ecovision has extensive experience design, installation and managing distributed rooftop solar PV asset portfolios across the UK. We have installed over … Flexi working of hours and location that facilitates a work/life balance Bike to work scheme What you’ll do: Main Responsibilities: Data Integrity Ensure data is accurate, consistent, and up-to-date across multiple systems and platforms. Implement processes to detect, correct, and prevent … data integrity issues in various data sources (databases, data lakes, etc.). Data Cleansing Perform data cleansing activities to remove duplicates, correct errors, and standardize data. Develop and execute data cleaning processes to handle missing, outdated, or inaccurate More ❯

effectively on IT projects. This role will be suited to an IT generalist with salesforce administration experience and an interest to engage in data analysis. About Ecovision: Ecovision has extensive experience design, installation and managing distributed rooftop solar PV asset portfolios across the UK. We have installed over … Flexi working of hours and location that facilitates a work/life balance Bike to work scheme What you’ll do: Main Responsibilities: Data Integrity Ensure data is accurate, consistent, and up-to-date across multiple systems and platforms. Implement processes to detect, correct, and prevent … data integrity issues in various data sources (databases, data lakes, etc.). Data Cleansing Perform data cleansing activities to remove duplicates, correct errors, and standardize data. Develop and execute data cleaning processes to handle missing, outdated, or inaccurate More ❯

effectively on IT projects. This role will be suited to an IT generalist with salesforce administration experience and an interest to engage in data analysis. About Ecovision: Ecovision has extensive experience design, installation and managing distributed rooftop solar PV asset portfolios across the UK. We have installed over … Flexi working of hours and location that facilitates a work/life balance Bike to work scheme What you’ll do: Main Responsibilities: Data Integrity Ensure data is accurate, consistent, and up-to-date across multiple systems and platforms. Implement processes to detect, correct, and prevent … data integrity issues in various data sources (databases, data lakes, etc.). Data Cleansing Perform data cleansing activities to remove duplicates, correct errors, and standardize data. Develop and execute data cleaning processes to handle missing, outdated, or inaccurate More ❯

growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying, and real-time data streaming. Establish and enforce best … practices in data engineering, coding standards, and architecture guidelines. Build and manage data lake architecture s on AWS to support scalable, secure, and cost-efficient storage and processing of structured and unstructured data. Manage team tasks and delivery using Agile methodologies, collaborating closely with product … experience in data engineering and ETL architecture. Deep expertise in AWS Data Services, including Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation and data lake design. Strong programming skills in Python and PySpark for data processing and automation. Extensive SQL More ❯

growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying, and real-time data streaming. Establish and enforce best … practices in data engineering, coding standards, and architecture guidelines. Build and manage data lake architecture s on AWS to support scalable, secure, and cost-efficient storage and processing of structured and unstructured data. Manage team tasks and delivery using Agile methodologies, collaborating closely with product … experience in data engineering and ETL architecture. Deep expertise in AWS Data Services, including Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation and data lake design. Strong programming skills in Python and PySpark for data processing and automation. Extensive SQL More ❯

Sr. Delivery Consultant - Data Architect, ProServe SDT North The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions … the organization through mentoring, training, and creating reusable artifacts BASIC QUALIFICATIONS - 5+ years' experience architecting and implementing data platforms (Data Lake, Data Lakehouse, Data Mesh, Data Warehouse) at enterprise scale - Experience building end-to-end data solutions … including data ingestion (batch/streaming), storage, orchestration, governance, security, analytics, and observability. - Highly technical and analytical mindset with ability to think strategically about business, product, and technical challenges in an enterprise environment - Extensive hands-on experience with data platform technologies, including at least three of More ❯

Data Engineer - Consultancy - Up to £600 per day (Inside IR35) - 6 Month Contract - Remote Overview: Join a leading consultancy, delivering innovative data-driven solutions for global clients. You’ll play a key role in developing and supporting enterprise-grade data platforms and services, ensuring … high-quality data pipelines and enabling smarter business decision-making. Key Responsibilities: Design and develop homogenous data repositories for enterprise reporting and analytics. Ingest data from SQL databases, REST APIs, Kafka streams and other sources. Apply data cleansing rules to ensure high … stability and performance of enterprise data platforms. Requirements: Strong Azure data skills: Data Factory V2, Data Lake Storage V2, Databricks, Function Apps, Logic Apps, Stream Analytics, Terraform, Azure CLI/Portal/PowerShell. Proficient with PySpark, Delta Lake, Unity Catalog More ❯

We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and … using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power More ❯

We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and … using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power More ❯

We have a new opportunity to be part of the IT team in the role of Data Analyst to work across departments excluded from the FIA Financial Regulations, primarily this will include non-F1 activities, Finance, HR, Commercial and Sustainability. As our Data Analyst, you will … responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and … using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power More ❯

Job Details: Enterprise Data Governance & Architecture Lead Job Title: Enterprise Data Governance & Architecture Lead Reports to: Head of Technology Data, Architecture & Technology Strategy Department: Technology Location: Leeds/Manchester/Bristol/Glasgow DEPARTMENT DESCRIPTION The Data Platform team is a key … component of C4's Technology organization that provides an enriched and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within C4. Data is the most valuable asset in C4. The Data Platform Department is … dedicated to developing advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, enabling C4 to leverage its data asset effectively and timely to maximize technology/business development and More ❯

Location: London (hybrid working 3 office days per week) n Employment Type: Permanent, full time n Additional Benefits: Annual Bonus n Join Our Data & Analytics Team: Transforming Data into Our Superpower! n Are you passionate about data and eager to make a significant impact … n As a Data Engineer, you’ll be crucial in developing and maintaining our data pipelines and data lake house architecture. You’ll be central to the success of our data team\\\'s efforts to maximise our data capabilities. … and maintaining resilient data pipelines n Identifying and automating manual or repetitive data processes. n Establishing the data lake house as a single source of insight for the business. n Developing analytical datasets to support insights into customer behaviour, operational efficiency and key More ❯

Location: Basingstoke (hybrid working 3 office days per week) n Employment Type: Permanent, full time n Additional Benefits: Annual Bonus n Join Our Data & Analytics Team: Transforming Data into Our Superpower! n Are you passionate about data and eager to make a significant impact … n As a Data Engineer, you’ll be crucial in developing and maintaining our data pipelines and data lake house architecture. You’ll be central to the success of our data team\\\'s efforts to maximise our data capabilities. … and maintaining resilient data pipelines n Identifying and automating manual or repetitive data processes. n Establishing the data lake house as a single source of insight for the business. n Developing analytical datasets to support insights into customer behaviour, operational efficiency and key More ❯

Data Architect - Active SC Clearance, Data Market Rate (Outside IR35) Location: London/Remote Duration: 6 months initially (Jan 2025 start) My client is an International Consultancy, who requires a Data Architect that holds an Active SC (Security) Clearance, and an in-depth understanding … of modern Data architectures including Data Lakehouse, Data mesh, to work closely with a key end client. Key Requirements: Active Security Clearance (SC) Proven experience as a Data Architect with knowledge of end-to-end Data Architecture Demonstrable experience in … defining and building BI/Data Warehouse Logical and Physical models, including normalised and dimensional models, as well as Data Lake architectures. Knowledge of Conceptual, Logical, and Physical Data Models Confident with mapping data from source to target. Ability to define More ❯

Digital, you will lead the design, development, and delivery of enterprise-grade business intelligence solutions using Microsoft Power BI and the broader Azure data platform. This role focuses on enabling data-driven decision-making by transforming complex data into actionable insights for strategic customers. … and performance tuning best practices for enterprise BI environments. Integrate Power BI with Azure Data Services (e.g., Azure Synapse, Data Lake, Databricks) and M365 platforms, with familiarity in Power Platform and Microsoft Fabric where applicable. Deliver hands-on workshops, coaching sessions, and enablement programs to … team collaborations and driving innovative solutions. Experience with Azure data services (e.g., Azure SQL, Synapse, Data Factory, Data Lake) and familiarity with Power Platform integration and Microsoft Fabric. Previous consulting experience in the EMEA region or with global clients is a plus. Technical More ❯

Lead BI Developer Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington) - £60-70k + excellent bonus + bens An experienced … Lead BI Developer is urgently required by my client with significant experience of designing, building, implementing and maintaining robust data solutions on Azure SQL and BI platforms. Strong knowledge of ADF, Azure Data Lakes, Azure SQL and Synapse Analytics will be needed, along with experience of … responsibility to provide third line support of solutions in production if required. Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington More ❯

Job Description: Data Modeler (Offshore) Location: India (Remote) Experience: 10+ years About Client A leading multinational IT services and consulting company specializing in digital transformation, cloud solutions, and AI-driven innovation. With a strong global presence, the company partners with enterprises across various industries to deliver cutting-edge … technology solutions. Must Have Skills: Solid expertise in data modeling, with considerable experience in database technologies, particularly Azure Databricks, Azure Synapse, and Azure Data Factory, to support business intelligence, analytics, and reporting initiatives. Strong understanding of best practices in data modeling to ensure that … experience, with strong domain knowledge in Clinical Research Organizations and Biopharmaceutical services preferred. Proven track record of designing, developing, and maintaining complex logical data models in multiple subject areas. Proficiency in data modeling tools such as ER/Studio, ERwin, or PowerDesigner. Strong proficiency in SQL More ❯

on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Position: Head of Data Engineering & Architecture Location: London (Hybrid, 40% in office) Salary: £Salary + Bonus + Equity + Benefits We are recruiting for an experienced Head of … expert in data engineering infrastructure, technologies and practices. Have deep expertise in data modelling and warehouse design in the modern, lake house era. Are an experienced and committed people manager with technical leadership experience. Are passionate about agile software delivery with a track record of … and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase More ❯

We are currently managing a Head of Data role for a leading company in the energy sector. You will work in a dynamic and fast-paced environment, driving data-driven decision-making and leading the company's digital transformation. Responsibilities: Define and lead the company's … data analytics strategy, aligning it with business … objectives. Ensure effective use of data to support strategic decision-making. Oversee data quality, accessibility, and governance (Data Lake, Data Warehouse). Lead the development of analytical models, reports, and insights to enhance decision-making. Implement advanced data analysis More ❯