76 to 100 of 567 Data Lake Jobs

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … architecture, including at least 3 years in a cloud-native environment. Proven expertise with AWS cloud services , including but not limited to: S3, Glue, Redshift, Lambda, Kinesis, Athena, Lake Formation. Strong hands-on experience with Snowflake - architecture, performance tuning, security, and data sharing features. Proficient in data modelling, data integration (ETL/ More ❯

Data Engineer | Hybrid | Pontypridd Do you have the right skills and experience for this role Read on to find out, and make your application. IntaPeople are proud and excited to be appointed to recruit an experienced Data Engineer for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very … exciting opportunity to join their fast-growing Data/IT function in this newly created position. You will be joining the data team as one of the first employees in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data … SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative More ❯

Job summary We are looking to recruit an enthusiastic and experienced Lead Data Architect on a fixed term basis to join our team. This post will play a key role in maximizing the potential of the data we collect to improve patient care and services across Wales. The ideal candidate will combine a blend of strong … technical skills with practical flair and commitment to team working for developing and coordinating key data flows into our warehouse environment, to support critical workstreams including a wide range of areas. You will act as a leader within your area, with managerial accountability for some data engineers, warehousing and acquisition professionals. We are looking for a … line manager prior to applying for this post. Main duties of the job The ideal candidate will combine a blend of strong managerial skills with technical flair in data analysis over a wide range of areas. You will act as a leader within your area, with managerial accountability for some data engineers. We are looking for More ❯

Perpay, Inc. seeks a Data Engineer in Philadelphia, PA. The Data Engineer will analyze, resolve, and optimize data-related challenges, implement solutions to unify application data from various sources, and facilitate automated data solutions across business domains for … enhanced scalability. Additional specific job duties will include: Develop architecture and model important performance metrics and organize data models within a high-capacity analytical data lake house using SQL, Python, and Spark; Analyze the execution plan high latency and/or long run time data models and deploy optimized and efficient improvements by … processing methods to facilitate rapid reporting; Implement solutions to bring together application data generated by distributed first and third-party systems driving our centralized data lake; Maintain Perpay's complex cloud-based data infrastructure using Terraform and build new infrastructure POCs to explore viable updates and upgrades in a staging environment; Contribute to More ❯

building a high-impact team in Northern Ireland. The Role: You'll build robust backend services in Go that power both the data platform (data lake, pipelines, model serving) and product-facing APIs . You'll collaborate with Data Science (leaders, DS, ML engineers, data engineers) to standardize tooling, operationalize models … and real-time/batch inference * Help standardize frameworks, libraries, and best practices across DS/Eng (packaging, environments, CI/CD, testing) * Contribute to the data lake/data platform foundations (catalog, lineage, governance, access patterns) Backend APIs & Services * Build and evolve gRPC/REST APIs powering customer-facing features and internal platforms * Implement … analytics (Parquet/Arrow) Career Paths (we're hiring multiple profiles): * Go Backend (API-first): Own product APIs, performance, reliability. * Go Platform (ML-first): Focus on data lake, pipelines, model serving. * Hybrid: Split time across APIs and ML platform enablement. * Growth routes to Senior or Tech Lead as the NI team scales. Why Join: * Shape a greenfield More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to … join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how … modernise legacy systems, migrate data to the cloud, and optimise data storage and processing costs. Ensure the integrity of datasets within the data lake aligns with logical models and that data is well documented in wikis, data dictionaries, etc. Participate in data engineering sprints, develop data More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to … join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how … modernise legacy systems, migrate data to the cloud, and optimise data storage and processing costs. Ensure the integrity of datasets within the data lake aligns with logical models and that data is well documented in wikis, data dictionaries, etc. Participate in data engineering sprints, develop data More ❯

Head of Data & BI Location: Ealing/London (Hybrid/remote limited travel to the office) Salary: Competitive Contract type: Fixed-Term Contract (6-8 months) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing the power of data to drive organisational change? Do you have … the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. Were looking for an Head of Data & BI to lead on the delivery of A2Dominions Data & BI Strategy. Youll oversee governance, data … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Title: Sr Data Tester Duration 6 to 12 months + Possibility of extending further Location Boston, MA or Springfield, MA (Candidates choice) Work Mode Hybrid 3 days onsite/2 days remote per week Client Mass Mutual Total Exp 13+ yrs Ideal Candidate - The ideal candidate will be responsible for testing data flows from SAP source … systems hence someone with a minimum understanding of SAP functional modules, how to extract the data from SAP system writing SQL queries and validate it, it is not a traditional QA tester profiles were looking. Were looking for a Data Testers.This role combines technical data testing skills with functional knowledge of SAP modules Skill … Matrix:SQL writing queries: Data testing experience: Understanding of SAP data structures, tables, and functional modules (e.g., FI/CO, MM, SD, HR, etc -Experience with ETL: Job Description Role: Senior Data Tester Employment Type: Contract Contract Duration 6 months + high possibility of extending further Work location: Remote/Onsite (mention no. of More ❯

Head of Data & BI Location: Ealing/London (Hybrid/remote – limited travel to the office) Salary: £Competitive Contract type: Fixed-Term Contract (6-8 months) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing the power of data to drive organisational change? Do you have … the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Head of Data & BI to lead on the delivery of A2Dominion’s Data & BI Strategy. You’ll oversee … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Head of Data & BI Location: Ealing/London (Hybrid/remote – limited travel to the office) Salary: £Competitive Contract type: Fixed-Term Contract (6-8 months) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing the power of data to drive organisational change? Do you have … the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Head of Data & BI to lead on the delivery of A2Dominion’s Data & BI Strategy. You’ll oversee … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Data Services Manager, Must live within 2 hours of London or Berkshire and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Financial service background mandatory. Expanding financial services client are looking … for a Data Services Manager to join their team. The role will suit a candidate who has been a manager for a couple of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Interim Head of Data & BI (Inside IR35 – via Umbrella or PAYE) Location: Ealing/London (Hybrid/remote – limited travel to the office) Day Rate: £Highly Competitive Contract type: Interim/Contract (35 hours per week, Monday to Friday) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing … the power of data to drive organisational change? Do you have the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Interim Head of Data & BI to lead … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Interim Head of Data & BI (Inside IR35 – via Umbrella or PAYE) Location: Ealing/London (Hybrid/remote – limited travel to the office) Day Rate: £Highly Competitive Contract type: Interim/Contract (35 hours per week, Monday to Friday) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing … the power of data to drive organisational change? Do you have the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Interim Head of Data & BI to lead … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Interim Head of Data & BI (Inside IR35 – via Umbrella or PAYE) Location: Ealing/London (Hybrid/remote – limited travel to the office) Day Rate: £Highly Competitive Contract type: Interim/Contract (35 hours per week, Monday to Friday) DBS Level - Basic Shape the future of data and insight at A2Dominion Are you passionate about harnessing … the power of data to drive organisational change? Do you have the leadership and vision to build a robust data culture, ensuring governance, quality, and actionable insights across the business? If so, this is an exciting opportunity to make a real impact. We’re looking for an Interim Head of Data & BI to lead … in a similar role within the Public Sector is essential, with housing sector experience highly desirable. Strong technical expertise with MS Azure Data Warehousing (Data Lake, Data Factory, Synapse, Databricks), SQL, Power BI, and other visualisation tools. Experience delivering large, cross-functional data projects in a corporate setting. Excellent communicator, able More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

Lead Data Engineer (Ab Initio/AWS/Data Pipelines) Location: Reston, VA (Hybrid - onsite roughly once every 1-2 months) Duration: 12-Month Contract About the Role We're looking for a Lead Data Engineer to build and optimize cloud-based data pipelines supporting large-scale AI and analytics initiatives. You … ll lead the design and implementation of data integration solutions using Ab Initio and AWS services, helping modernize how enterprise data is moved, transformed, and leveraged for AI/ML applications. What You'll Do Design, develop, and maintain ETL/ELT data pipelines using Ab Initio. Move structured and unstructured data … problem-solving skills with the ability to collaborate across functions. Nice to Have Experience supporting AI/ML or data-driven applications. Familiarity with data lake, data warehouse, and big data technologies. AWS certifications or cloud data engineering credentials. Ref: (ALTA IT More ❯

Data Scientist Data Scientist Initial 6-month contract £475 to £500 per day Outside IR35 Remote Working (+ occasional site visits) The Opportunity ISR are supporting a major UK Government Agency seeking an experienced Data Scientist to help shape and expand their data and analytics capabilities. You’ll play a key role … in designing and delivering advanced data models, integrating new sources of information and applying modern AI and machine learning techniques to solve real-world challenges. This role is ideal for someone who thrives at the intersection of data science, analytics, and public sector transformation, helping to deliver better outcomes for the general public through data … understanding of statistical modelling and machine learning. Experience with Azure Machine Learning (AML), Azure Data Factory, and the broader Azure data ecosystem (Data Lake, Synapse, Analysis Services). Expertise in Natural Language Processing, clustering algorithms, text embeddings, LangChain and LLM deployment. Strong knowledge of data visualisation tools such as Power BI More ❯

Senior Data Engineer, Databricks, 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham (mid level roles also available at 40000 - 50000) Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a … distinct advantage. Expanding SaaS product company are looking for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯