1 to 25 of 52 Data Lake Jobs in the North of England

ADF Data Engineer ADF Data Engineer - SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric, Data Warehousing, Agile - Hybrid (Warrington) - £50k + excellent bonus + excellent bens An experienced ADF Data Engineer is urgently required by my client … with strong experience of the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric). You will be responsible for helping to build a new, best practice-based data warehouse solution which will function Enterprise-wide. You will … role on a product development programme using the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric) - Work collaboratively within an Agile team of Developers, Testers and BA/Product Owners on a set of new greenfield projects - Observe object More ❯

Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potential Your New Company Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data … and DevOps teams to align operational strategies with technical and business requirements. Optimize operational performance and cost management for services including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage. Serve as the domain expert in DataOps by providing strategic guidance, mentoring colleagues, and driving continuous process improvements. What you will … within the Microsoft Azure ecosystem. Hands-on expertise with Azure Data Platform with components such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Azure SQL, Purview and APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark More ❯

SQL BI Developer SQL BI Developer - SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric, Data Warehousing, Agile - Hybrid (Warrington) - £45-50k + excellent bonus + excellent bens An experienced SQL BI Developer is urgently required by my client with strong experience of … the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric). You will be responsible for helping to build a new, best practice-based reporting solution which will function Enterprise-wide. You will be involved in the full software development … role on a product development programme using the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric) - Work collaboratively within an Agile team of Developers, Testers and BA/Product Owners on a set of new greenfield projects - Observe object More ❯

management technical knowledge so as to be able to work across full data cycle. • Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD • Coding experience in Apache Spark, Iceberg or Python (Pandas) • Experience in change and release management. • Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: • Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB • Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) • Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. • Experience is building Data lake and building CI/CD data pipelines • A candidate is expected More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the … latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop … approaches and can apply data security and privacy strategy to solve business problems You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.) Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Hybrid - Manchester Industry: Retail & eCommerce Role: Senior Data Engineer Location: Hybrid (1-2 days in Manchester) Salary: £65,000 + Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid … growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. … driven recruitment consultancy supporting data and technology professionals connect with forward-thinking businesses who enhance our tomorrow. Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Hybrid - Manchester More ❯

that adventure. Our employees are at the heart of delivering impactful and meaningful work for our clients and helping them to reach for and realise their vision. Snowflake Data Architect Slalom is seeking an experienced Snowflake Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional … with experience in designing, developing, validating and communicating enterprise data solutions using Snowflake. Deep experience in developing enterprise data management strategies including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. What will you do? Lead as …/advise clients on reference architectures Requirements: Expert in capturing end user requirements and aligning technical solutions to the business objectives Experience in leading, designing and implementing Cloud Data strategies, including designing multi-phased implementation roadmaps Significant experience (and ideally certified) in Snowflake and acted as lead data architect on at least two Snowflake implementations. Expertise More ❯

passionate about helping our people get more out of life too; building careers with real growth, a sense of purpose, belonging and wellbeing. About the role This Principal Data Engineer role will work exclusively within our AdTech business unit whilst ensuring alignment to best practices, standards, and policies. The strategic direction is led by the Data … from this role. This role will work within the AdTech squad focusing on their priorities that will enable a consistent, efficient, and effective use of the Data Lake, Enterprise Data Warehouse, and marketing tools. Any experience with automating process and embedding re-useable patterns is interesting. As our AdTech Principal Data Engineer you … of services across AWS , Google Cloud , Celebrus and OneTrust Key Responsibilities Analysis, design, architecting and development of AdTech data solutions for deployments to the Data Lake and Data Warehouse. Actively engaging with our Data Performance Unit on strategic direction, technology, and delivery excellence. Peer/code review for other team members. More ❯

The Role KOMI Group is looking for a Data Analyst to work on a variety of exciting data projects in the market. Reporting to the CFO, you will play a key role in delivering value to the business by helping us leverage data effectively. As a Data Analyst, you will maintain and … develop KOMI's data warehouse and visualisation infrastructure by performing high-quality technical work. The successful candidate will have a solid foundation in SQL, Azure DevOps and cloud data warehousing, with strong communication and analytical skills. The ideal candidate will be an enthusiastic data professional with a strong foundation in data analytics … and managing CI/CD pipelines, source control (Git), and automated testing/deployment for data engineering workflows. Knowledge of Microsoft Azure (e.g., Azure Data Lake, Azure Functions) and its integration with Snowflake. Knowledge in Python for automation and data processing tasks. Knowledge of ELT tools like Kleene or Fivetran. Experience with visualisation More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Data Platform Engineer Elland with flexible working Competitive Salary & Benefits Marshalls plc is the UK's leading hard landscaping, building and roofing products supplier and has supplied some of the most prestigious landmarks in the UK since the 1890s. We're the benchmark for excellence and have been recognised as a Superbrand since 2010. As well as exceptional … service, technical innovation, and manufacturing expertise, we continue to be a leader in our field in corporate responsibility and sustainable business practice. We are looking for an experienced Data Platform Engineer to join our Data & Insights team to support the design, development, and maintenance of robust, secure, and reliable data pipelines that serve key … AX/D365 , CRM, and third-party platforms. Manage the capacity, scalability, and configuration of the data platform, including SQL Server, SQL MI, Synapse, Data Lake , and Microsoft Fabric , in collaboration with infrastructure and security teams. Support the migration to Microsoft Fabric , ensuring modern, efficient data architecture. Ensure data quality, consistency More ❯

Databricks Data Engineer (roles available at Lead, Senior and Mid Level), £ 50000 - 85000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. … Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Azure Data Engineer - Leeds (Hybrid) - £65,000 Are you an experienced Azure Data Engineer with a passion for building scalable, cloud-native data solutions? We're recruiting on behalf of a dynamic organisation in Leeds that's investing in its data platform - and they're looking for someone with strong Databricks … expertise to join their team. About the role: Designing and developing robust data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Working with Delta Lake and Azure Data Lake Storage to manage and optimise large datasets. Collaborating with data analysts, engineers, and business stakeholders to deliver clean, reliable data. … Azure-based architecture Ensuring best practices in data governance, security, and performance tuning Requirements: Proven experience with Azure Data Services (ADF, Synapse, Data Lake) Strong hands-on experience with Databricks (including PySpark or SQL) Solid SQL skills and understanding of data modelling and ETL/ELT processes Familiarity with Delta Lake More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the … architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to … outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently in use More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … in an agile team.Experience working in a highly regulated industry and with highly sensitive data.Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.Experience in data science using R, Stata, or Python.Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket.Understanding of clinical trials, GCP, and GxP.What We Offer More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team responsible … for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks. This is an excellent opportunity to join a company as it continues to grow and expand its data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … ETL processes to integrate data into our mobile and web applications, as well as internal dashboards. Data Architecture Design: Develop and optimise data storage, retrieval, and processing systems to ensure efficiency and scalability. Collaboration: Work closely with data scientists, software engineers, and internal stakeholders to understand data needs and deliver … solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such as Airflow, Spark, or TensorFlow. Data Engineering Fundamentals: Strong understanding of data architecture, data More ❯

Data Engineer Join a Trailblazing Team in Clinical Research Data ManagementStep into a role that places you at the cutting edge of clinical trials, leveraging Electronic Health Record (EHR) data to revolutionise patient care and research. Based in the innovative Manchester Science Park, this position offers the chance to be part of a world … is usually on Tuesdays and Thursdays but can be subject to change. Strong benefits package This role focuses on the development, performance, management, and troubleshooting of ETL processes, data pipelines, and data infrastructure. The successful candidate will ensure the effective and reliable operation of these systems, adopting new tools and technologies to stay ahead of industry … database testing; unit, performance, stress, security.- Experience in agile teams and highly regulated industries.- Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.- Data science experience using R, Stata, or Python.- Familiarity with Atlassian tools; JIRA, Confluence, BitBucket.- Understanding of clinical trials, GCP, and GxP.Personal Attributes:- Strong collaboration More ❯

Haywards Heath, Home Office (Remote) or Manchester Salary: £55,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an excellent service. And that's … Lead Finance Solutions Developer 1st Central are on the lookout for a technically strong and analytically minded Lead Finance Solutions Developer who can bridge the gap between finance, data engineering, and actuarial analytics. If you're passionate about delivering high-quality, scalable data solutions to support business-critical decisions, and you enjoy working across multidisciplinary teams … related field. Strong SQL and data modelling skills; experience with relational databases. Skilled in working with cloud platforms (e.g., AWS, Azure, or GCP) and data lake environments. Experience with actuarial models, principles, and data structures (e.g., Actuarial reserving techniques, cashflow projections under Solvency II and IFRS 17) life tables, claims triangles, policy reserves More ❯