9 of 9 Data Lake Jobs in the East of England

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the companys data … be based in either UK or Portugal Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … approach. Experience in SaaS or platform-based businesses is a plus Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the company’s data … be based in either UK or Portugal – Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … approach. Experience in SaaS or platform-based businesses is a plus Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

Data Lead This role can be based in either UK or Portugal Who we are? Verifile is an award-winning leading provider of CV verification and background screening services using innovative technology and methodology. We carry out background checks on candidates to enable our clients to make informed and long-term rewarding recruitment decisions. As Data Lead, youll be the driving force behind ensuring our data is accurate, secure, and fully leveraged. Youll create a single source of truth, turning information into actionable insights and uncovering opportunities that give us a competitive edge. Youll design and evolve Verifiles data infrastructure, adopting emerging technologies to boost performance and efficiency. Partnering with … approach. Experience in SaaS or platform-based businesses is a plus. Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

SAP Finance Data & Analytics Specialist ( Interim State Management) Luton - 12 months - outside IR35 - £580 per day The SAP Finance Data & Analytics Specialist wiill be responsible for ‘keeping the lights on’ for all the critical Finance global & local reporting solutions. Apply data, analytics, process, and object expertise to support interim state and S/… design, acting as an integral part of the Data and Analytics design team, considering both business process and analytics requirements. You will be managing 7 non-SAP analytics applications and responding to changes driven by the ongoing S4 Transformation' Essential Skills – 15 + years of experience in SAP Finance projects. Two or more full life-cycle S/…/4HANA and ECC in the FI/CO module functionalities. Experience and knowledge of Analytics tools and Data Warehouses like PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, SAP Analytics Cloud etc. Bachelor’s or master’s degree in finance or accounting or accounting qualifiction Desirable Skills Experience or knowledge in FP&A tools More ❯

Data Engineers ?? Cambridge/Hybrid 2x per week onsite | ?? £60,000£75,000 | ?? SC or DV Clearance Required Were working with a specialist technology consultancy delivering cutting-edge solutions into the UKs most secure government environments. Due to continued growth, theyre looking for a talented Data Engineer to join their secure data team and … help solve complex, high-impact challenges. The role Youll design and develop secure data pipelines and platforms, working on projects that process sensitive, mission-critical information. This is an opportunity to apply your technical skills in an environment where your work has a direct impact on national security. What youll be doing: Build and optimise scalable data … workflows and processes What were looking for: 5+ years of experience in data engineering or related roles Proficiency in Python, Java, Golang, Spark, Azure, Synapse Analytics, SQL, Datalake Technology, PySpark, Python, Azure Functions, Azure Data Factory Nice to have: Scala. Familiarity with Kepler geospatial visualisation tool, or other similar tools, and experience working with geospatial data More ❯

Data Quality Analyst Hybrid two days per week in the office (Luton) Are you ready to play a key role in transforming data quality as part of a major ERP implementation? We're seeking a Data Quality Analyst to support the transition to a modern Enterprise Resource Planning (ERP) system. This role is critical … in improving data accuracy, governance, and overall decision-making across key finance functions, including Record to Report (R2R), Order to Cash (O2C), Source to Pay (S2P), and Financial Planning & Analytics (FP&A). What you'll be doing: Define and document critical data elements in collaboration with business stakeholders. Develop and apply data quality … frameworks, profiling tools, and dashboards. Perform data cleansing and validation to support ERP migration activities. Identify inconsistencies and risks through detailed data profiling and analysis. Work cross-functionally with Finance, IT, and other teams to align data requirements and implement governance best practices. Support continuous improvement initiatives to enhance data processes and More ❯

Data Quality Analyst Hybrid two days per week in the office (Luton) Are you ready to play a key role in transforming data quality as part of a major ERP implementation? We're seeking a Data Quality Analyst to support the transition to a modern Enterprise Resource Planning (ERP) system. This role is critical … in improving data accuracy, governance, and overall decision-making across key finance functions, including Record to Report (R2R), Order to Cash (O2C), Source to Pay (S2P), and Financial Planning & Analytics (FP&A). What you'll be doing: Define and document critical data elements in collaboration with business stakeholders. Develop and apply data quality … frameworks, profiling tools, and dashboards. Perform data cleansing and validation to support ERP migration activities. Identify inconsistencies and risks through detailed data profiling and analysis. Work cross-functionally with Finance, IT, and other teams to align data requirements and implement governance best practices. Support continuous improvement initiatives to enhance data processes and More ❯