151 to 175 of 385 Data Lake Jobs in England

Recruiter Ltd seeks an experienced Data Engineer to support a data migration and integration programme in a relatively low maturity Azure … environment. You will design, build and maintain data pipelines, migrating data from diverse legacy systems to Azure Data Lake and Databricks. You will also integrate data into a proprietary transformation solution and work with a range of source systems including Oracle ...

Title: Data Engineer Location: Liverpool, UK Salary: £65,000 - £70,000 per annum, depending on experience Job Type: Permanent, Full Time Working Hours: 37.5 hours per week, Monday to Friday, 9am to 5:30pm We are seeking a talented and experienced Data Engineer to join … innovative and collaborative Database and AI Team. In this role, you will play a key part in shaping our data strategy and driving business success. Your skills will contribute directly to our forward-thinking initiatives. At Acorn we value and prioritise innovation, teamwork, and continuous development. Key part ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling such as CI/CD pipelines and version control The ability … will be responsible for the design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisation’s architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

Envitia is a UK-based software and services company that helps organisations unlock the full value of their data to make better, faster decisions. With over 30 years of experience, we specialise in delivering innovative software products, solutions, and consultancy services that transform complex data challenges … into actionable insights. Our mission is to empower customers across defence, government, and national security sectors to harness the power of data — from geospatial intelligence to advanced analytics and AI integration. We are proud to be a trusted partner to UK defence and government organisations, delivering technology that ...

Data Engineer/Data Analyst to support a ledger migration and data-cleanup across the data lake, reporting, and downstream feeds. The role focuses on large-scale batch processing, data validation, and regression testing within a dynamic financial services … environment. Key tasks include data extraction, transformation and reconciliation to ensure data integrity throughout migration, contributing to migration readiness and timely delivery in a fast-paced #J-18808-Ljbffr ...

Role: Data Team Lead- AD Location: London Salary: Competitive salary and package dependent on experience Career Level: Associate Managing Director (CL5) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance, which requires 5 years continuous UK address history at the point … drive adoption of modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Provide strategic direction across data architecture, engineering, analytics, governance and AI. Own delivery across large, complex programmes, ensuring scope ...

Role: Data Team Lead- AD Location: London Salary: Competitive salary and package dependent on experience Career Level: Associate Managing Director (CL5) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance, which requires 5 years continuous UK address history at the point … drive adoption of modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Provide strategic direction across data architecture, engineering, analytics, governance and AI. Own delivery across large, complex programmes, ensuring scope ...

Cloud Data Architect (Manager) – BIP xTechAbout BIPBIP is an international consultancy working with leading organisations to deliver transformation, create long-lasting value and shape the future with confidence. We bring together deep industry expertise, innovative thinking and a collaborative approach to help our clients solve complex challenges … ValueWe Are Creators of Our Own FutureTogether We Go FurtherAbout BIP xTechBIP xTech is BIP's Centre of Excellence for Artificial Intelligence, Big Data, and Modern Data Platforms. We work with our clients to design and deliver scalable, cloud-native data platforms that enable ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Head of Data & Analytics Department: Technology Employment Type: Full Time Location: London Reporting To: Chief Information Officer Compensation: £100,000 - £110,000/year Description Job Title: Head of Data & Analytics Salary: £100,000- £110,000 + Bonus + EV Allowance Location: Hybrid (2-3 days … week in London office) We're looking for a Head of Data and Analytics to own our data strategy and turn the information flowing through Pod into decisions that grow the business. You'll build and lead a small central data team, and work ...

Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within … relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines, support the Azure Data Lake, and create integrations between source systems, Azure Data Lake and Databricks. Collaboration with stakeholders will shape data transformation ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

Coventry City Council is seeking an experienced BI & Insight Analyst/Data Analyst to support a data transformation project … within Digital & HR Services. The role involves migrating data from the existing data warehouse to a new Data Lake, with HR data a significant focus, and close collaboration with HR teams and stakeholders across the Council. You will develop and maintain ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Capabilities Digital and Data Office Setup Hybrid Job ID #43951 Playing in picture-in-picture Playing in picture-in-picture (opens a new window) Like Add to Watch Later At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...

with hundreds of thousands of restaurant, grocery and convenience partners across the globe About this role We're looking for an experienced Senior Data Engineer to join the Insights & Enablement team within Retail Media Tech at JET. This team sits at the heart of JET's retail media … Core (or dbt Cloud) and Airflow for orchestration and transformation at scale. Solid grounding in data warehouse and data lake architecture, including dimensional modelling and layered architectures (Gold/Silver/Bronze or equivalent). Production experience with GCP (BigQuery, Dataflow ...

About UBDS Digital UBDS Digital, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI, cyber security and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. … highly governed environments Experience with Azure data and integration technologies such as Data Factory, Synapse Analytics, Data Lake Storage, Functions, Logic Apps or API Management Experience with Azure Databricks in large-scale enterprise environments Knowledge of enterprise application and data integration ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

Senior Systems Manager - Data Application Deadline: 29 June 2026 Department: IT and Business Systems Employment Type: Permanent - Full Time Location: Silverstone Description As Senior Systems Manager for Data at Silverstone Circuits, you will be the founder member of our new data team … will lead and support the shaping of this key new capability for Silverstone. You will be responsible for the engineering and governance of our Datalake while acting as a business partner and change advocate, ensuring Silverstone can use data effectively. You’ll bridge technical solutions with commercial objectives ...

Data Migration Specialist Location: Sheffield, UK (Hybrid/Onsite) Contract Duration: 6 Months Start Date: Immediate Are you a senior Data Migration Specialist with deep expertise in Azure data engineering and enterprise-scale transformations? We are looking for a hands-on technical lead … advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration ...

Business Intelligence Developer and Data Engineer Cheshire TBC, Permanent/Full Time Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are you passionate about turning complex data into meaningful insight … that helps businesses make better decisions? We are recruiting on behalf of the 2M Group of Companies for a Business Intelligence Developer and Data Engineer. This is a hands-on role for someone with strong Power BI and SQL skills who can build high-quality reporting and data ...