151 to 175 of 526 Data Lake Jobs in the UK excluding London

seeking a Senior Engineer, Qlik Sense out of our London office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more efficient, transparent financial markets. With over 100 years of experience and colleagues in over 30 countries, Fitch Group's culture of credibility, independence … transparency is embedded throughout its structure, which includes Fitch Ratings, one of the world's top three credit ratings agencies, and Fitch Solutions, a leading provider of insights, data and analytics. With dual headquarters in London and New York, Fitch Group is owned by Hearst. Fitch's Technology & Data Team is a dynamic department where innovation … a team-oriented mindset. Bachelor's degree in CS or comparable What Would Make You Stand Out: Familiar with AWS services such as EC2, S3 and Data Lake Experience with Power BI and Tableau Knowledge of Qlik SaaS and Qlik Sense architecture and administration concepts. Experience with Artificial Intelligence (AI) technologies and frameworks. Why Choose Fitch: Hybrid More ❯

Provide architectural guidance on security, compliance, and governance in cloud solutions. Collaborate with stakeholders to create digital roadmaps for long-term cloud transformation. Design conceptual, logical, and physical data architectures that support business and analytics needs. Implement data cataloging and data governance frameworks to enhance data discovery, lineage tracking, and compliance. Define … data modeling standards, ensuring alignment with business intelligence, AI/ML, and analytics strategies. Develop data security frameworks, including encryption, access control, and data masking. Support data migration and transitioning strategies, ensuring minimal disruption to business operations. Optimize data storage and retrieval mechanisms across cloud-based databases, preferably Azure CosmosDB … GCP). Enterprise Architecture: Proven ability to design and implement end-to-end cloud solutions, including multi-cloud and hybrid models. Strong knowledge of conceptual, logical, and physical data modeling. Experience in data cataloging, data lineage, and governance frameworks. Hands-on experience with cloud-based databases, data lakes, and data More ❯

range of exciting challenges including cloud computing, AI, consolidation, migration, integrations, simplification, and Digital Experiences. Solutions typically involve changes to, or creation of, business processes, operating model, application, data flows, infrastructure, and integration of third-party services. You have a solid grasp of the concepts of business goals, objectives and business outcomes, business capabilities, value-streams and business … and architecture patterns to translate business, non-functional and technical requirements into an execution-ready architectural design. Works closely with business analysts and engineers to provide customer-centric, data-driven, traceable architecture designs for components that are traceable to transition state and change requirements. Understands business and technical capabilities (future and current state), and how solutions support their … Spring Boot, Micronaut, ASP .NET Core Microsoft technologies, Azure platform and .Net ecosystem Development languages like .Net, Java, Python Database technologies and platforms like SQL, NoSQL, Data Lake, Snowflake, Databricks, MongoDB, Oracle Frontend web development languages like React, Angular, JavaScript, HTML and CSS Observability platforms like Splunk, Dynatrace, Datadog, Grafana Integration technologies like REST, Kafka, iPaaS, API More ❯

Social network you want to login/join with: Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in … expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management: Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data More ❯

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. The role comes with an extensive benefits package including a good pension … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position. More ❯

login/join with: Duration: contract to run until 31/12/2025 Rate: up to £644 p/d Umbrellainside IR35 We are seeking an experienced Data Modeller with proven expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise … data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are scalable, accurate, and aligned with business needs. Key Skills/requirements Design and maintain conceptual, logical, and physical data models to support reporting, analytics, and operational systems. Collaborate with data engineers and … to explain complex data concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data requirements More ❯

Lead Data Solution Architect £80,000 to 110,000 GBP Bonus Hybrid WORKING Location: United Kingdom (Greater London) Type: Permanent Role: Lead Data Solution Architect Work Type & Location: Hybrid (London-based with flexible remote-first setup) Role Type: Permanent Start Date: ASAP Salary: £80,000 - £110,000 DOE A global technology consultancy is expanding its UK … Data & Intelligence team and looking for a highly skilled Lead Data Solution Architect . You'll work at the forefront of cloud-native data architecture, shaping and delivering cutting-edge data solutions for high-profile clients across a range of industries. This is a hands-on leadership role that combines deep architectural … Proven experience as a Lead Data Architect or Senior Data Solutions Architect Expertise in Kafka/Confluent , Databricks , Unity Catalog , and modern data lake/lakehouse architectures Strong grasp of cloud data platforms (AWS, Azure, GCP, Snowflake) Understanding of Data Mesh , Data Fabric , and data More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Job Description Job Title: Azure Data Architect Location: Hybrid – (1-2 days/week in Dunstable) Rate: Inside IR35 Contract Duration: 6 months About the Role We are looking for an experienced Azure Data Architect to join an innovative, data-driven transformation programme. This role offers the opportunity to work on cutting-edge cloud … data solutions and collaborate closely with enterprise architecture teams on high-impact projects. You’ll be instrumental in designing and implementing robust, scalable data platforms using the latest Azure technologies. Key Responsibilities Collaborate with stakeholders to gather and analyse business and technical requirements Develop high-level and detailed solution designs for cloud-based data … of hands-on experience delivering data architecture solutions on Microsoft Azure Strong understanding of Azure services including Data Factory, Databricks, Synapse Analytics, Data Lake, Delta Lake, SQL Database, Key Vault , and Power BI Experience in lakehouse architecture design and implementation Proven ability to prepare and present architecture documents Proficient in evaluating and More ❯

come. If you want to be part of a diverse team where opportunities flow and fresh ideas are welcomed, #JustAddWater. We currently have an opportunity for an Azure Data Architect to join our team based in Exeter. This is a Permanent Full-time position with a salary of £70,000 per annum plus excellent benefits. About the role … decision-making. What you’ll be doing: Design and implement data solutions on Azure, using services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB, and more. Make informed decisions on the strategic direction and roadmap for cloud platform use and … Architect or similar role. Deep understanding of database structure principles. Experience with Azure data technologies such as Azure SQL, Data Factory, Data Lake, Cosmos DB, PowerBI, and SQL. BSc in Computer Science, IT, or a relevant field. Ideally based in Exeter, or out of our Bristol or Redhill office. What's in More ❯

Join our Data & Insight team to architect Movera's data ecosystem on Azure. You'll develop data pipelines, manage the data lake, and transform data for high-performance Power BI reporting. Collaborate with stakeholders to deliver the Data roadmap, ensuring a single source of truth and robust … the Head of Data & Insight, and other members of the team to ensure clarity on the backlog for data requirements into the data lake Have a full understanding of the various business units and business objectives, and how these are reflected in the Business Hierarches, Business Metrics and reporting architecture. Strong working knowledge … of business processes and all relevant current Systems/Data sources, to understand, shape and validate the feed of data into the data lake Support in maintaining both a robust production and a parallel development environment Full documentation of all processes to feed both the data lake and power BI More ❯

Join our Data & Insight team to architect Movera's data ecosystem on Azure. You'll develop data pipelines, manage the data lake, and transform data for high-performance Power BI reporting. Collaborate with stakeholders to deliver the Data roadmap, ensuring a single source of truth and robust … the Head of Data & Insight, and other members of the team to ensure clarity on the backlog for data requirements into the data lake Have a full understanding of the various business units and business objectives, and how these are reflected in the Business Hierarches, Business Metrics and reporting architecture. Strong working knowledge … of business processes and all relevant current Systems/Data sources, to understand, shape and validate the feed of data into the data lake Support in maintaining both a robust production and a parallel development environment Full documentation of all processes to feed both the data lake and power BI More ❯

Snowflake Data Engineer Milton Keynes (Hybrid) 3 Month Contract £400/day (Outside IR35) Snowflake Data Engineer needed with experience of data migration projects. 3 Month Rolling Contract based in Milton Keynes (Hybrid remote). A chance to work with an established global IT, Digital and Network Services Consultancy for an end client in … a 'hybrid' basis with 2-3 days/week working remotely from home (WFH). Outside IR35. Start ASAP in Feb 2025. Key experience + tasks will include: Data Engineer with strong experience of designing + implementing Snowflake data solutions environments. Designing business processes + implementing cloud-based enterprise data warehouse solutions architecture … using Snowflake. Data Migration of legacy systems to new Snowflake environment including: cloud data warehouse, cloud data platform set-up, data lake/data platform design, integrating new features, customizations + interfaces. Creating High-level and Low-level design documents (HLD, LLD) and functionality analysis for COTS solution. Deep More ❯

Azure Data Engineer Manchester Up to £65k On behalf of our industry-leading client, we are recruiting for a talented Azure Data Engineer. As Azure Data Engineer, you will be working closely with Data Engineering, Business Services, and Technical Partners to create and integrate Azure Data Engineering pipelines transforming core … systems data into knowledge. The Azure Data Engineer will be responsible for: Working with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off-premises data … efficiently tested, deployed, updated, maintained, and managed The Azure Data Engineer will have the following: Experienceworkingin an Agile environment Advanced SQL coding skills Azure Data Lake (Gen 1 and 2) Azure Analysis Services Azure SQL Data Warehouse (Synapse Analytics) Azure Data Factory Experience working with large JSON documents Strong data More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. … You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use … collaborative environment and adapts to changing priorities with ease. • Excellent communication and presentation skills, capable of conveying complex ideas to both technical and non-technical stakeholders. • Deep understanding of DataLake, Lakehouse, and Warehouse paradigms. • Extensive experience in developing and maintaining data pipelines for ELT/ETL from various data sources, including databases, APIs, text files, and More ❯

Azure Data Engineer – Manchester– Up to £65k On behalf of our industry-leading client, we are recruiting for a talented Azure Data Engineer. As Azure Data Engineer, you will be working closely with Data Engineering, Business Services, and Technical Partners to create and integrate Azure Data Engineering pipelines transforming core … systems data into knowledge. The Azure Data Engineer will be responsible for: Working with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off-premises data … efficiently tested, deployed, updated, maintained, and managed The Azure Data Engineer will have the following: Experienceworkingin an Agile environment Advanced SQL coding skills Azure Data Lake (Gen 1 and 2) Azure Analysis Services Azure SQL Data Warehouse (Synapse Analytics) Azure Data Factory Experience working with large JSON documents Strong data More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data … you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar with Cloud security, performance optimisation and monitoring More ❯

Social network you want to login/join with: A rapidly growing Microsoft Partner Consultancy are looking for a number of Data Engineers and Senior Data Engineers to join their expanding team. They’ve developed a cutting-edge Microsoft Data Platform to help customers accelerate their data journeys – through better data management and insight generation, and making it easier than ever to make better data-driven decisions! With clients spread across the UK and Europe, this role is remote, and therefore open to candidates across the UK. Every other month there is a company-wide event, allowing you to celebrate success and socialise with your colleagues. As … pipelines, through to data analytics visualisation. You can expect to work on a tech stack including Python, SQL, Azure Data Factory, Azure Data Lake, Azure Synapse, Dynamics 365, Power BI and Fabric. If you join as a Senior Data Engineer, you will also take responsibility for coordinating a team and driving More ❯

Data Engineer – Shape the Future of Data Innovation Belfast, Northern Ireland (Hybrid) Competitive Salary - Up to £55,000 An exciting opportunity has opened for an experienced Data Engineer to design and build large-scale data solutions in a fast-paced, high-impact environment. This role is ideal for someone with a strong … background in AWS cloud technologies, ETL pipelines, data warehousing, and big data architectures. The Role As a Data Engineer , you will: Design and deploy production data pipelines from ingestion to consumption within a big data architecture. Work with technologies such as Python, Java, Scala, Spark, and SQL to extract, clean … transform, and integrate data. Build scalable solutions using AWS services like EMR, Glue, Redshift, Kinesis, Lambda, and DynamoDB. Process large volumes of structured and unstructured data, integrating multiple sources to create efficient data pipelines. Collaborate with engineering teams to integrate data solutions into production systems. Contribute to Agile teams, participating in Scrum ceremonies and More ❯

Social network you want to login/join with: Senior and Mid-Level Data Engineering Roles - Remote - £50k - £75k My client are a young, expanding Microsoft Partner and are actively searching for senior and mid-level data engineers to join their in-demand data engineering function. If you are an expert with the Azure … Data Stack and have consulting experience this will be a great opportunity for you. Salary and Benefits Salary of £50k - £75k (DOE) Discretionary bonus of up to 10% Fully remote working (office attendance required once per month) And many more! Role and Responsibilities Collaborate with … a variety of clients to gather requirements and transform these into tailored Azure-focused solutions Expert knowledge and deployment of Azure Data Factory, Synapse, Data Lake Storage, Python You will navigate clients ERP environments (particularly SAP and/or Dynamics 365) Recognise and share opportunities to re-use existing data flows between teams More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Fruition Group Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital … transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Search by ‘Skills’ or ‘Keywords’ or 'Requisition ID’ Search by Location Select how often (in days) to receive an alert: Work with us Title: Data and Analytics Architect - L1 Requisition ID: 72555 Country/Region: GB Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that … engineering with tools such as Spark, Databricks,scala/Pyspark or SQL Strong understanding of ETL/ELT pipelines, distributed data processing and data lake architecture. Having exposure to ETL tools such as Informatica, Datastage or talend is added advantage Experience with Unity catalog, Delta lake and modern data lakehouse concepts … enterprise technology environment for data architecture management a. Develop, maintain and implement standard patterns for data layers, data stores, data hub & lake and data management processes b. Evaluate all the implemented systems to determine their viability in terms of cost effectiveness c. Collect all the structural and non-structural More ❯

Social network you want to login/join with: Senior Data Engineer (SC Cleared), Leeds, West Yorkshire Client: CALIO Consulting Group (CCG) Location: Leeds, West Yorkshire, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 Job Description: Key Responsibilities Lead the technical delivery of complex data engineering … projects, ensuring solutions are scalable, secure, and aligned with our delivery framework and client goals. Design and build high-quality data pipelines and integration workflows, setting the technical direction and ensuring engineering best practices are followed throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯