1 to 25 of 110 Data Lake Jobs in the South East

We are seeking a highly skilled and experienced Master Data Management (MDM) Profisee Architect to join our dynamic data team. Reporting to the Head of Data Management, you will play a critical role in shaping and implementing the MDM architecture roadmap. Your expertise in … later stages. As the steward of the MDM model, you will ensure the uniformity, accuracy, and consistency of the enterprise's shared master data assets, upholding the Single Source of Truth (SSOT) principle for all decision-making processes across the organisation. What you'll do as a MDM … procedures to ensure data quality and integrity. Strong technical proficiency in data architecture, Big Data, Data Lake, and Lakehouse storage solutions. Excellent written and verbal communication skills, with the ability to lead cross-functional teams. Desirable Experience: Experience within the water More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

daily towards creating the world we want tomorrow. Job Description: Lead Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯

a Research DataOps Engineer with a passion for research delivery, to join an Oxford University spin-out and to implement a Data Lake House from the ground up. This role is critical to support the next phase of our medical imaging AI and Analytics research. The role … individuals to support a variety of data and computing needs. The successful candidate will design and build out a data lake house, whilst being expected to actively contribute to ongoing data-centric product research. The ideal candidate will: be motivated at the thought … other and acting with candour and professionalism. Responsibilities Responsibilities include some or all of the following: Design and build a secure Data Lake House infrastructure to support AI and Data Analytics Research Manage Cloud/On-premises compute resources to achieve research objectives Contribute to More ❯

a – Data Architect , you will be responsible for designing end-to-end data solutions for large-scale Data Lake (Big Data) projects. You will guide the full lifecycle of business intelligence solutions, from requirements analysis and platform selection to architecture design … performing data architecture Your Profile Essential skills/knowledge/experience: Extensive experience as Solution Designer. Currently working on Data Lake (Big Data) based projects. Experience in Snowflake, DBT, Glue, Airflow. Ability to demonstrate structured consideration of multiple options, comparing competing technologies, and … approaches e.g., Produce a KDD. Ability to present and discuss competing options and make recommendations to key stakeholders. Good understanding of Data Lake and Big Data technologies. Good understanding of Insurance Domain. Experience in data vault model. Understanding of AWS Services. Rewards & Benefits More ❯

The Role As a – DevOps , you will be responsible for designing end-to-end data solutions for large-scale Data Lake (Big Data) projects. You will guide the full lifecycle of business intelligence solutions, from requirements analysis and platform selection to architecture design … performing data architecture. Your Profile Essential skills/knowledge/experience: Extensive experience as Solution Designer. Currently working on Data Lake (Big Data) based projects. Experience in Snowflake, DBT, Glue, Airflow. Ability to demonstrate structured consideration of multiple options, comparing competing technologies, and … approaches e.g., Produce a KDD. Ability to present and discuss competing options and make recommendations to key stakeholders. Good understanding of Data Lake and Big Data technologies. Good understanding of Insurance Domain. Experience in data vault model. Understanding of AWS Services. Rewards & Benefits More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Architect - Flexible location Bibby Financial Services have an exciting opportunity available for a Data Architect to join our team, working in any of our UK locations with travel to Banbury required when necessary . You will join us on a full time, permanent basis and … hired in the first place. We want you to make the choices you believe in – we’ll believe in them too. As our Data Architect, we will reward you and your hard work with: Company car allowance Private healthcare for you and your family Company pension scheme Wide … releases. You will have worked with the latest Azure data platform technologies, particularly Azure Data Factory, Azure Data Lake Storage and Azure Databricks. Hands on experience of working in Databricks. In particular design and usage of the Delta Lake storage format. Hands More ❯

an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data … as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … and standards to secure clinical data both in-motion and at-rest. Shape Data Workflows: Utilize Databricks components like Delta Lake, Unity Catalog, and ML Flow to ensure efficient, secure, and reliable data workflows. Key Responsibilities Data Engineering with Databricks: Design … data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical More ❯

growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying, and real-time data streaming. Establish and enforce best … practices in data engineering, coding standards, and architecture guidelines. Build and manage data lake architecture s on AWS to support scalable, secure, and cost-efficient storage and processing of structured and unstructured data. Manage team tasks and delivery using Agile methodologies, collaborating closely with product … experience in data engineering and ETL architecture. Deep expertise in AWS Data Services, including Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation and data lake design. Strong programming skills in Python and PySpark for data processing and automation. Extensive SQL More ❯

Location: Basingstoke (hybrid working 3 office days per week) n Employment Type: Permanent, full time n Additional Benefits: Annual Bonus n Join Our Data & Analytics Team: Transforming Data into Our Superpower! n Are you passionate about data and eager to make a significant impact … n As a Data Engineer, you’ll be crucial in developing and maintaining our data pipelines and data lake house architecture. You’ll be central to the success of our data team\\\'s efforts to maximise our data capabilities. … and maintaining resilient data pipelines n Identifying and automating manual or repetitive data processes. n Establishing the data lake house as a single source of insight for the business. n Developing analytical datasets to support insights into customer behaviour, operational efficiency and key More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

Senior Data Engineers x 2 for Kent based concern My client is seeking to recruit Senior Data Engineers to join its expanding IT operation To be considered for these positions you will need to have experience in the following areas - Good … Data Engineering/ETL development experience - Data design experience in an MI/BI/Analytics environment (for example Kimball, lake house, data lake) - Good experience working in a structured Change Management project lifecycle - Excellent Data Warehouse skills - A strong … knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential. - Strong demonstrable knowledge of data warehouse methodologies - Robust understanding of high-level business processes - Understanding of data migration, including reconciliation, data cleanse More ❯

across various industries. With a presence in over 50 countries, HCLTech leverages cutting-edge technologies, including artificial intelligence (AI), machine learning (ML), and data analytics, to deliver exceptional solutions that empower businesses to achieve their goals. Objectives of this Role As a Data & AI Principal at … HCLTech, you will serve as the main point of contact for all Data & AI engagements, addressing client concerns and needs. You will manage large strategic accounts valued at $10M+, focusing on growth and customer satisfaction. Your role will involve building and strengthening client relationships to achieve long-term … by Microsoft Azure, Google Vertex, or Amazon. Technical know-how and understanding of Cloud Technology, Cloud Data Warehouse, and Data Lake platforms. Expertise in Data Governance practices, including leading solutions for Data Quality, Data Profiling, Data Catalog More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key … expertise and experience we’re looking for: Data Engineering in Databricks – Spark programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks … Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data More ❯

Data Architect Our client, a leading financial services corporation, is hiring a Data Architect to drive & design our client's data strategy as they move from on-prem to Azure cloud services. You will be part of a team designing and managing data systems primarily in Azure, ensuring alignment with business goals and requirements. To be successful, you must have strong expertise in Azure-based data solutions working within a regulated environment. Our client is paying a basic salary of £83,000 circa + 15% bonus/28 days holiday … various data sources (on-premises, cloud-based, and third-party) into the Azure environment. Utilise Azure services like Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Databricks for data storage, transformation, and analysis. Core skills and experience: Previous experience acting More ❯