1 to 25 of 87 Data Lake Jobs in the South East

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

daily towards creating the world we want tomorrow. Job Description: Lead Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification (Technical Skills): Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯

a Research DataOps Engineer with a passion for research delivery, to join an Oxford University spin-out and to implement a Data Lake House from the ground up. This role is critical to support the next phase of our medical imaging AI and Analytics research. The role … individuals to support a variety of data and computing needs. The successful candidate will design and build out a data lake house, whilst being expected to actively contribute to ongoing data-centric product research. The ideal candidate will: be motivated at the thought … other and acting with candour and professionalism. Responsibilities Responsibilities include some or all of the following: Design and build a secure Data Lake House infrastructure to support AI and Data Analytics Research Manage Cloud/On-premises compute resources to achieve research objectives Contribute to More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

We are Hiring! We are looking for a passionate and skilled Data & AI Solutions Architect (Pre-Sales) to join our team and help design & sell cutting-edge solutions to our public & private sector customers. Job Description for Data Service Line Practitioner Job Title: Data … UK, US, Europe, the Middle East, and Asia Pacific. Mastek helps enterprises across the spectrum of services including digital experience & engineering, cloud implementations, data, automation & AI, and cloud managed services. A preferred Oracle, Salesforce, Microsoft, AWS and Snowflake partner, Mastek has 6000+ employees and delivers right-fit solutions … to both medium businesses and global Fortune 1000 clients. We are a leading provider of innovative technology solutions focused on transforming businesses through data and artificial intelligence. Our Data & AI service line empowers clients to harness the potential of their data, unlock actionable insights More ❯

Senior GCP Data Engineer (Contract) Position: Senior GCP Data Engineer Location: London (Hybrid – 3 days onsite) Contract Type: 12-month Contract Day Rate: £500(Inside IR35) Start Date: ASAP Client: Leading Investment Bank (Cyber Security Division) 🌟 Why Join Us? Innovative Projects: Lead the development of cutting … edge data solutions within the cyber security domain. Collaborative Environment: Work alongside a team of seasoned professionals in a supportive setting. Professional Growth: Engage in projects that offer opportunities for skill enhancement and career advancement. 🛠️ Role Overview We are seeking a seasoned Senior GCP Data Engineer … to spearhead data initiatives within our cyber security division. The ideal candidate will possess a robust background in data engineering, particularly within the Google Cloud Platform (GCP), and will be adept at designing and implementing scalable data solutions. 🔧 Key Responsibilities API Development: Design, develop More ❯

an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data … as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … and standards to secure clinical data both in-motion and at-rest. Shape Data Workflows: Utilize Databricks components like Delta Lake, Unity Catalog, and ML Flow to ensure efficient, secure, and reliable data workflows. Key Responsibilities Data Engineering with Databricks: Design … data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … perfect opportunity to develop your career. The difference you'll make: Designing, building, and maintaining our AWS Data Estate. This includes S3 lake formation, Iceburg and extends to our Snowflake platform. Designing AWS-based services and capabilities adopting appropriate modelling techniques following agreed architectures, design standards, patterns More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

Senior Data Engineers x 2 for Kent based concern My client is seeking to recruit Senior Data Engineers to join its expanding IT operation To be considered for these positions you will need to have experience in the following areas - Good … Data Engineering/ETL development experience - Data design experience in an MI/BI/Analytics environment (for example Kimball, lake house, data lake) - Good experience working in a structured Change Management project lifecycle - Excellent Data Warehouse skills - A strong … knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential. - Strong demonstrable knowledge of data warehouse methodologies - Robust understanding of high-level business processes - Understanding of data migration, including reconciliation, data cleanse More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key … expertise and experience we’re looking for: Data Engineering in Databricks – Spark programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks … Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data More ❯

Data Architect Our client, a leading financial services corporation, is hiring a Data Architect to drive & design our client's data strategy as they move from on-prem to Azure cloud services. You will be part of a team designing and managing data systems primarily in Azure, ensuring alignment with business goals and requirements. To be successful, you must have strong expertise in Azure-based data solutions working within a regulated environment. Our client is paying a basic salary of £83,000 circa + 15% bonus/28 days holiday … various data sources (on-premises, cloud-based, and third-party) into the Azure environment. Utilise Azure services like Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Databricks for data storage, transformation, and analysis. Core skills and experience: Previous experience acting More ❯

in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting … opportunity for you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they … learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud More ❯

are seeking a Technical Trainer to lead impactful training programs across cutting-edge technologies, with a strong focus on Starburst, Dell Data Lake solutions, and Data Warehousing frameworks. Responsibilities: Design and develop high-quality training programs focused on Starburst, Dell Data Lakes, and … Data Warehousing architectures. Create engaging, hands-on materials such as labs, case studies, presentations, learning content that support enterprise data analytics adoption. Ensure training material is tailored to a wide range of audiences, from data engineers to business analysts. Deliver live, virtual, and hybrid training sessions that promote hands-on exploration of Starburst and Data Lake environments. Tailor instructional methods to suit technical and non-technical audiences; apply real-world scenarios from data warehouse modernization and lakehouse integration. More ❯

Company Insight This is the opportunity for an exceptional Senior Data Engineer to join one of Europe's best performing systematic quant trading businesses. Since its inception, this firm has cemented a formidable reputation within the systematic trading space, having been recognised as one of 2024's top … performing funds. This is an organisation that prides itself on it's innovative data and tech driven investment approach implemented within their trading strategies. Such an unparalleled scientific approach has allowed the firm to build next-generation, scalable and fault-tolerant multi-asset trading and backend systems, generating … data pipelines in Python using data libraries and cloud SDKs. Data modelling within scope of Data Lake and OLAP - large volumes and highly concurrent data access. Optimizing performance of the data lake as well as OLAP More ❯

engineering, governance, and performance optimisation. Key Responsibilities Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns Ensure the platform … Champion best practices in data quality, lineage, governance , and performance tuning Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including … SQL, PySpark, Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience working in regulated environments (e.g. financial services, insurance, banking) Excellent communication skills, capable of engaging More ❯

Data Engineer – Contract | London (Hybrid) Daily Rate: £240 Location: London | Hybrid (2–3 days onsite) Initial Duration: 6 months (with potential for extension) Are you a data-driven professional with a passion for building scalable, high-impact data solutions? This is a fantastic opportunity … to join a global leader in financial education and play a key role in shaping data initiatives that support thousands of professionals around the world. About the Company Our client is a global leader in financial learning and professional development. Their solutions empower financial services professionals across areas … working knowledge of cloud-based data solutions Nice to Have: Experience with graph databases, Hadoop/Spark, or enterprise data lake environments What You’ll Bring Strong foundation in computer science principles (data structures, algorithms, etc.) Experience building enterprise-grade pipelines and data More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both … technical teams and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data … based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . More ❯