1 to 25 of 48 Data Lake Jobs in the South East

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

EIT Oxford fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are currently recruiting for a Data Architect to support the EIT Pathogen Programme. In this role, you will play a pivotal part in designing and implementing cutting-edge data architectures to support the … pathogen mission. You'll collaborate closely with cross-functional teams to understand business requirements and translate them into robust data models and architectures. As a Data Architect , you'll have the opportunity to shape the future of our data platform and collaborate with platform and product teams to deliver analytical and AI products to … architecture governance processes Essential Knowledge, Skills and Experience: Knowledge and experience of architecting and delivering modern data platform standards, tools and patterns including data lakes, lake houses, iceberg, data mesh Experience of architecting, building, and delivering modern data platforms at scale Familiar with TOGAF and other enterprise architecture frameworks Experience and More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data … commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) Azure Synapse Analytics Azure Data Lake Storage (Gen2) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing projects More ❯

Role: Head of Data Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £50,000 - £60,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data … IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake technologies. The role will combine hands-on technical understanding with strategic planning, people leadership, and commercial management. Key Responsibilities: Lead and manage a data-focused IT team … ideally within complex enterprise environments. Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data … managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem solving and are proactive in getting More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to … power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT … and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders More ❯

Role: Data Analyst Location: High Wycombe/Hybrid Salary: £40,000 - £45,000 per annum VIQU have partnered with a leading retail company who are currently recruiting for a data analyst to optimise their business by leveraging data driven insights. The role will focus on analytics on an existing Azure based data platform, and will include data extraction, cleaning, analysis, and visualisation whilst using SQL SSIS/SSRS software. Responsibilities of the Data Analyst: Identify trends by analysing data. Collaborate with cross functional teams to deliver insights. Build Power BI dashboards. Extract, clean, and transform data from existing platforms (e.g., ERP, CRM, or bespoke … analyst, driving actionable insights. Experience using SQL (SSRS/SSIS) for managing databases. Ability to manipulate data. Knowledge of Azure data tools, including Data Lake, Data Factory, and Synapse Analytics. Experience with data visualisation tools like Power BI. Strong communication and presentation skills. Role: Data Analyst Location: High More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯

Data Architect (Lead and Principle) £90,000 to 130,000 GBP Bonus Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Architect Location: UK-wide hybrid wit various levels of seniorirty Salary: £90,000 - £130,000 + bonus (DOE) Eligibility: Must have full UK right to work - no sponsorship offered Overview An exciting … opportunity for an experienced Data Architect to play a key role in shaping and delivering large-scale data platforms within public sector and public healthcare transformation programmes. This role blends hands-on data architecture, client-facing consultancy, and technical leadership within agile delivery teams. You'll lead on data strategy, data … in ambiguous or fast-changing environments. Desirable Experience Experience defining enterprise-level data architecture or operating at a solution/portfolio level. Knowledge of data lake ecosystems , information handling models, and capacity planning. Experience establishing or maturing data governance and stewardship frameworks. Familiarity with public cloud platforms (e.g. Azure, AWS, GCP) and data More ❯

is investing heavily in data as it digitises operations across its risk, product, and customer intelligence teams. They're building a modern Lakehouse architecture using Databricks, Delta Lake, and Azure Data Lake. You'll be part of a collaborative, forward-thinking team with a focus on best practices, automation, and end-to-end data … enabling analytics and machine learning at scale, using best-in-class tools across the Azure stack. Your responsibilities will include: Designing and deploying ETL pipelines using PySpark and Delta Lake on Databricks. Supporting the deployment and operationalisation of ML models with MLflow and Databricks Workflows. Building out reusable data products and feature stores for data … native tools. Collaborating with data scientists, analysts, and product teams to improve data usability and performance. KEY SKILLS AND REQUIREMENTS Advanced experience with Databricks , Delta Lake , and PySpark . Strong background in data engineering and distributed processing . Hands-on knowledge of Azure Data Lake , Data Factory , or More ❯

HCL is looking for JDE TechnoFunctional Resource Job Title: JDE TechnoFunctional Resource for Data Migration Project Job Summary: We are seeking an experienced JDE TechnoFunctional Resource to join our team for a data migration project from JDE Worldsoft to Oracle Cloud. The ideal candidate will have a strong technical and functional background in JDE Worldsoft, with … expertise in data migration, integration, and Oracle Cloud technologies. Key Responsibilities: - Collaborate with the project team to design and implement a comprehensive data migration strategy from JDE Worldsoft to Oracle Cloud. - Analyze existing JDE Worldsoft data structures, identify data relationships, and develop a data mapping plan for migration to Oracle … and support. - Bachelor's degree in Computer Science, Information Technology, or related field. Nice to Have: - Experience with Oracle Cloud's Autonomous Database, Oracle Cloud's Data Lake, or other cloud-based data management solutions. - Certification in JDE Worldsoft, Oracle Cloud, or related technologies. More ❯

About the Role We are seeking an enthusiastic and detail-oriented Data Analyst on a 12 month contract to join our energetic Data Team within a successful Financial Services business. This is a pivotal role in shaping the digital future of our organisation. You will work closely with business users and take ownership of mining, organising … and analysing data from both existing and new sources to support strategic planning and decision-making. Working closely with a small team of UK-based Data Analysts and IT experts (both in-house and from our central functions in Germany). Your work will directly influence business operations, customer experience, and innovation across departments. This role … Team in Germany to resolve cross-border data issues. Explore and apply new data sources and techniques to enhance our data lake and analytics capabilities. Promote the use of data-driven insights across departments. What we're looking for: Required: Education & Experience: Degree in Computer Science or equivalent professional More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Junior Data Engineer. Hybrid working - London based Role The Junior Data Engineer will assist in the design, development, and maintenance of scalable data pipelines and ETL/ELT processes in Azure. Write efficient and reliable SQL queries for data extraction, transformation, and analysis. Support data integration from various sources (internal systems, third-party vendors) into centralised data platforms. Monitor and troubleshoot data jobs and pipelines to ensure consistent and reliable delivery. Collaborate with analytics and reporting teams to deliver high-quality datasets for business intelligence. Participate in code reviews, documentation, and … querying, data manipulation, and performance tuning. Hands-on experience with Azure Data Services (such as Azure Data Factory, Azure Synapse, Data Lake, or Logic Apps). Strong problem-solving skills and attention to detail. Excellent communication skills and a collaborative mindset. Nice To Have Experience with Python for data More ❯

Senior Data Architect London/WFH to £115k Are you a skilled Data Architect with a strong knowledge of financial markets seeking an opportunity to progress your career? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients, in a senior, hands-on role. As a Data … range of business problems, designing exceptional customer experiences and products, ensuring they get the most of out of technology solutions to enhance business capabilities with a focus on data architecture design and delivery. You'll partner with technology leaders across financial services clients to provide best practice guidance for data management, data architecture development … Bricks, GCP, Azure) You have a good knowledge of Contextual Data Modelling, Entity Relationship Modelling, Logical and Physical Data Modelling and Data Lake design You have experience within a financial services or consultancy environment You have advanced communication, client facing and stakeholder management skills What's in it for you: As a More ❯

City & Capital are currently representing a highly respected & fast-growing property finance lender who are achieving exciting growth. They have engaged our services to appoint a technical & experienced Data Architect who will take oversight of the company’s overall data architecture. The Company Our client is known for supporting property developers & investors with access to funds … in their sector & ahead of the pack in terms of innovation and engagement with tech and systems that drive business performance and lending efficiency. The Department & Team The Data Architect is a senior member of the IT department and will work closely with the Head of IT and CTO on critical projects that drive the growing technological landscape … of the firm. The IT team is set to grow considerably in light of the planned projects, making the appointment of a capable and forward thinking data architect absolutely critical to success. The department works closely with senior leaders & users in operational departments, so the capacity to communicate across the business is a firm requirement for this role. More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Data Architect Location: Hybrid - London (2-3 days onsite) Type: Permanent Industry: Data Consultancy Salary: Competitive + Benefits The Opportunity Our client, a growing data consultancy with deep expertise in the Microsoft Azure ecosystem, is looking for a Data Architect to join their high-performing team. This role is both strategic and … hands-on, focused on designing modern, scalable, and secure data platforms for enterprise clients. You'll play a key role in shaping data architecture across the full Azure stack- including Azure Databricks and Azure Data Factory (ADF) -and will guide engineering teams in delivering robust, future-proof solutions using … lakehouse and medallion architecture principles . Key Responsibilities Design end-to-end data architectures using Azure services, including Azure Databricks, ADF, Synapse Analytics , and Data Lake Storage Define scalable data models and implement architectural patterns such as lakehouse and medallion Lead technical solution design during client engagements, from discovery to delivery Establish and More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

The Position: The R&D Data Excellence Lead drives the vision, strategy, and execution of data excellence across the R&D organization. This role ensures that data is standardized, governed, and leveraged for advanced insights across scientific, clinical, safety, and regulatory domains. The role serves as a strategic advisor to R&D leadership, overseeing … enterprise-aligned data infrastructure, data architecture, and standards to accelerate discovery, development, and decision-making. The role partners closely with enterprise I&T to ensure all data initiatives are scalable, compliant, and interoperable. Responsibilities: Define and execute the R&D-wide data and analytics strategy aligned to R&D 2.0 transformation goals … and PD&C objectives Serve as a strategic advisor to R&D leadership on opportunities to improve pipeline productivity and operational efficiency using data Establish and govern data standards, metadata management, lineage, and ontologies across R&D domains Ensure compliance with enterprise data governance and facilitate its application across R&D data More ❯

The Position: Read the overview of this opportunity to understand what skills, including and relevant soft skills and software package proficiencies, are required. The R&D Data Excellence Lead drives the vision, strategy, and execution of data excellence across the R&D organization. This role ensures that data is standardized, governed, and leveraged for … advanced insights across scientific, clinical, safety, and regulatory domains. The role serves as a strategic advisor to R&D leadership, overseeing enterprise-aligned data infrastructure, data architecture, and standards to accelerate discovery, development, and decision-making. The role partners closely with enterprise I&T to ensure all data initiatives are scalable, compliant, and interoperable. … Responsibilities: Define and execute the R&D-wide data and analytics strategy aligned to R&D 2.0 transformation goals and PD&C objectives Serve as a strategic advisor to R&D leadership on opportunities to improve pipeline productivity and operational efficiency using data Establish and govern data standards, metadata management, lineage, and ontologies across More ❯

Data Solutions Architect £110,000 - £120,000 GBP 10% Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solutions Architect - Consulting Location: London (Remote-first) Working Pattern: Full-time, Permanent Salary: £110,000 - £120,000 per annum About the Role We're seeking a Data Solutions Architect to join a … dynamic consulting team delivering cutting-edge, cloud-based data solutions for high-profile clients across diverse industries. This is a remote-first role with occasional travel, offering the opportunity to lead end-to-end delivery of complex data architecture projects in a collaborative, agile environment. What You'll Be Doing Leading cross-functional teams of Data Engineers, Architects, BAs, and QA Analysts. Designing and delivering scalable data solutions using modern cloud platforms and data technologies. Engaging with stakeholders to shape and own the technical delivery of data architecture projects. Applying best practices in data governance, security, and compliance. What We're Looking For Experience & Leadership Proven More ❯

Data Specialist - Government Client Are you a seasoned data professional ready to shape the future of data architecture in a high-impact government setting? We're working with a major government organisation seeking Data Specialists for upcoming projects. This is a strategic role focused on designing and delivering robust, interoperable data … or Manchester Security Clearance : You would have to undergo DV clearance (can take ~12 months; you may work other roles during this time) Key Responsibilities: Set and drive data architecture strategy across the organisation Promote and implement data standards and patterns with internal and external partners Ensure data interoperability and quality across delivery teams … Support cloud migration with a modern, data-centric architecture Useful Experience: Data Modelling : Physical, logical, conceptual models; data flow diagrams; ontologies; UML/Visio/Sparx Data Standards : Technical specs, code assurance, championing interoperability Metadata Management : Data catalogues, repositories; tools like Apache Atlas, Hive Metastore, AWS Glue/Datazone Data More ❯

senior AWS Consultant, you will provide expert technical consultancy to various large-scale customers. You will be expected to utilise your deep expertise in building platforms for AWS Data Lakes and Landing Zones to provide concise consultancy to clients and internal teams alike and provide hands-on input throughout related projects when required. You will also have key … implementing, solutioning and configurating AWS Data Lakes environment. Providing consultancy to customers and delivering on projects Responsible for providing solutions, configuring and optimising the data lake environment Responsible for providing solutions, configuring and optimizing with AWS key services with AWS cloud infrastructure management, data processing, security, and virtual desktops. Designing and implementing with … Landing Zones/Transit Gateways/Redshift/Firehose/CloudTrail/Workspaces Experience creating design documentation Experience within Linux based environments Strong understanding of AWS Data Lake solutions and AWS Redshift AWS Certified Solutions Architect, Developer, or SysOps Administrator certifications are highly desirable Deployment experience with AWS CloudFormation or Terraform Knowledge of AWS Core services i.e. More ❯

talented and experienced Python Developer to join our dynamic team in London . You will play a critical role in developing and optimizing backend systems, working with modern data technologies, and contributing to high-performance and AI-enabled applications. Key Responsibilities: Develop robust, scalable applications using Python , APIs, and async processing techniques Collaborate with … cross-functional teams on system architecture, design, and implementation Work with Databricks or Microsoft Fabric to manage big data workflows Utilize Azure Cloud services (Data Lake, Functions, App Services) for development and deployment Implement and maintain containerized solutions using Docker and CI/CD pipelines Apply MLOps practices using tools like MLFlow , Git-based versioning … development experience with strong knowledge of APIs, data structures, and asynchronous programming Experience with Databricks or Microsoft Fabric Proficiency in Azure cloud services including Data Lake, Functions, and App Services Strong understanding of Docker , CI/CD workflows, and automation pipelines Familiarity with MLOps tooling such as MLFlow, Git version control, and environment management Desirable More ❯