1 to 25 of 27 Permanent Data Lake Jobs in the Thames Valley

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

IMMEDIATE JOINERS !! Junior Big Data Developer (Python & SQL Focus) We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services (AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage). Exposure to workflow orchestration tools (Apache Airflow, Prefect, or Dagster). Bachelor's degree ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … What We're Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

granular financial datasets. You'll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable of processing … Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data … Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

troubleshooting Familiar with the Agile. Well communication. Good English listening and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk … work with and manage stakeholders Desirable skills/knowledge/experience: Ability to prepare and process datasets for Power BI usage Experience with One Lake, Azure Data Lake, and distributed computing environments Understanding of financial regulations such as GDPR, SOX etc. Spark application performance tuning Knowledge ...

Data Migration Engineer (Dynamics CE Focus/ERP) Permanent | Fully remote, competitive salary + bonus We are looking for a hands-on Data Migration Engineer to join a fast-growing, acquisition-led organisation. Your core mission will be to migrate operational (CRM) and in time, finance … into Dynamics (or similar ERP platforms) Experience working with messy, real-world data Exposure to Azure-based environments (Data Lake, Fabric, etc.) Why Join? High visibility, business-critical role Direct ownership of outcomes Exposure to multiple systems and acquisitions Opportunity to become ...

Lead Data Engineer (SQL Python Snowflake) London/WFH to £85k Are you a skilled data technologist with strong leadership and stakeholder management skills? You could be progressing your career in a senior, hands-on Data Engineer position at a global tech company that … provide data centric software solutions to major blue-chip and government organisations to enable them to discover and analyse data and customer feedback. What's in it for you: As a Lead Data Engineer you'll earn a competitive package: Salary to £85k Bonus ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the securities … shape this function in the long term. The Role: The successful candidate will work across these areas: Owning the build and maintenance of their Lake house and being the 'go-to' Data person in the business. Working with stakeholders from across the business showing the possibilities that ...

Senior Data Engineer Salary: Up to £70,000 I am working with a leading Microsoft partner that are currently recruiting for a Senior Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within … Microsoft AI-powered business solutions. This strategic role combines deep technical expertise in Microsoft's data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients ...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with … data playing a mission-critical role in every aspect of the business. This is a high-impact, high-autonomy role in a lean engineering environment. You'll design and maintain real-time and historical data systems, power internal analytics tooling, and ensure data quality ...

with likeminded people on an innovative project. You'll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial … Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io ...