17 of 17 Data Lake Jobs in the Thames Valley

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing ...

granular financial datasets. You'll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable of processing … Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. … Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion ...

with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. … Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion ...

Data Engineer Our financial services client based in Reading is looking to recruit an experienced Data Engineer to join ASAP. The position will be fully remote working with occasional visits to their offices in Reading. To be considered for the role you must have the following … Data Factory. Basic understanding of Azure Fabric and appropriate implementation. Familiarity with the management and use cases of Azure Data Lake Storage. Familiarity with the development of analytics Azure Synapse. Familiarity with Azure database service with strong knowledge of the SQL language. An understanding ...

Data Migration Engineer (Dynamics CE Focus/ERP) Permanent | Fully remote, competitive salary + bonus We are looking for a hands-on Data Migration Engineer to join a fast-growing, acquisition-led organisation. Your core mission will be to migrate operational (CRM) and in time, finance … into Dynamics (or similar ERP platforms) Experience working with messy, real-world data Exposure to Azure-based environments (Data Lake, Fabric, etc.) Why Join? High visibility, business-critical role Direct ownership of outcomes Exposure to multiple systems and acquisitions Opportunity to become ...

cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role … MLOps concepts, model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data … Power BI (Desktop, Service, DAX). Expertise in Data Modelling and Schema creation. Strong experience with Databricks and Azure Data Lake design. Proficiency in SQL, ETL frameworks, and database management systems. Analytical mindset with proven problem-solving abilities. Excellent communication, coaching, and teamwork skills ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion … Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

daily. Join us to grow your skills, shape bold ideas, and help build the future of tech. We're looking for a Principal Data Architect to help shape how high-growth startups build and scale on AWS. In this role, you'll design and deliver … data and analytics solutions - from architecture and pipelines to visualization and insights - guiding customers from concept through production. You'll work closely with startup founders, technical leaders, and account executives to create scalable, cost-efficient architectures that drive real business impact. Work location - hybrid from London ...

definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you'll contribute to the development of AI offerings, standards … other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...

Paragon Alpha are partnered with one of the worlds most prominent multi-strat hedge funds, looking to make a Data hire in London to support quant equities strategies. This data team helps to build cloud based and scalable data-lakes … quant teams, ingest vast amounts of data into the company, which can be used for quant research and model development. Stack: Python, AWS, S3, Airflow, SQL The role needs a talented data engineer who can build a scalable and bespoke data platform ...

world-leading global quantitative hedge fund are looking for a Data Engineer to support their systematic trading and research platform, with a focus on building, managing, and scaling datasets used directly by quants and traders. You will be responsible for developing automated ETL pipelines, integrating new and alternative … checks, and contributing to the firm's core data framework while working closely with research and trading teams. Stack: Python, Databases/Datalakes, Git The firm offers a highly collaborative, global environment with strong ownership, close interaction with quants and traders, and the opportunity to work on data ...