301 to 325 of 498 Data Lake Jobs

during a peak in workload. We are specifically looking for someone with specialist knowledge of The Access Group's Children's Services Mosaic data models and experience using them for data and analytics development for reporting purposes. This expertise is not currently available within the team … will need sufficient experience to work confidently and independently. You will lead the analysis, specification, development, testing, implementation and support of corporate data storage solutions and internal database developments. You will also implement, maintain and support business analytics and intelligence systems that help deliver effective council services. Working ...

in a scripting language Our tech stack Python as our main programming language DBT for data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer … scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here Wondering what the salary for this role is Just ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

Birmingham or London (12 days per month in office) Employment: Full time A leading and growing UK financial services company is seeking a Data Engineer to build Power BI reporting solutions and support the development of its Azure data platform. This is an excellent opportunity … pipelines. Working knowledge of Azure Synapse modelling and performance tuning. Good SQL skills for analytics and optimisation. Understanding of Azure Data Lake structures. Experience using Git and Azure DevOps in Agile teams. 24 years experience in a Data Engineering or BI Development role. Exposure ...

## Lead Azure Data Engineering Architect – Lloyds MarketplaceApplylocations: Londontime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: October 31, 2026 (30+ days left to apply)job requisition id: SR-44500It's fun to work in a company where people truly BELIEVE in what they … .* Good understanding of tools and platforms used across the **Lloyd’s insurance ecosystem**.* Proficiency in Azure ecosystem: Blob Storage, Data Lake, Synapse Analytics, Databricks, Functions, and Monitor.* Demonstrated expertise in **analytics consulting**, **data analysis**, and **data analytics**.* Strong business acumen ...

Solutions Architect required for Global Insurance firm. This is a high-impact role focused on driving Zero Trust strategy, enterprise IAM architecture, secure data platforms, and long-term security roadmaps aligned to business transformation initiatives. You’ll work across security, cloud, data, and architecture teams … technology objectives Lead architecture design across IAM, access governance, privileged access, and identity federation Design secure frameworks supporting a global data lake and enterprise data platforms Partner with data, cloud, and infrastructure teams to ensure secure-by-design principles Produce architecture blueprints, standards ...

title: Senior Operational Support Analyst Salary: Circa £62K + TFL Benefits Grade: Band 3 Contract type: TfL Team: TSO Professional Service - Technology & Data Location: London (Pier Walk)/Hybrid* working All offers of employment are subject to satisfactory right‐to‐work checks. Candidates must be able to demonstrate … problems (essential) Proven experience of supporting SQL Data Warehouse using SSIS (essential) Experience supporting Azure Data Factory, Data Lake, Event Hub and Databricks. (essential) Ability to understand and write T-SQL, Kusto, Python coding languages. (essential) Experience of supporting PowerBI, Business Objects reports. ...

experienced developer looking for a role where you can shape systems, drive innovation, and lead the development of cutting‐edge data solutions? We are seeking an experienced Systems & Data Developer to play a key role in the design, development, and evolution of our data … Microsoft Power Platform, including Power Apps, Power Automate, and Power BI Experience working with Azure data services, including Azure Data Lake Knowledge of API development and system integrations Understanding of data modelling, databases, and data architecture Experience delivering automation and process ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

successful multinational technology business is looking for a Data Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high‐impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision‐making. You’ll take ownership of data reliability end‐to‐end, designing ...

United Kingdom is seeking a Data Platform Engineer to architect and build scalable data pipelines and data lake services. You will own ETL/ELT, collaborate in Agile teams, and drive CI/CD for cloud-native data solutions built … Snowflake, AWS, Spark and Python. If you are passionate about data quality, scalable architectures, and mentoring others, join us. #J-18808-Ljbffr ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Principal Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Senior Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

NewDay is seeking a Data Engineer … London to design, build, and evolve core pipelines powering analytics, reporting, and data science. You will own the Data Lake, drive scalable ETL/ELT processes, and contribute to a resilient data platform within a hybrid work model. You’ll work ...

SALESFORCE MARKETING CLOUD NEXT & DATA 360 ARCHITECT Salary: £100,000-£120,000 + 5-10% bonus + pension & benefits Location: Hybrid - London/Birmingham preferred Working pattern: Typically 1 day onsite per week Security: SC eligibility required ARCHITECT THE FUTURE OF CUSTOMER ENGAGEMENT Are you a senior Salesforce … Architect with expertise in customer data, marketing technology and enterprise transformation? We're looking for an experienced Salesforce Marketing Cloud Next & Data 360 Architect to lead the design and delivery of complex, enterprise-scale customer transformation programmes. You'll help major organisations connect customer data ...

London, Greater London | £78k - £85k per year Data Engineer (Python SQL AWS) London/WFH to £85k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role … scaling Investment Research tech company with great benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus ...

successful multinational technology business is looking for a Data Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end-to-end, designing ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

team has grown extremely quickly as a result. With this rapid growth, we are looking for Platform Engineers to join our team. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter … application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

Data Engineering Lead - Value & Analytics Location: London Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking for a Data … technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard, you will integrate financial, project and operational information into a consistent and automated view ...

Data Engineering Lead - Value & Analytics Location: London Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking for a Data … technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard, you will integrate financial, project and operational information into a consistent and automated view ...