301 to 325 of 485 Permanent Data Lake Jobs

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

successful multinational technology business is looking for a Data Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high‐impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision‐making. You’ll take ownership of data reliability end‐to‐end, designing ...

United Kingdom is seeking a Data Platform Engineer to architect and build scalable data pipelines and data lake services. You will own ETL/ELT, collaborate in Agile teams, and drive CI/CD for cloud-native data solutions built … Snowflake, AWS, Spark and Python. If you are passionate about data quality, scalable architectures, and mentoring others, join us. #J-18808-Ljbffr ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Principal Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Senior Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

NewDay is seeking a Data Engineer … London to design, build, and evolve core pipelines powering analytics, reporting, and data science. You will own the Data Lake, drive scalable ETL/ELT processes, and contribute to a resilient data platform within a hybrid work model. You’ll work ...

SALESFORCE MARKETING CLOUD NEXT & DATA 360 ARCHITECT Salary: £100,000-£120,000 + 5-10% bonus + pension & benefits Location: Hybrid - London/Birmingham preferred Working pattern: Typically 1 day onsite per week Security: SC eligibility required ARCHITECT THE FUTURE OF CUSTOMER ENGAGEMENT Are you a senior Salesforce … Architect with expertise in customer data, marketing technology and enterprise transformation? We're looking for an experienced Salesforce Marketing Cloud Next & Data 360 Architect to lead the design and delivery of complex, enterprise-scale customer transformation programmes. You'll help major organisations connect customer data ...

London, Greater London | £78k - £85k per year Data Engineer (Python SQL AWS) London/WFH to £85k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role … scaling Investment Research tech company with great benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus ...

successful multinational technology business is looking for a Data Engineer to join its growing data team in Central London. This role is hybrid – you’ll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You’ll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You’ll take ownership of data reliability end-to-end, designing ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

team has grown extremely quickly as a result. With this rapid growth, we are looking for Platform Engineers to join our team. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter … application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

Data Engineering Lead - Value & Analytics Location: London Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking for a Data … technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard, you will integrate financial, project and operational information into a consistent and automated view ...

Data Engineering Lead - Value & Analytics Location: London Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking for a Data … technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard, you will integrate financial, project and operational information into a consistent and automated view ...

thrive in it. Loyalty – We stand by each other and our mission. Job Summary About the Role Movar is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. You will design and manage data pipelines that support analytics … engineers to deliver robust and reusable data products. Manage data lakes and warehouses using formats such as Delta Lake and Parquet. Implement best practices for data governance, performance, and security. Continuously evaluate and adopt new technologies to evolve Movar's data ...

Summary Our talented Microsoft Fabric team is made up of globally recognised experts and there’s room for more analytical, innovative, client driven data professionals. If you’re passionate about helping clients make better, data driven decisions to tackle their most complex business challenges … including large‐scale projects Experience working with modern Microsoft Fabric and Azure technologies, such as Synapse, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala ...

measuring and why, and then being the person who makes that measurable. We're not starting from scratch. There's a data lake, dbt on BigQuery, Looker on top, and it works. Software engineers, Data scientist and even some business champions commit to it daily. … team, and we are not planning to build one under you. You will set the standard for how data lands in our lake and how it gets used, and hold the rest of the engineering team to it. You’ll join a Product & Engineering team of around ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

agile team where you'll have genuine ownership rather than simply maintaining established models and systems. You'll help shape how we use data, quantitative research and automation across Trading & Shipping, with the opportunity to build tools and analytical capability from the ground up.**ABOUT OUR OPPORTUNITY … they are kept updated and have support for commercial decisions.**WHAT YOU'LL BE DOING*** Build and manage the IT&S data lake, organising complex and unstructured data to enable quantitative research across our Trading and Shipping activities.* Develop robust data pipelines ...

Here to Protect Tomorrow. Xoople is Earth’s System of RecordTM At Xoople, we're building the Earth's data infrastructure layer for AI. Our mission is to enable AI to understand and predict physical changes on the world's surface by creating Earth’s System of RecordTM … trusted, enterprise-grade data foundation that connects the physical world to digital systems. By transforming vast amounts of Earth observation data into actionable insights, we help enterprises and governments make faster, smarter decisions about risk, operations, sustainability, and growth. Working at Xoople means joining a team ...

Data Engineer****Salary: Up to £65,000 per annum + Bonus****Swindon/London – Hybrid**As a Data Engineer, your primary responsibility is to design, develop, and maintain data pipelines and infrastructure on our platform. You will work with various data sources … track record of working with git* Strong working knowledge of Python (Pyspark) and SQL* Strong working knowledge of data management inside a datalake* Proven ability to explain technical issues and solutions to peers and customers* Proven ability to independently progress and complete tasks* Strong desire to learn ...

Oracle Data & AI Consultant (Associate Manager, CL8) Location: UK Salary: Competitive salary and package dependent on experience Career Level: Associate Manager (CL8) Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across … delivering cloud native solution on Oracle Cloud, our Oracle practice offers and delivers an unparalleled digital footprint for our customers. As an Oracle Data & AI Consultant, you will: Manage delivery of Oracle Data & AI projects across strategy, design, implementation and deployment phases. Design and implement modern ...

Consultant Our talented Microsoft Fabric team is made up of globally recognised experts and there’s room for more analytical, innovative, client driven data professionals. If you’re passionate about helping clients make better, data driven decisions to tackle their most complex business challenges … including large‐scale projects Experience working with modern Microsoft Fabric and Azure technologies, such as Synapse, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...