326 to 350 of 569 Permanent Data Lake Jobs

Matchtech is seeking a Data Engineer to design and maintain scalable Azure data platforms, build robust data pipelines … support data-driven solutions across the business. You will work with Azure Data Factory, Databricks, Synapse, Data Lake Storage, and SQL databases, ensuring data quality, governance and CI/CD automation. The role offers permanent employment in a leading technology organization ...

About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams to ensure seamless data flow and accessibility, supporting … concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a developing Azure environment. The role focuses on designing and building … robust data pipelines, migrating data from legacy systems, and delivering scalable data flows into Azure Data Lake and Databricks. You will also help integrate data into a proprietary transformation solution and work closely with stakeholders to understand source data ...

global healthcare and insurance organisation who are making a real difference to people's lives. We require experienced senior or mid-level Data Platform Engineers to join the AI and Data Platform teams. £70,000 - £100,000 + Bonus + Excellent Benefits Fully remote with occasional … Azure-based data solutions. * Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. * Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

Principal Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active eDV clearance for this role. About us At Raytheon UK, we take immense pride in being a leader … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

Senior Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active eDV clearance for this role. About us At Raytheon UK, we take immense pride in being a leader … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

description Marketing is increasingly shaped by data, AI, and automation - and practitioners who understand all three are rare. As a Senior Consultant specialising in Agentic Marketing Data & Analytics, you will work at the intersection of marketing analytics, AI, and data strategy, helping clients harness … data to understand their customers more deeply, measure marketing effectiveness, and unlock the potential of agentic AI - intelligent, autonomous systems that can analyse, recommend, and act on marketing data at scale. This is a genuine opportunity to build hands-on expertise across data analysis ...

description Marketing is increasingly shaped by data, AI, and automation - and practitioners who understand all three are rare. As a Senior Consultant specialising in Agentic Marketing Data & Analytics, you will work at the intersection of marketing analytics, AI, and data strategy, helping clients harness … data to understand their customers more deeply, measure marketing effectiveness, and unlock the potential of agentic AI - intelligent, autonomous systems that can analyse, recommend, and act on marketing data at scale. This is a genuine opportunity to build hands-on expertise across data analysis ...

Data Governance Lead | Databricks & Unity Catalog | Worcestershire (Hybrid) | Up to £80,000 + 10% Bonus This is a build role, not a maintenance one. You would be the first dedicated data governance hire, taking a function that currently exists in pockets and turning it into … platform is Databricks with Unity Catalog as the governance layer, supporting customer analytics, BI and a growing set of AI products. The data is sensitive and the sector is regulated, so getting this right carries genuine commercial weight. The Role Establish the data governance and data ...

Senior Software Engineer (Data) Department: Engineering Employment Type: Full Time Location: London Description Hybrid: 2 days per week in our Tower Bridge office (Tuesdays & Thursdays) Uswitch At Uswitch, our goal is to be the UK’s favourite way to choose and manage home-life essentials – from broadband … brands that include: Confused, Tempcover, money.co.uk, and Mojo Mortgages. The team Our Marketing Enablement team builds and manages the systems that help turn data into something useful. We work closely with multiple teams like CRM, PPC & analytics to ship the pipelines, integrations and tooling behind how we find ...

solutions, and assist with cloud/SaaS migrations in collaboration with senior developers and architects. Design, build, and enhance reporting and data solutions that incorporate AI/ML driven insights, working closely with analytics and business teams. Translate defined business requirements into clear technical designs for features … workflows (e.g., REST APIs, ETL tools, Azure Data Factory, SSIS) and working with data warehouse or data lake environments. Familiarity with cloud platforms (preferably Azure) and DevOps practices, including Git based source control, CI/CD pipelines, and automated testing. Familiarity with ...

solutions, and assist with cloud/SaaS migrations in collaboration with senior developers and architects. Design, build, and enhance reporting and data solutions that incorporate AI/ML driven insights, working closely with analytics and business teams. Translate defined business requirements into clear technical designs for features … workflows (e.g., REST APIs, ETL tools, Azure Data Factory, SSIS) and working with data warehouse or data lake environments. Familiarity with cloud platforms (preferably Azure) and DevOps practices, including Git based source control, CI/CD pipelines, and automated testing. Familiarity with ...

About the roleA fantastic opportunity to join as Data Analytics Lead for a growing Payments FinTech backed by one of the largest banks in the UK. As Data Analytics Lead you will drive value for the customer through sourcing and data transformation. … still being hands on in terms of analysisEnsuring that relevant insight and analysis is provided to drive growthExperience of Synapse, Azure Data Lake, Azure Data Factory, highly desirableWorking closely with other senior stakeholders on the overall business strategyProficient understanding of cloud data solutions ...

other non-disability related questions, please reach out to our Talent Partners. Role We’re looking for a Staff Backend Engineer – Data Platform to be a key technical leader within the teams responsible for Depop’s data platform. … drive the technical vision and implementation for our foundational data platform — from experimentation, event ingestion pipelines to our data lake, governance frameworks, and data observability and real-time analytics capabilities. You will work closely with data scientists, machine learning engineers, backend ...

it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. About the TeamThe DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders … based, concurrent, high-throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g. Airflow, Dagster)Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

LocationNorthampton, United Kingdom# Sr Data/Solution Architect at N Consulting LtdLocationNorthampton, United KingdomSalary£500 - £525/dayJob TypeContractDate PostedApril 14th, 2026Apply Now**Job Title: Sr Data Architect****Location: Northampton, UK****Job Type: Contract- Hybrid****Job Description:****Minimum 8+ years of experience working as Data Architect for AWS Cloud Dataware house** **Data Architecture & Engineering Deliverables****Understand Data Requirements & Authoritative Data Source Assessment**: Engage early to capture business and technical data needs.**Create and Maintain Architecture Artifacts**:o **Data Flow Diagrams (DFD)** and **Logical ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

expansion of AI and automation, the future of work has never been more challenging for organizations. Beamery's unique jobs, skills and tasks data platform helps organizations navigate these challenges and make more informed decisions across Talent Lifecycle Management. Our solutions power recruitment, mobility, upskilling, diversity, work architecture … hard to create; built on trust, empathy & honesty ensuring our workforce is able to bring their full selves to work. About the opportunityOur data platform powers Beamery's reporting and underpins our AI strategy. We're hiring a Staff Data Engineer to set its technical direction. ...

seeking a Snowflake Architect for this role. Kindly find the updated job description below- Job Description: 10+ years of overall experience in Data Warehousing, Data Engineering, and Cloud Data Platforms. Strong hands-on experience with Snowflake architecture, design, implementation, and optimization. Proven expertise … designing enterprise-scale data platforms, data lakes, and modern data warehouse solutions. Deep understanding of Snowflake features including Snowpipe, Streams, Tasks, Dynamic Tables, Time Travel, Zero-Copy Cloning, Data Sharing, RBAC, and performance tuning. Experience in data modelling, including dimensional ...

Data Engineering roles require the eligibility for SC clearance, please check the GOV.UK website for the requirements before you apply. We work with some of the UK's biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. … clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data ...

with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … essential. We're equally interested in engineers who have worked with technologies such as Azure Databricks, Synapse, Data Lake, data pipelines or lakehouse architectures and want to develop further into Fabric. Exposure to Entra ID, Microsoft 365, Defender, Purview or Power Platform would also ...

Manager to own the Group’s data strategy, architecture and governance for data platforms spanning data lake, warehouse and analytics tooling. You will lead the technical build, ensure data integrity and enable data-driven decision making across … subsidiaries through strong data governance. The role combines strategic roadmapping with hands-on delivery, requiring collaboration with technology, operations and business stakeholders to drive adoption #J-18808-Ljbffr ...

Manager to own the Group’s data strategy, architecture and governance for data platforms spanning data lake, warehouse and analytics tooling. You will lead the technical build, ensure data integrity and enable data-driven decision making across … subsidiaries through strong data governance. The role combines strategic roadmapping with hands-on delivery, requiring collaboration with technology, operations and business stakeholders to drive adoption #J-18808-Ljbffr ...

This is an exciting contract opportunity for an SC Cleared Data Engineer tojoin an experienced team delivering a crtitical public sector engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery … Skills & Experiences Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. Deep understanding ...