The Opportunity Are you passionate about data engineering? The Open Data team at the Parliamentary Digital Service (PDS) is beginning the development of a new Open Data Platform for parliamentary procedure data, replacing existing platforms and their associated data integration and publishing services. As our Senior DataEngineer you will play a key … role in designing, building, and evolving the data platforms that support decision-making across the organisation. This role sits at the intersection of engineering, analytics, and product delivery. You'll work closely with cross-functional teams to provide high-quality, reliable, and scalable data solutions that drive insight and operational excellence. You'll bring strong software engineering experience … production-ready code as standard. Alongside this, you'll have hands-on cloud experience (Azure preferred, but AWS or GCP also welcome), including deploying, managing, and supporting cloud-hosted data services and applications. Using your advanced technical expertise and experience delivering modern data systems, you'll help shape our data strategy, improve how teams access and use More ❯
Lead DataEngineer Position Senior DataEngineer to lead and drive forward complex and high-impact data initiatives. Summary of the Role Howden Group Services is expanding its internal data engineering capability and is looking for a highly experienced Senior DataEngineer with deep expertise in Databricks and Azure data services. … The ideal candidate will have a strong background in designing and delivering scalable, metadata-driven data solutions, particularly in metadata ingestion and orchestration processes. The role requires a strategic thinker who can lead technical design discussions, drive best practices, and mentor junior engineers. The successful candidate will be comfortable managing multiple deliverables, working closely with stakeholders, and implementing robust … data solutions to enable business insights and operational efficiencies. Responsibilities The successful candidate will: Lead the development of metadata ingestion frameworks and orchestration processes. Design and implement scalable and reusable metadata-driven services to optimise data pipelines. Architect and maintain robust data solutions using Databricks and Azure services (such as Azure Data Factory, Synapse, and ADLS More ❯
Principal DataEngineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal DataEngineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources and real … time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience with Spark Streaming … Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions for enterprise clients Principal-Level More ❯
revolutionising the investment experience for financial advisers and their clients by combining our innovative proprietary technology with exceptional customer service. As we scale, we are growing our multi-disciplinary Data, Analytics&AI function to unlock the full potential of our data assets. About the Role This is a high-impact hands-on leadership role with the opportunity to … design and build Fundment's data and analytics infrastructure from the ground up. Reporting to our Head of Data&Analytics, you will create the data foundations that allow us to deliver data-driven insights, automated systems and AI-powered products to drive business growth and enhance operational efficiency. Key Responsibilities Data Platform Architecture & Strategy: Lead … the implementation of a robust, scalable, and secure data platform architecture on Google Cloud Platform (GCP). Define and enforce technical standards, design patterns, and best practices for data ingestion, processing, storage, and consumption. Ensure our data infrastructure follows best practices across data governance, cataloguing, quality and lineage. Ensure the data platform adheres to all More ❯
Lead DataEngineer Salary: Up to £80,000 I am working with a leading Microsoft partner that is currently recruiting for a Lead DataEngineer to join their growing team. This organisation is driving digital transformation for businesses across the UK, specialising in delivering innovative solutions using the Microsoft Power Platform, Azure and emerging technologies like … Microsoft Fabric. Their mission is to help organisations unlock the full potential of their data through modern, cloud-first architectures. This is a hands-on leadership role where you will guide a team of technical consultants while also contributing to the design and delivery of cutting-edge data solutions. In this role, you will be responsible for: Leading … of Technical Consultants, driving engagement and development. Overseeing resource planning, scheduling, and performance management. Collaborating with architects, analysts, and stakeholders to scope and deliver projects. Designing and implementing scalable data solutions using Microsoft Fabric, Azure Synapse, Data Factory and Databricks. To be successful in this role, you will have: Proven leadership experience within data engineering or dataMore ❯
to offer specialist advice, best practice and technology to all areas of our business specifically designed for our global reach. About the Role We're looking for a Principal DataEngineer to play a leading role in shaping and implementing our enterprise data architecture. This position is ideal for someone who combines deep technical expertise with strong … stakeholder engagement skills and a strategic mindset. You'll help define and implement the data foundations that enable impactful AI and analytics solutions across our global engineering, consulting, and infrastructure business. You'll work closely with cross-disciplinary teams, including data scientists, domain experts, and product managers, to design scalable, secure, and interoperable data systems. You'll … also help establish our enterprise data ontology and lead a small team of data engineers to turn that vision into reality. What You'll Do Enterprise data pipeline design&optimisation: Design and implement robust data pipelines to map both structured and unstructured data from diverse sources into the enterprise vector store, ensuring high-quality embeddings More ❯
At Sahaj Software, we're not just shipping pipelines - we're designing purpose-built data platforms that solve complex challenges for some of the UK's most forward-thinking organisations. We believe in craftsmanship, autonomy, and trust. No hierarchies and no bureaucracy, just small teams solving big problems with modern tech. Why this role? As a Senior/Lead … DataEngineer, you'll own the design and delivery of scalable data platforms, pipelines, and architectures that power real business decisions. You'll work closely with data scientists, engineers, and stakeholders to transform messy data into clean, reliable, and production-grade systems. This is a hands-on, high-impact role where you'll influence technical … direction while staying close to the code. Perfect if you want scope for growth without going "post-technical." What you'll do Design and build modern data platforms using Databricks, Apache Spark, Snowflake, and cloud-native services (AWS, Azure, or GCP). Develop robust pipelines for real-time and batch data ingestion from diverse and complex sources. Model More ❯
Senior DataEngineer 6 Month initial contract Hybrid role (up to 3 times a week in London) Start ASAP £500 - £540 per day Inside IR35 Azure/Python/SQL/ELT experience *Please note that this role requires security clearance due to the nature of the project Essential Skills & Experience 10+ years' experience in Data Engineering … years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern data integration architectures. Extensive experience working with Azure data services, particularly Azure Data Factory, Azure Blob Storage, Azure SQL Database, and related components within the Azure ecosystem. Demonstrable experience designing, developing, and maintaining large-scale datasets and complex data pipelines in cloud environments. Proven capability in data architecture design, including the development and optimisation of end-to-end data pipelines for performance, reliability, and More ❯
sends you unmissable jobs and then helps you ace the interview. He'll make sure you are considered for this role, and help you find others if you ask. DataEngineer Company Description: Well-funded AI cybersecurity startup Job Description: As a Backend Engineer (Data Engineering), you'll architect and build production-grade data pipelines … for a well-funded AI cybersecurity startup. This role involves designing and implementing data lake architecture, streaming pipelines, and transformation systems to process massive volumes of security data. You'll own the entire data lifecycle, ensuring reliability and performance to power AI agents protecting customer environments. Location: Remote Why this role is remarkable: Ambitious data challenges at … by top-tier VCs, with a team of experienced leaders from Big Tech and Scale-ups. Opportunity to build an AI-native company from the ground up, architecting the data foundation using cutting-edge technologies like Apache Iceberg. What you will do: Design, implement, and maintain scalable data pipelines that ingest gigabytes to terabytes of security dataMore ❯
Senior DataEngineer | Microsoft Fabric | £60,000-£80,000 We're working with a growing consultancy known for delivering modern, scalable data solutions. Their work sits at the intersection of strategy, engineering and innovation, empowering organisations to unlock value through cutting-edge Microsoft technologies. As part of their continued growth, they're now seeking a Senior DataEngineer to take a pivotal role in delivering enterprise-grade data solutions, with a strong focus on Microsoft Fabric and the wider Azure ecosystem. What you'll do: Lead the design and implementation of data platforms powered by Microsoft Fabric Guide delivery teams through complex builds across cloud-native architectures Bridge the gap between hands-on … engineering and technical strategy Collaborate closely with clients and internal stakeholders to translate needs into scalable solutions What you bring: Deep experience with Microsoft Azure, particularly around data services Proven track record delivering with tools such as Fabric, Synapse, or Databricks Proficiency in SQL, Python, and modern data engineering patterns Leadership experience within engineering or delivery teams A More ❯
Our client is looking for a DataEngineer to join their team on a initial 3-5 month contract with a good scope for extensions. This role would require travel to London 3 days a week and would be working via an umbrella company. Key Responsibilities Develop and maintain data pipelines and automation scripts using Python. Implement … and manage CI/CD pipelines for data and application deployment. Collaborate with teams to ensure smooth integration and delivery of solutions. Optimize performance and reliability across data platforms and cloud environments. Document processes and share knowledge effectively. Essential Skills Python (Highly Proficient): Libraries such as Pandas, NumPy; API development (Flask/Dash); package management (pip, Poetry). … DevOps Expertise: CI/CD tools (Jenkins, GitHub Actions), scripting (Bash, Python), Linux environments. Cloud & Containerization: Docker, Kubernetes, and experience with cloud platforms (GCP or similar). Familiarity with data engineering concepts (ETL/ELT, SQL) and big data tools (Spark, Airflow) is a plus. Strong problem-solving skills and ability to work independently under pressure. LA International More ❯