SeniorDataEngineer - (Azure/Databricks) page is loaded SeniorDataEngineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart … marital status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. SeniorDataEngineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success … The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure DataEngineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role More ❯
About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help organizations … unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled SeniorDataEngineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a SeniorDataEngineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Circle Recruitment
Role: SeniorDataEngineer Salary/Rate: £600-700 per day inside IR35 Location: hybrid multiple locations available, 2 days on siteContract Duration: 4 months, potential to extend We are currently looking for a SeniorDataEngineer for our government client. This SeniorDataEngineer role is hybrid, based between … days per week on site and the remainder of the week working remotely. Office locations include most major towns, with London being a preference. The contract for the SeniorDataEngineer position is for 4-months with potential to extend, operating inside IR35. Security Clearance: Security Check ("SC Clearance") This role is inside IR35 - Due to the … service of the role, it will now be based on an Umbrella solution. Essential skills/experience required: Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices Proficiency in Python and SQL for data engineering tasks Experience with DBT and a good understanding of data modelling approaches (e.g. star schema, dimensional More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
WüNDER TALENT
SeniorDataEngineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: SeniorDataEngineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary: £80k-£90k (Senior) | £90k-£95k (Lead … About The Role Our partner is looking for a SeniorDataEngineer to join a high-impact engineering team delivering scalable data solutions for complex marketing and customer insight use cases. This is an opportunity to work on cutting-edge data pipelines, cloud-native platforms and real-time data flows in a collaborative, forward … thinking environment. You’ll be involved in designing and building production-grade ETL pipelines, driving DevOps practices across data systems and contributing to high-availability architectures using tools like Databricks, Spark and Airflow- all within a modern AWS ecosystem. Responsibilities Architect and build scalable, secure data pipelines using AWS, Databricks and PySpark. Design and implement robust ETL/ More ❯
Position : SeniorDataEngineer Salary: Negotiable, depending on Experience Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and strong proficiency in Python Scripting. To join our Consultancy client … working on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data Handling : Familiarity with batch, streaming, real-time, and unstructured data sources. Architectural Design & Systems Thinking : Ability to design … and build scalable, high-performance data solutions. Data Modelling & Warehouse Design : Proficiency in data modelling, warehouse design, and database optimization, with examples of logical and physical models. Distributed Data Systems : Experience in deploying, managing, and tuning distributed systems for optimal reliability and performance. Coding & Development Practices : Demonstrated coding expertise with modular, reusable, and efficient code in More ❯
. Meet the team behind this journey DeepL has millions of passionate users around the globe, both consumer and enterprise. These users produce a massive quantity of data. The Data Domain teams increase operational efficiency and drive innovation at DeepL by facilitating the flow of this data from producers to consumers, in order to maximize business impact. Through … the creation of stable and user-friendly analytical data models, we make customer data models and user behavioral data accessible and reusable for data professionals throughout the company. In this role, your main responsibilities and deliverables will be to build and maintain ETL pipelines, create foundational data models in our data warehouse, and integrate … new data sources using DataOps best practices, including documentation and testing. You will also support other data specialists in their work to make their queries and tables efficient and their use of data effective. We are looking for a SeniorDataEngineer to join a versatile team that builds and maintains data models More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Method Resourcing
DataEngineer | Python | SQL | AWS | Terraform | Docker SeniorDataEngineer Up to £105,000 + Equity & Benefits London - Fully-remote Method Resourcing have partnered with a rapidly scaling SaaS business to help them find their first Data Engineering hire. This is a fantastic time to be joining a business with ambitious plans for their … technology over the coming years. You will be an IC-level member of the technical team, with responsibility for the development, scaling and ownership of their data estate. On top of data storage solutions and pipeline development. We are looking for a highly experienced DataEngineer who can demonstrate strong technical acumen in: Significant experience as … a DataEngineer - Ideally as an IC, or part of a small team Python and SQL fluency Expertise in AWS, particularly managed storage solutions Cloud infrastructure such as Docker, K8s and Terraform We are offering this role at a range of up to £105,000 for the right candidate. This is a fully-remote role. RSG Plc is More ❯
We're hiring a SeniorDataEngineer (Genetics) to join us on 12 months FTC to support Maternity Cover. This role will be working within our Bioinformatics Team working on genetic data and building pipelines to process, control and create data releasees for Researchers. Our Future Health is the UK's largest ever health research … make new discoveries about human health and diseases. So future generations can live in good health for longer. What You'll Be Doing: Support the build of production-level data pipelines from data providers to our primary data store and Trusted Research Environment. Work closely with the Lead DataEngineer on key designs and features. … Build and maintain pipelines which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis. Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of standards. Work to promote the adoption of best practises across the squad (unit testing, CI/CD More ❯
An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging DataEngineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. … Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such … as Actuarial and Finance, to help with their data presentation requirements and help deliver data for visualisation solutions, such as Power BI Key skills required: Expertise in Python, Java, Scala, or other programming languages used to build data pipelines, implement data transformations, and automate data workflows. Strong knowledge of Power BI Strong SQL experience. Familiarity More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Eden Smith Group
An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging DataEngineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. … Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such … as Actuarial and Finance, to help with their data presentation requirements and help deliver data for visualisation solutions, such as Power BI Key skills required: Expertise in Python, Java, Scala, or other programming languages used to build data pipelines, implement data transformations, and automate data workflows. Strong knowledge of Power BI Strong SQL experience. Familiarity More ❯
SeniorDataEngineer We are looking for a technical expert with deep data engineering experience, who thrives on solving complex problems, driving business impact, and coaching other engineers. Salary : £70k-£90k Reporting to : François-Xavier Decroix (Engineering Manager) Location : primarily based in our London Office, with flexible and hybrid working (ideally 2 days per week in … the office). About the role As a SeniorDataEngineer, you will take responsibility for continuously improving critical systems which transport hundreds of gigabytes of data per day and trillions of messages per year. You will work closely with the broader team to bring innovative new datasets and insights to customers in a reliable, scalable … and cost-effective way. Your work will be crucial in our mission to empower safe and sustainable transport around the world through data insights. You will be the go-to person for our cloud data pipeline & underlying infrastructure, especially Apache Kafka and our PostgreSQL database . You will also work with tech like Kubernetes, Vault, go microservices and More ❯
LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by tuning … queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing best More ❯
Possibility of remote work: Hybrid (number of WFO days will depend on the client's needs) Contract duration: 6 months Location: London JOB DETAILS Role Title: SeniorDataEngineer Note: (Please do not submit the same profiles as for 111721-1) Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years … Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands-on experience with PySpark, Python, AWS, data modelling. Must have experience in ETL processes. Must … have hands-on experience in Databricks development. Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands-on experience in SQL development. Excellent communication skills & logical thinking. More ❯
A small and fast-growing Power Platform Consultancy is seeking a Microsoft Fabric DataEngineer to join their dynamic team in London, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. You'll … be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. In line with a hybrid working model, you'll spend … days per week in Central London for team collaboration and client engagement. The Role: As a Fabric DataEngineer, you will: Lead the end-to-end delivery of Microsoft Fabric projects for a range of clients. Act as a Fabric Subject Matter Expert, championing best practices and innovative solutions. Work closely with stakeholders to understand business needs and More ❯
by Intrum, Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - DataEngineer We are looking for our first dedicated Data Engineering hire to join our small but high performing data team. You will be responsible for ensuring … the scalability and reliability of our data infrastructure to power our machine learning and analytics workloads to support the companies growth. Our data stack: We work with a modern data stack built on Databricks and AWS with python and pyspark as our primary tools. In this role, you'll get to: Own business critical components and perform … meaningful work with an impact on our company and our customers Design , implement and deliver data pipelines and infrastructure to support our machine learning and analytics products Collaborate as part of a fast paced data team and help achieve the team's goals of delivering high impact data products at scale Work with a modern dataMore ❯
approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses … create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be leading teams, setting technical direction, advising … clients or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it comes More ❯
Position: Mid-Level Analytics Engineer Location: London (Hybrid, 2 days per week in office) Salary: £50,000 - £65,000 per annum Employment Type: Permanent, Full-Time Work Authorisation: Candidates must reside in the UK and have existing work eligibility. Sponsorship is not available. About Us We're a fast-growing, product-focused e-commerce business investing heavily in data to power smarter decisions across the company. Data plays a vital role in everything from product development to marketing performance. We're looking for a Mid-Level Analytics Engineer to support our data platform and contribute to our evolving analytics capabilities. Role Overview This role is ideal for someone with solid technical skills who enjoys working … collaboratively across teams to deliver accurate, actionable, and accessible data solutions. You'll work closely with senior engineers and stakeholders, supporting data pipeline development and helping improve data accessibility. Key Responsibilities Assist in building and maintaining data pipelines using dbt and Snowflake, ensuring they are scalable and efficient. Collaborate with analytics engineers and stakeholders across More ❯
As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and operational models to … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest level … of UK Security Vetting (DV), upon application. Key Responsibilities: You will blend Data Engineering and Data Science, and will have experience that might cover a number of the tasks listed below: Data Engineering tasks Manage the implementation and development of integrations between the data warehouse and other systems. Create deployable data pipelines that are tested More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Fortice
As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and operational models to … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest level … of UK Security Vetting (DV), upon application. Key Responsibilities: You will blend Data Engineering and Data Science, and will have experience that might cover a number of the tasks listed below: Data Engineering tasks Manage the implementation and development of integrations between the data warehouse and other systems. Create deployable data pipelines that are tested More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
SeniorData & AI Engineer - London - Hybrid - £80,000 - £100,000 My client are a leader in the financial services industry. They're looking for an experienced candidate with a wide range of experience across Azure Data engineering and proficiency with AI tools and usage. This is an exciting opportunity to enhance my clients AI capabilities and … restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check. TRG are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London … Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
SeniorData & AI Engineer - London - Hybrid - £80,000 - £100,000 My client are a leader in the financial services industry. They're looking for an experienced candidate with a wide range of experience across Azure Data engineering and proficiency with AI tools and usage. This is an exciting opportunity to enhance my clients AI capabilities and … restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check. TRG are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London … Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
to-AWS Migration Demo - showcasing cross-cloud architecture AI-Powered Email Intelligence System - with natural language querying Document Validation POC - including interface and full integration Key Skills Required Cloud Data Engineering: AWS (Aurora, DMS, Lambda, Kinesis), Azure Data Factory Streaming & CDC: Apache Kafka, AWS Kinesis, change data capture AI/Vector Search: Pinecone, Weaviate, or Chroma with … LangChain API Development: RESTful services, 3rd-party system integrations Production Standards: Monitoring, logging, cost optimisation, error handling Ideal Candidate Senior-level engineer with proven experience delivering client-facing demos or production-quality POCs Able to take ownership and deliver autonomously against a defined architecture Thrives in fast-paced, hands-on environments with a clear strategic direction The Details More ❯
At Hastings Direct, storing your data securely is very important to us. Please see our Data Protection Statement and Job Application Terms & Conditions here for details on how your information will be stored. time left to apply End Date: September 1, 2025 (24 days left to apply) job requisition id Welcome to Hastings Direct. We're a digital … insurance provider with ambitious plans to become The Best and Biggest in the UK market. We've made huge investments in our data and tech capabilities over the past few years, along with nurturing our 4Cs culture. We're proud of the journey we're on as a company and know that our continued success will rely on the … we would love to hear from you. Role overview; Job details - you'll need to have demonstrable experience in: Develop, document and maintain robust processes that transform and clean data for input into a variety of live systems and analytical workflows Take on larger projects where you will need to co-ordinate the division of tasks with colleagues and More ❯