Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to AzureData Lake or other storage services. Write efficient … and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, AzureDataFactory). Data Ingestion … Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features More ❯
Data Engineer/Architect - Active SC, NPPV3, AzureDataFactory Up to £640 per day (Outside IR35) Primarily Remote 3 month initial contract I am currently working with a leading consultancy who are looking for an NPPV3 and SC cleared Data Engineer/Architect to work on a large data migration project, utilising AzureDataFactory and Synapse, for a widely known end client. Key Requirements: Proven experience as Data Engineer/Architect within large Enterprise Scale organisation Must … hold Active NPPV3 clearance and Active SC clearance Demonstrable experience using AzureDataFactory (ETL) and Azure Synapse Strong working knowledge of HLD, figuring out requirements and developing for implementation Excellent communication skills Nice to have: Exposure to Microsoft Fabric Experience in More ❯
Solihull, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Pontoon
Job Title: AzureData Engineer Location: Warrington and Solihull (Hybrid Working) Rate: Circa £700/Day Working Pattern: Full Time Security Clearance: SC Cleared Required Contact: Till end of October Are you ready to elevate your career as an AzureData Engineer … Join our client's dynamic Data Engineering team, where you'll play a pivotal role in shaping data solutions that drive business success! Key Purpose: As a Senior Data Engineer (SDE), you will collaborate with BI Analysts and Developers to transform functional requirements into … actionable technical data solutions. Your expertise will be crucial in designing and building ETLs/ELTs, data warehouses, and robust data models, while ensuring data security and optimal performance. Skills & Experience: Proven experience in AzureData Engineering, particularly More ❯
Senior Data Analyst - 12 month Fixed Term Contract Who are we? Modern Networks Limited is a leading provider of managed IT services, specialising in delivering reliable, scalable, and secure IT solutions tailored to the needs of commercial properties, science parks, and SMEs. Our comprehensive services include IT support … broadband connectivity, telephone systems, and proactive cybersecurity protection. Modern Networks ensures business continuity through data backup and disaster recovery solutions, optimises performance by managing IT infrastructure, and enhances communications by monitoring and optimising network performance. They also help businesses achieve and maintain compliance with industry regulations and data protection laws. What's the role? We’re looking for a highly skilled Senior Data Analyst with strong data processing capabilities and a proven track record of translating complex data into meaningful insights. As a Senior Data Analyst, you will More ❯
Data Platforms Product Owner | Technical Data Background | Banking/Cards/Insurance | London (hybrid) | £600/day (Inside IR35) | 6 month initial contract Our London based Financial Services client is looking for a Technical Data Platforms Product Owner to work on a large project. … You'll have a solid data/tech background, preferably in Financial Services. You'll have the ability to write the User Stories for the Data Engineers and tell the Architect what you need in the Data Model - and you'll define the data platforms roadmap. You will also have good experience around ADF, Azure DataBricks, and Snowflake - plus your knowledge will include ETL processes, Data Governance, Data Warehouses, Data Marts, and Data Lakes. Key Skills & Experience: Product Owner DataMore ❯
City of London, London, United Kingdom Hybrid / WFH Options
Adecco
Datawarehouse Design and Implementation Engineer | AzureDataFactory | Snowflake and Star | Insurance | Geospatial Data | £550/day Inside IR35 | 6 month Contract | London/City (Hybrid working 2 days in the London office per week). Our client (a global speciality Insurance … firm) has a requirement for an experienced Data Warehouse Design/Implementation Engineer to work on the design and implementation of Azure datawarehouses using ADF/AzureDataFactory, with excellent ETL process - and Star/Snowflake schemas on long … term Data projects (initially 6 months). You'll also have some experience of Geographical Data/Geospatial Data/Geo Location Data. Your background will be working on large scale data warehouse projects in Financial Services (preferably Insurance) and with strong More ❯
Warwick, Warwickshire, West Midlands, United Kingdom
LA International Computer Consultants Ltd
Our client is looking for a AzureData Engineer to join their team on a six month rolling contract. They require a candidate to be able to be office based in Warwick, with the role also being deemed Inside IR35. Your responsibilities: * Collaborate with business stakeholders … to manage and deliver small enhancement requests for a data product. * Update solution designs and implement data workflows using AzureDataFactory (ADF), Logic Apps, and DataOps practices. * Develop and maintain data pipelines integrated with Snowflake. * Ensure effective … communication and coordination across teams for smooth project execution. Your Profile Essential skills/knowledge/experience: * ADF Expert Level * Logic Aps , * Data Ops , * Snowflake Desirable skills/knowledge/experience: * 6 to 8 years of Expierence LA International is a HMG approved ICT Recruitment and Project Solutions More ❯
Integration Engineer City of London - Contract Flexible day rate INSIDE IR35 APIs ; Data Flows ; Azure Logic Apps Working with prestigious London market insurer I am looking for a hands-on, forward-thinking Integration Engineer to help bring coherence and orchestration to a fragmented technology environment. About … the role- Design and implement integration solutions across our technology estate to enable seamless data and system interoperability. Assess existing systems and integrations, identifying areas of inefficiency, duplication, or fragility, and lead remediation efforts. Champion modern integration platforms, tools, and patterns (e.g., APIs, event-driven architecture, messaging systems … strategic goals and user needs. Experience required- Proven experience designing and implementing enterprise integration architectures using modern tooling Strong understanding of integration patterns, data orchestration, and system architecture in complex environments Familiarity with microservices architecture and modern API lifecycle management Comfortable operating in ambiguous, fast-evolving landscapes and More ❯
Job Title: Senior Data Engineer Location: London or Telford Contract: 6 months Clearance Requirement: Must hold or be eligible to obtain SC clearance About the Role We are seeking a Senior Data Engineer to join our team on a permanent basis, working on a high-profile … UK Government programme. You'll apply your expertise in data engineering and software development to solve complex data challenges, supporting critical infrastructure and decision-making through scalable, secure, and innovative data solutions. This is a fantastic opportunity to work with modern technologies in a … collaborative and mission-driven environment, with the freedom to innovate and grow your skills. Key Responsibilities Design and lead implementation of data pipelines from operational systems to BI and analytics platforms Build, maintain, and operate scalable data environments and real-time data streaming systems More ❯
Role : Data Engineer Location : Glasgow ( 3 days in a week) Key Requirements/Expertise : Primary skills : Data, Python, pyspark Should have expertise in data engineering experience leveraging technologies such as Snowflake, AzureDataFactory, ADLS, Databricks etc. Should … have expertise in writing SQL queries against any RDBMS with query optimization. Experience structuring Data Lake for reliability security and performance. Experience implementing ETL for Data Warehouse and Business intelligence solutions. Ability to write effective modular dynamic and robust code, establish code standards as well. Strong … and software release management. Knowledge of DevOps processes including CI/CD and Infrastructure as Code fundamentals Experience performing root cause analysis on data & processes and identify opportunities for improvement. Familiar with Agile software development methodologies. Proactive communication and stakeholder management. More ❯
once joined. Need to be UK-based to be eligible. Key skills and experience: o Proficiency in managing and administering DB2 databases and Azure SQL Managed Instance. o Experience with tools like SQL Server Migration Assistant (SSMA) for DB2 and AzureDataFactory (ADF). o Strong SQL skills and familiarity with scripting languages such as Python o Data Mapping and Transformation: Ability to map and transform data from DB2 schemas to Azure SQL schemas. o Skills in optimizing database performance and troubleshooting issues during … migration. o Understanding of Azure cloud services, including networking, storage, and security. o Strong analytical and problem-solving skills to address migration challenges. o Experience in migration projects, including planning, execution, and monitoring ( not BAU) Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and More ❯