to develop an ODS or DWH. Experience in integrating data analytical outcomes and key information into clinical workflows. Desired skills Knowledge of streaming data architectures and technologies (e.g., Kafka, Azure Event Hubs, Kinesis). Knowledge of handing Genome datasets (FASTQ, VCF etc.) and document formats (IHE). General experience working with Gen AI including LLM generated clinical data/… environments and building various types of data pipelines. Demonstrated ability to design and implement data integration and conversion pipelines using ETL/ELT tools, accelerators, and frameworks such as Azure Data Factory, AzureSynapse, Snowflake (Cloud), SSIS, or custom scripts. Skilled in developing reusable ETL frameworks for data processing. Proficient in at least one programming language commonly … used for data manipulation and scripting, including Python, PySpark, Java, or Scala. Strong understanding and hands-on experience with DevOps practices and tools, especially Azure DevOps for CI/CD, Git for version control, and Infrastructure as Code. Advanced SQL skills and experience working with relational databases like PostgreSQL, SQL Server, Oracle, and MySQL. Experience implementing solutions on cloud More ❯
Data Lakes, Warehousing, MDM, and BI. Engineering delivery practices : Knowledge of Agile, DevOps, Git, APIs, Containers, Microservices, and Data Pipeline orchestration. Broader platform experience (desirable): Familiarity with Databricks, Snowflake, Azure Data Factory, AzureSynapse, Microsoft SQL/SSIS. Certifications that are a plus: Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) Microsoft Certified: Fabric Data Engineer … output. Adapt easily to solo or team work. Stay updated on industry trends and standards. If you're passionate about data and want to join a leading data and analytics company based in the UK, consider applying at Dufrain. Please submit your CV highlighting relevant experience and certifications. Applicants must have the right to work in the UK; visa More ❯
help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key Responsibilities: Forge strong partnerships with clients and cross-functional teams, bridging the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges … data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and AzureSynapse . Strong skills in SQL and Apache Spark (Scala or Python). A strong foundation in More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting … professional experience in a data role.At least 3 years' professional experience developing data pipelines and ETLs using Microsoft products.Minimum 1 year of experience working with cloud-native technologies like Azure Data Factory.Demonstrable experience of delivering technical work within time and budget constraints.Good understanding of data security best practices.Experience in supporting ETLs or data pipelines crucial to a production system.Experience … working in a cross-functional team to deliver technical solutions.Desirable Skills:Experience with SQL Server, SSIS, Azure Data Factory, and Azure SQL.Experience with Cloud and Infrastructure as Code, particularly in an Azure setting using Bicep.Understanding of DevOps practices and the associated benefits.Skill in database testing including unit, performance, stress, and security testing.Experience working in an agile team.Experience More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting … in a data role. At least 3 years’ professional experience developing data pipelines and ETLs using Microsoft products. Minimum 1 year of experience working with cloud-native technologies like Azure Data Factory. Demonstrable experience of delivering technical work within time and budget constraints. Good understanding of data security best practices. Experience in supporting ETLs or data pipelines crucial to … a production system. Experience working in a cross-functional team to deliver technical solutions. Desirable Skills: Experience with SQL Server, SSIS, Azure Data Factory, and Azure SQL. Experience with Cloud and Infrastructure as Code, particularly in an Azure setting using Bicep. Understanding of DevOps practices and the associated benefits. Skill in database testing including unit, performance, stress More ❯
West Midlands, England, United Kingdom Hybrid / WFH Options
itecopeople
Contract Reporting Lead - Power BI/Dynamics/Azure 6 Months | Hybrid (West Midlands, 1-2 days/month) | up to c£600/day (Outside IR35) We're looking for a Reporting Lead to drive the reporting strategy for a key transformation programme, replacing legacy customer and property data systems with Dynamics 365 and Microsoft Fabric . This … best practice) Experience with Microsoft Fabric (early-stage or implementation exposure ideal) Familiarity with Dynamics 365: Customer Engagement (esp. iProperty Cloud) Finance & Operations Understanding of data flows between Dynamics, Azure, and reporting platforms Experience with Azure Data Services (Data Factory, SynapseAnalytics) Confident facilitator of workshops and capable of translating complex needs into clear plans Excellent More ❯
structured datasets that can be utilized for reporting purposes in a performant, secure way. Key responsibilities: Taking full ownership of assigned projects and BAU tasks. Maintaining current pipelines within Azure ADF and Synapse Analytics. Building a process to transform raw data from various CRM systems into a harmonized and curated layer. Developing the usage of event-driven topics … practices within the Data Team. Developing and creating data science tools to gain a deeper understanding of the customer base. Recording and updating work on the Project Management System (Azure DevOps). Owning and enhancing the BAU runbook for engineering operations. Developing instrumentation and monitoring of automated IT tasks. Taking a leadership role in the engineering functions of the … required: 3-5 years' cloud-based data engineering experience. Experience with formal methodologies in data engineering. Experience leading or working within an engineering team or function. Experience with the Azure Stack. Experience working in a proactive analytics environment. Experience in the Utilities sector. Experience leading technical projects. Skills & Technologies required: Proficiency in cloud-based data engineering tools (ADF More ❯
Experience 3+ years experience as a SQL Developer or in a similar data-focused role Advanced knowledge of Microsoft SQL Server, T-SQL, indexing, and query optimisation Experience with Azure SQL and related services (e.g. Azure Data Factory, SynapseAnalytics is a plus) Strong understanding of data security and governance best practices Experience with SSRS, Power More ❯
Experience 3+ years' experience as a SQL Developer or in a similar data-focused role Advanced knowledge of Microsoft SQL Server, T-SQL, indexing, and query optimisation Experience with Azure SQL and related services (e.g. Azure Data Factory, SynapseAnalytics is a plus) Strong understanding of data security and governance best practices Experience with SSRS, Power More ❯
the mortgage market. Two years ago, they embarked on an ambitious journey to modernise their operations, initiating a massive migration from legacy systems to a cutting-edge cloud environment (Azure). You'll be joining a forward-thinking organisation committed to leveraging technology to enhance its services and operational efficiency. THE ROLE: As the Head of Data Engineering, you … team of approximately 30 Data Engineers across multiple locations. Your primary responsibilities will include: Leading Cloud Migration: Overseeing the strategic migration of legacy databases (primarily SQL Server) to the Azure cloud platform. Team Leadership: Managing multiple Data Engineering teams, ensuring continued delivery of legacy projects while simultaneously driving the adoption of the modern Azure platform. Legacy Decommissioning: Strategically … teams, including managing multiple teams and offshore resources. Cloud Migration Expertise: Demonstrated success in leading end-to-end data platform migrations to the cloud, with a strong preference for Azure (Synapse, Databricks, Azure SQL, PowerBI). Legacy System Knowledge: Experience with traditional SQL Server technologies and an understanding of maintaining and decommissioning legacy data warehouses. Technical Acumen More ❯
in a data role.- Minimum of 3 years’ experience in developing data pipelines and ETLs using Microsoft products, with at least 1 year working with cloud-native technologies like Azure Data Factory.- Proven track record of delivering technical work within time and budget constraints.- Strong understanding of data security best practices.- Experience supporting ETLs or data pipelines crucial to … a production system.- Experience working in a cross-functional team to deliver technical solutions.Desirable Skills:- Proficiency with SQL Server, SSIS, Azure Data Factory, and Azure SQL.- Experience with Cloud and infrastructure as Code, particularly in an Azure setting using Bicep.- Understanding of DevOps practices.- Skill in database testing; unit, performance, stress, security.- Experience in agile teams and … highly regulated industries.- Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.- Data science experience using R, Stata, or Python.- Familiarity with Atlassian tools; JIRA, Confluence, BitBucket.- Understanding of clinical trials, GCP, and GxP.Personal Attributes:- Strong collaboration skills, including teamwork, listening, and communication.- Professionalism and a commitment to delivery and improvement.- Curiosity and More ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
oriented environment. Experience Required: To be successful in this role, you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the Role: In this role … collaborate with stakeholders to understand data requirements, contribute to architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders … insights teams to provide actionable data outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently More ❯
Eastleigh, Hampshire, United Kingdom Hybrid / WFH Options
Spectrum IT Recruitment
cloud technologies and help build a robust new data platform for real-time analytics. Key Responsibilities: Own and deliver assigned data projects and BAU tasks Maintain data pipelines using Azure ADF and SynapseAnalytics Transform raw CRM data into structured, curated datasets Develop event-driven data processes for internal and external use Contribute to best-practice architecture … decisions and documentation Support reporting and analytics by surfacing clean, secure data Build monitoring tools for engineering operations and performance Work with Azure DevOps to manage and track project work About You Essential Skills & Experience: Proficiency in cloud-based tools (ADF, Synapse, S3, Lambda) Experience using PySpark for ELT pipelines Strong analytical and problem-solving mindset Able More ❯
KEDA (Kubernetes-based Event Driven Autoscaler), and familiarity with Celery for distributed task execution and background job processing, particularly in data pipeline or microservices environments Hands-on experience with Azure cloud services, especially Azure Data Factory, Azure Databricks, Azure Storage, and Azure Synapse. Proficiency in designing and deploying CI/CD pipelines using AzureMore ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
supportive and growth-oriented environment. To be successful in this role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
oriented environment. Experience Required: To be successful in this role, you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
oriented environment. Experience Required: To be successful in this role, you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, AzureSynapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience … roles may be subject to successful background checks including a DBS and Credit Check. Tenth Revolution Group (and Nigel Frank) are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Canopius
work within our growing Data team to help shape and enhance our data capabilities. The role will involve developing and maintaining a modern, scalable and reliable data architecture in Azure capable of storing large volumes of information to support analytical solutions. The role will also involve supporting development activities on our legacy SQL Server data warehouses and aiding in … the transition over to the Azure platform. We are looking for candidates who are keen to develop their data engineering skills within the Azure cloud environment, supporting the end-to-end development process from business requirements gathering through to testing. Key Responsibilities: Developing technical ability and knowledge by shadowing and assisting with the development of data solutions in … Azure components such as Azure Data Factory, Databricks, Synapse and Azure SQL Database Assisting development activities on our legacy SQL Server data warehouses and facilitating our transition to Azure Performing root cause analysis on reported issues and helping to identify solutions Assisting in creating and maintaining comprehensive documentation of data transformations, processes and systems Peer More ❯
Bristol, Avon, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
data integrity and GDPR compliance To be successful in the role you will have Hands-on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and AzureSynapse Strong command of SQL Excellent communication More ❯