implementing data engineering best-practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment . Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements. Optimize data solutions for performance and … up monitoring and data quality exception handling. Strong data modelling experience. Experience managing and developing CI/CD pipelines. Experience with Microsoft Azure products and services, and proficiency in ETL processes. Experience of working with APIs to integrate data flows between disparate cloud systems. Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. The aptitude More ❯
the Role Designing, building and maintaining data pipelines. Building and maintaining data warehouses. Data cleansing and transformation. Developing and maintaining ETL processes (ELT = extract, transform, load) to extract, transform, andload data from various sources into data warehouses. Validating charts and reports created by systems built in-house. Creating validation tools. Developing and maintaining data models, data tools. Monitoring and … Experience in R programming language. Experience in Python programming language. Experience in designing, building and maintaining data pipelines. Experience with data warehousing and data lakes. Experience in developing and maintaining ETL processes. Experience in developing data integration tools. Experience in data manipulation, data analysis, data modelling. Experience with cloud platforms (AWS, Azure, etc.) Experience in designing scalable, secure, and cost More ❯
Newcastle Upon Tyne, United Kingdom Hybrid / WFH Options
NHS Business Services Authority
deliver measurable outcomes. Experience of working in environment where written and verbal communication are essential to delivery of outcomes. Desirable Awareness of data engineering concepts, including Data Warehousing or ETL processes. Exposure to deployment pipelines or CI/CD concepts, with a willingness to learn how code is tested and promoted into production environments. Familiarity with reporting and dashboarding tools More ❯
Liverpool, Lancashire, United Kingdom Hybrid / WFH Options
Intuita - Vacancies
using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation. • Data Modelling using Kimball, 3NF or Dimensional methodologies • Utilize SQL and Python languages to extract, transform, andload data from various sources into Azure Databricks and Azure SQL/SQL Server. • Design and implement metadata driven pipelines to automate data processing tasks. • Collaborate with cross-functional teams More ❯
Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements into robust technical solutions. Implement and maintain ETL/ELT pipelines using Azure Data Factory or Synapse Pipelines . Design and develop a fit-for-purpose enterprise data warehouse to serve reporting and analytics. Ensure data quality, data … Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta Lake and large-scale data processing. Experience building ETL pipelines in Azure Data Factory or similar orchestration tools. Familiarity with version control systems (e.g., Git ) and CI/CD practices. Preferred Qualifications: Experience in a manufacturing, FMCG, or retail More ❯
/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with APIs and integrating them into data pipelines. Strong programming More ❯
Middlesbrough, Yorkshire, United Kingdom Hybrid / WFH Options
Causeway Technologies
products. Work with the Group Architect to align team standards and processes to Causeway's and influence the evolution of Causeway's standards and processes. Essential experience Experience with ETL/ELT processes and frameworks. Experience with CI/CD pipelines and Infrastructure as Code and understanding SDLC principles of data engineering workflows. Previous background in a similar software engineering More ❯
important to ensure the delivery of robust, future-proof data solutions. Key Skills Experience developing modern data stacks and cloud data platforms. Capable of engineering scalable data pipelines using ETL/ELT tools e.g. Apache Spark, Airflow, dbt. Expertise with cloud data platforms e.g. AWS (Redshift, Glue), Azure (Data Factory, Synapse), Google Cloud (BigQuery, Dataflow). Proficiency in data processing More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Fruition Group
important to ensure the delivery of robust, future-proof data solutions. Key Skills: Experience developing modern data stacks and cloud data platforms. Capable of engineering scalable data pipelines using ETL/ELT tools e.g. Apache Spark, Airflow, dbt. Expertise with cloud data platforms e.g. AWS (Redshift, Glue), Azure (Data Factory, Synapse), Google Cloud (BigQuery, Dataflow). Proficiency in data processing More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. More ❯
clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. More ❯
platform for data analytics, including design and deployment of infrastructure. Expertise in creating CI/CD pipelines. Experience in creating FTP (SFTP/FTPS) configurations. Experience in working with ETL/ELT workflows for data analytics. Degree in Computer Science, Mathematics or related subject. Highly desirable skills & exposure: Working collaboratively as part of an Agile development squad. Experience and knowledge More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting projects … an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines … ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.Drive continuous improvement by refining processes, products, and identifying new tools, standards, and practices.Collaborate with teams across the business to define solutions, requirements, and testing More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting projects … an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines … ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data pipelines, ETL processes, and databases. Drive continuous improvement by refining processes, products, and identifying new tools, standards, and practices. Collaborate with teams across the business to define solutions More ❯
Middlesbrough, Cleveland, England, United Kingdom Hybrid / WFH Options
Reed
BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using Azure Data Factory (ADF) and other technologies. Coach and mentor junior BI professionals. Test and modify new data sets and reports to ensure reliability and … stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar products for complex integrations. Role experience as a DBA or in DBA related activities. Relevant further qualification in a business analytics related field. More ❯
Goldthorpe, Rotherham, South Yorkshire, England, United Kingdom Hybrid / WFH Options
Reed
BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using Azure Data Factory (ADF) and other technologies. Coach and mentor junior BI professionals. Test and modify new data sets and reports to ensure reliability and … stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar products for complex integrations. Role experience as a DBA or in DBA related activities. Relevant further qualification in a business analytics related field. More ❯
Stockton-on-Tees, Cleveland, England, United Kingdom
Reed
deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting as a subject matter expert on Azure data tools and best practices. Develop and maintain ETL processes using SQL, SSIS, and Azure Data Factory. Integrate data from diverse sources including internal databases, APIs, and third-party providers. Monitor and tune performance of data components, ensuring data … to support transparency and maintainability. Required Skills & Experience Bachelor’s degree in Computer Science, Information Systems, or a related technical field. 3+ years of experience in data engineering andETL development. Advanced proficiency in T-SQL, SSIS, and Azure Data Factory. Strong experience with data modelling, performance tuning, and troubleshooting. Proven ability to lead and manage a small technical team. More ❯
deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting as a subject matter expert on Azure data tools and best practices. Develop and maintain ETL processes using SQL, SSIS, and Azure Data Factory. Integrate data from diverse sources including internal databases, APIs, and third-party providers. Monitor and tune performance of data components, ensuring data … to support transparency and maintainability. Required Skills & Experience Bachelor's degree in Computer Science, Information Systems, or a related technical field. 3+ years of experience in data engineering andETL development. Advanced proficiency in T-SQL, SSIS, and Azure Data Factory. Strong experience with data modelling, performance tuning, and troubleshooting. Proven ability to lead and manage a small technical team. More ❯
Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products Champion best practices in testing, CI/CD, version control, and infrastructure More ❯
Leeds, Morley, West Yorkshire, United Kingdom Hybrid / WFH Options
VIQU IT
Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products Champion best practices in testing, CI/CD, version control, and infrastructure More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Lloyds Bank plc
quality and integrity. Applying test data management tools for crafting, managing, and maintaining test data sets. Developing and execute data transformation tests using DBT (Data Build Tool). Performing ETL testing to validate data extraction, transformation, and loading processes. Collaborating with data engineers, analysts, and other stakeholders to identify and resolve data quality issues. Automating data testing processes to improve … in defining and implementing data testing strategies. Hands-on experience with test data management tools. Proficiency in DBT (Data Build Tool) for data transformation and testing. Strong understanding of ETL processes and experience in ETL testing. Excellent problem-solving skills and attention to detail. Experience with data integration tools and frameworks. Understanding of data quality frameworks and standard methodologies. Understanding More ❯
Leeds, England, United Kingdom Hybrid / WFH Options
In Technology Group
Design and develop BI solutions using tools like Power BI, SQL, and DAX Collaborate with cross-functional teams to gather requirements and deliver insights Maintain and optimize data models, ETL processes, and reporting systems Ensure data accuracy, integrity, and security across all BI platforms Support ad-hoc data analysis and reporting needs Requirements Proven experience as a BI Developer or … in a similar data-focused role Strong SQL skills and experience with relational databases Proficiency in Power BI (or similar tools) Understanding of data warehousing concepts andETL processes Excellent problem-solving and communication skills Nice to Have Experience with cloud platforms (e.g., Azure, AWS) Knowledge of Python or R for data analysis Familiarity with Agile methodologies What We Offer More ❯
ideally within internal consultancy or transformation environments. Strong experience with PostgreSQL , Power BI , and low-code platforms (Budibase or similar). Solid programming skills, preferably in Python , especially for ETL development and support. Proficiency with version control systems (e.g., GitHub ), with an understanding of best practices for collaboration, review, and deployment. Familiarity with REST APIs , including how to design, consume More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Dept Holding B.V
of leading complex data initiatives Strong technical leadership experience, with the ability to guide and develop engineering teams Deep expertise in designing and implementing data architectures, data pipelines, andETL processes Hands-on experience with cloud platforms (GCP, AWS, Azure) and their data-specific services Proficiency in Python, SQL, and data orchestration tools (e.g., Airflow, DBT) Experience with modern data More ❯
reporting in a consultancy and programme-delivery context. Experience with Zoho Analytics and Salesforce is a bonus. Key Responsibilities Data Management & Reporting Write and maintain efficient SQL queries to extract, transform, andload (ETL) data from various sources Develop scalable and insightful dashboards and reports in Power BI to support programme performance tracking, operations, and compliance Monitor and troubleshoot data More ❯