implementing data engineering best-practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment . Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements. Optimize data solutions for performance and … up monitoring and data quality exception handling. Strong data modelling experience. Experience managing and developing CI/CD pipelines. Experience with Microsoft Azure products and services, and proficiency in ETL processes. Experience of working with APIs to integrate data flows between disparate cloud systems. Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. The aptitude More ❯
the Role Designing, building and maintaining data pipelines. Building and maintaining data warehouses. Data cleansing and transformation. Developing and maintaining ETL processes (ELT = extract, transform, load) to extract, transform, andload data from various sources into data warehouses. Validating charts and reports created by systems built in-house. Creating validation tools. Developing and maintaining data models, data tools. Monitoring and … Experience in R programming language. Experience in Python programming language. Experience in designing, building and maintaining data pipelines. Experience with data warehousing and data lakes. Experience in developing and maintaining ETL processes. Experience in developing data integration tools. Experience in data manipulation, data analysis, data modelling. Experience with cloud platforms (AWS, Azure, etc.) Experience in designing scalable, secure, and cost More ❯
Liverpool, Lancashire, United Kingdom Hybrid / WFH Options
Intuita - Vacancies
using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation. • Data Modelling using Kimball, 3NF or Dimensional methodologies • Utilize SQL and Python languages to extract, transform, andload data from various sources into Azure Databricks and Azure SQL/SQL Server. • Design and implement metadata driven pipelines to automate data processing tasks. • Collaborate with cross-functional teams More ❯
Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements into robust technical solutions. Implement and maintain ETL/ELT pipelines using Azure Data Factory or Synapse Pipelines . Design and develop a fit-for-purpose enterprise data warehouse to serve reporting and analytics. Ensure data quality, data … Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta Lake and large-scale data processing. Experience building ETL pipelines in Azure Data Factory or similar orchestration tools. Familiarity with version control systems (e.g., Git ) and CI/CD practices. Preferred Qualifications: Experience in a manufacturing, FMCG, or retail More ❯
/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with APIs and integrating them into data pipelines. Strong programming More ❯
Middlesbrough, Yorkshire, United Kingdom Hybrid / WFH Options
Causeway Technologies
products. Work with the Group Architect to align team standards and processes to Causeway's and influence the evolution of Causeway's standards and processes. Essential experience Experience with ETL/ELT processes and frameworks. Experience with CI/CD pipelines and Infrastructure as Code and understanding SDLC principles of data engineering workflows. Previous background in a similar software engineering More ❯
important to ensure the delivery of robust, future-proof data solutions. Key Skills Experience developing modern data stacks and cloud data platforms. Capable of engineering scalable data pipelines using ETL/ELT tools e.g. Apache Spark, Airflow, dbt. Expertise with cloud data platforms e.g. AWS (Redshift, Glue), Azure (Data Factory, Synapse), Google Cloud (BigQuery, Dataflow). Proficiency in data processing More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. More ❯
clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. More ❯
platform for data analytics, including design and deployment of infrastructure. Expertise in creating CI/CD pipelines. Experience in creating FTP (SFTP/FTPS) configurations. Experience in working with ETL/ELT workflows for data analytics. Degree in Computer Science, Mathematics or related subject. Highly desirable skills & exposure: Working collaboratively as part of an Agile development squad. Experience and knowledge More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting projects … an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines … ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.Drive continuous improvement by refining processes, products, and identifying new tools, standards, and practices.Collaborate with teams across the business to define solutions, requirements, and testing More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting projects … an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines … ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data pipelines, ETL processes, and databases. Drive continuous improvement by refining processes, products, and identifying new tools, standards, and practices. Collaborate with teams across the business to define solutions More ❯
Middlesbrough, Cleveland, England, United Kingdom Hybrid / WFH Options
Reed
BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using Azure Data Factory (ADF) and other technologies. Coach and mentor junior BI professionals. Test and modify new data sets and reports to ensure reliability and … stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar products for complex integrations. Role experience as a DBA or in DBA related activities. Relevant further qualification in a business analytics related field. More ❯
Goldthorpe, Rotherham, South Yorkshire, England, United Kingdom Hybrid / WFH Options
Reed
BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using Azure Data Factory (ADF) and other technologies. Coach and mentor junior BI professionals. Test and modify new data sets and reports to ensure reliability and … stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar products for complex integrations. Role experience as a DBA or in DBA related activities. Relevant further qualification in a business analytics related field. More ❯
Stockton-on-Tees, Cleveland, England, United Kingdom
Reed
deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting as a subject matter expert on Azure data tools and best practices. Develop and maintain ETL processes using SQL, SSIS, and Azure Data Factory. Integrate data from diverse sources including internal databases, APIs, and third-party providers. Monitor and tune performance of data components, ensuring data … to support transparency and maintainability. Required Skills & Experience Bachelor’s degree in Computer Science, Information Systems, or a related technical field. 3+ years of experience in data engineering andETL development. Advanced proficiency in T-SQL, SSIS, and Azure Data Factory. Strong experience with data modelling, performance tuning, and troubleshooting. Proven ability to lead and manage a small technical team. More ❯
deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting as a subject matter expert on Azure data tools and best practices. Develop and maintain ETL processes using SQL, SSIS, and Azure Data Factory. Integrate data from diverse sources including internal databases, APIs, and third-party providers. Monitor and tune performance of data components, ensuring data … to support transparency and maintainability. Required Skills & Experience Bachelor's degree in Computer Science, Information Systems, or a related technical field. 3+ years of experience in data engineering andETL development. Advanced proficiency in T-SQL, SSIS, and Azure Data Factory. Strong experience with data modelling, performance tuning, and troubleshooting. Proven ability to lead and manage a small technical team. More ❯
Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products Champion best practices in testing, CI/CD, version control, and infrastructure More ❯
Leeds, Morley, West Yorkshire, United Kingdom Hybrid / WFH Options
VIQU IT
Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products Champion best practices in testing, CI/CD, version control, and infrastructure More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Lloyds Bank plc
quality and integrity. Applying test data management tools for crafting, managing, and maintaining test data sets. Developing and execute data transformation tests using DBT (Data Build Tool). Performing ETL testing to validate data extraction, transformation, and loading processes. Collaborating with data engineers, analysts, and other stakeholders to identify and resolve data quality issues. Automating data testing processes to improve … in defining and implementing data testing strategies. Hands-on experience with test data management tools. Proficiency in DBT (Data Build Tool) for data transformation and testing. Strong understanding of ETL processes and experience in ETL testing. Excellent problem-solving skills and attention to detail. Experience with data integration tools and frameworks. Understanding of data quality frameworks and standard methodologies. Understanding More ❯
Leeds, England, United Kingdom Hybrid / WFH Options
In Technology Group
Design and develop BI solutions using tools like Power BI, SQL, and DAX Collaborate with cross-functional teams to gather requirements and deliver insights Maintain and optimize data models, ETL processes, and reporting systems Ensure data accuracy, integrity, and security across all BI platforms Support ad-hoc data analysis and reporting needs Requirements Proven experience as a BI Developer or … in a similar data-focused role Strong SQL skills and experience with relational databases Proficiency in Power BI (or similar tools) Understanding of data warehousing concepts andETL processes Excellent problem-solving and communication skills Nice to Have Experience with cloud platforms (e.g., Azure, AWS) Knowledge of Python or R for data analysis Familiarity with Agile methodologies What We Offer More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Fruition Group
Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse andETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Dept Holding B.V
of leading complex data initiatives Strong technical leadership experience, with the ability to guide and develop engineering teams Deep expertise in designing and implementing data architectures, data pipelines, andETL processes Hands-on experience with cloud platforms (GCP, AWS, Azure) and their data-specific services Proficiency in Python, SQL, and data orchestration tools (e.g., Airflow, DBT) Experience with modern data More ❯
reporting in a consultancy and programme-delivery context. Experience with Zoho Analytics and Salesforce is a bonus. Key Responsibilities Data Management & Reporting Write and maintain efficient SQL queries to extract, transform, andload (ETL) data from various sources Develop scalable and insightful dashboards and reports in Power BI to support programme performance tracking, operations, and compliance Monitor and troubleshoot data More ❯
and implementing automated reporting solutions in Power BI Support the operation of the business's applications which support the distribution of data to external customers Data Modelling: Extract, transform, andload data from a variety of sources into Power BI and develop and maintain data models which support data analysis and reporting requirements Collaboration: Work closely with stakeholders to understand More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Forward Role
Data Engineer – Leeds– SQL | Power BI | Azure | ETL Ready to drive innovation with T-SQL and BI, shaping a cutting-edge data platform? Do you have the expertise to build and maintain complex data warehouses and Power BI solutions? Excited to solve BI challenges and support data-driven decision-making across the business? A fantastic new opportunity has arisen with … models. In addition to working with Power BI, you'll play a key role in optimising and developing the company's Data Warehouse. This will involve designing and maintaining ETL/ELT processes, ensuring seamless data integration and efficient data flow. You'll work with SQL Server, SSIS, and Azure Data Factory to ensure the warehouse can support large-scale … SQL expertise will be crucial for managing complex queries and troubleshooting data pipeline issues. Key Skills: SQL/T-SQL Power BI or Tableau Experience with data warehousing andETL/ELT processes Azure If you're passionate about shaping data solutions and thrive in a fast-paced, collaborative environment, this could be the role for you. APPLY now or More ❯