implementing data engineering best-practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment . Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements. Optimize data solutions for performance and … up monitoring and data quality exception handling. Strong data modelling experience. Experience managing and developing CI/CD pipelines. Experience with Microsoft Azure products and services, and proficiency in ETL processes. Experience of working with APIs to integrate data flows between disparate cloud systems. Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. The aptitude More ❯
Birmingham, West Midlands, England, United Kingdom Hybrid / WFH Options
Broster Buchanan Ltd
time data streaming, batch data processing and data transformation processes Experience with core tools such as Data Factory, Databricks, Synapse, Kafka and Python Any exposure to data migration/ETL would be highly beneficial, with SQL/T-SQL, SSIS, SSRS and SSAS, as there is a large data migration project planned Any previous experience with setting up data governance … and processes would be highly beneficial Good proficiency in Power BI and Tableau Strong knowledge of data integration techniques andETL/ELT processes Experience with data modelling, data warehousing, and data governance best practices More ❯
BI reporting. * Conveying technical concepts to non-technical stakeholders across the business. Senior Data Engineer - What will you need? * Extensive Data Warehouse Experience. * Proficiency in Azure: Azure Data Factory (ETL), Azure SQL Server, Azure DevOps, Key Vaults and Logic Apps. * Strong Data Modeling Skills. * Familiarity with CI/CD pipelines and agile workflows. * Experience integrating data from diverse sources, ensuring … data accuracy and consistency throughout the ETL process. * Ambition to reduce processing times and improving efficiency. Robert Walters are proud to specialise in BI & Data recruitment across the UK, offering amazing opportunities on a permanent and interim basis. We are also proud to be heading up the Data Leaders roundtables and PBI BRUM meetup group, bringing new and exciting networking More ❯
Burton-on-Trent, Staffordshire, England, United Kingdom Hybrid / WFH Options
Crimson
in Azure Data Pipeline development is key for this position. Key Skills & Responsibilities: Build and manage pipelines using Azure Data Factory, Databricks, CI/CD, and Terraform. Optimisation of ETL processes for performance and cost-efficiency. Design scalable data models aligned with business needs. Azure data solutions for efficient data storage and retrieval. Ensure compliance with data protection laws (e.g. More ❯
programming languages such as Python and R. Experience working with cloud-based data platforms, such as Snowflake or Databricks is preferred. Expertise in using T-SQL to interrogate andextract data through complex queries and stored procedures. A comprehensive understanding of databases, query optimisation, load monitoring, the Microsoft BI Stack andETL frameworks. Technical expertise in data mining, data auditing More ❯
Walsall, West Midlands, West Midlands (County), United Kingdom
Michael Page
programming languages such as Python and R. · Experience working with cloud-based data platforms, such as Snowflake or Databricks is preferred. · Expertise in using T-SQL to interrogate andextract data through complex queries and stored procedures. · A comprehensive understanding of databases, query optimisation, load monitoring, the Microsoft BI Stack andETL frameworks. · Technical expertise in data mining, data auditing More ❯
Atherstone, Warwickshire, England, United Kingdom Hybrid / WFH Options
Aldi
using industry level best practices.Reporting to the Platform and Engineering Manager, the candidate will be required to design and manage data warehousing solutions, including the development of data models, ETL processes and data integration pipelines for efficient data consolidation, storage and retrieval, providing technical guidance and upskilling for the team, and conducting monitoring and optimisation activities. If you’re a … winning employer, apply to join #TeamAldi today! Your New Role: Project Management of demands and initiatives Lead the design and implementation of data warehousing Design and develop data models, ETL processes and data integration pipelines Complete Data Engineering end-to-end ownership of demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You More ❯
Develop and maintain interactive dashboards and reports using Qlik Sense. Collaborate with business units to gather requirements and translate them into technical specifications. Perform data extraction, transformation, and loading (ETL) from various sources. Ensure data accuracy, integrity, and consistency across all reports and dashboards. Analyse large datasets to identify trends, patterns, and actionable insights. Optimise Qlik applications for performance and … 2+ years of experience working with Qlik Sense. Strong SQL skills and experience with relational databases. Proficiency in data visualisation and storytelling with data. Experience with data modelling andETL processes. Excellent analytical and problem-solving skills. Strong communication, presentation, and collaboration abilities. Preferred Qualifications: Experience with cloud platforms (e.g., AWS, Azure, GCP). Familiarity with other BI tools (e.g. More ❯
Birmingham, West Midlands, England, United Kingdom Hybrid / WFH Options
Asset Resourcing Limited
SSIS, SSAS, SSRS, and PowerBI). Proficiency in languages such as Python and SQL, commonly used in Azure data processing. Use of Azure Data Factory for designing and managing ETL workflows. Experience with Microsoft Azure, including deploying and managing data solutions in Azure. Use of Azure Logic Apps for workflow orchestration. Ideally experience of Integration of data from external sources More ❯
Power BI, and DAX, as these tools form a core part of the role. Solid knowledge of T-SQL, with experience writing complex queries and developing stored procedures to extractand interrogate data. Deep understanding of databases, query optimisation techniques, load monitoring, the Microsoft BI Stack, andETL frameworks. Technical expertise in data mining, auditing, and segmentation. Experience in building More ❯
Power BI, and DAX, as these tools form a core part of the role. Solid knowledge of T-SQL, with experience writing complex queries and developing stored procedures to extractand interrogate data. Deep understanding of databases, query optimisation techniques, load monitoring, the Microsoft BI Stack, andETL frameworks. Technical expertise in data mining, auditing, and segmentation. Experience in building More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing andETL tools like Apache Kafka, Spark, or Hadoop. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK More ❯
Birmingham, Staffordshire, United Kingdom Hybrid / WFH Options
Kerv Digital for Digital Transformation
migrated data Desirable experience: • Azure data certifications • Azure Synapse: Synapse-link, on-demand SQL engine, dedicated SQL pool • Writing unit tests, git Version control • Awareness of reliability patterns in ETL pipelines • Use of python in Jupyter notebooks for data processing • Azure storage technologies and cost/performance characteristics • Power BI, DAX, data flows • Techniques and tools for sanitizing data prior More ❯
Longbridge, City and Borough of Birmingham, West Midlands (County), United Kingdom Hybrid / WFH Options
Kerv Digital
migrated data Desirable experience: Azure data certifications Azure Synapse: Synapse-link, on-demand SQL engine, dedicated SQL pool Writing unit tests, git Version control Awareness of reliability patterns in ETL pipelines Use of python in Jupyter notebooks for data processing Azure storage technologies and cost/performance characteristics Power BI, DAX, data flows Techniques and tools for sanitizing data prior More ❯
Warwickshire, West Midlands, United Kingdom Hybrid / WFH Options
Hays
in a highly skilled, collaborative environment with access to end-to-end business data. You'll: Lead the design and implementation of data warehousing solutions Develop robust data models, ETL pipelines, and data integration processes Take end-to-end ownership of demand delivery Provide technical mentorship and support (2nd/3rd line) Collaborate with business partners, data scientists, and report More ❯
Birmingham, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Tenth Revolution Group
and trends. Requirements: -3+ years of experience as a data engineer. -Strong proficiency in AWS data services such as S3, Glue, Lambda, and Redshift. -Experience with data modelling, ETL processes, and data warehousing concepts. -Proficiency in SQL and Python. Benefits: -Competitive salary, benefits package and discretionary bonus. -Opportunity to work on cutting-edge technology. -Career growth and development opportunities. More ❯