development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services more »
in accordance with guidelines provided by the Trusts Information Governance and cybersecurity leads. 2.6 Maintain processes, documentation, concerning the development and optimisation of complex Extract, Transform & Load (ETL)/Extract, Load & Transform (ELT) data pipelines. 2.7 Produce technical documentation to support the administration and management of the corporate data warehouse more »
SE1, Chaucer, Greater London, United Kingdom Hybrid / WFH Options
Royal College Of Obstetricians And Gynaecologists
through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETLand reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »
Better Placed Ltd - A Sunday Times Top 10 Employer in 2023!
Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling andETL/ELT concepts. Strong problem-solving and troubleshooting skills. Excellent communication and collaboration skills. Data Engineer – London more »
cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies such as Azure Data Factory. Implement and optimize data solutions using Kubernetes for container orchestration. Collaborate with more »
our data systems. Champion data quality principles and best practices throughout the organization. Required Skills and Experience: Advanced proficiency MS SQL Extensive experience with ETL/ELT techniques, data warehouse design, and data visualisation. Strong command of Microsoft tools such as Fabric, Azure Blob Storage, Data Factory, Purview, and Power more »
Sunderland, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
SCS Sofas
Azure DevOps, Visual Studio, Tabular Editor Understanding of Microsoft Dynamics, Business Central would be beneficial Solid understanding and experience of database management systems andETL Framework Experience in leading/motivating teams to deliver meaningful change and drive their professional development. Experience managing and building relationships with internal and external more »
various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »
capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETLand ELT processes. Ensure the seamless flow and availability of high-quality data across the organisation Use Snowflake for data storage, processing, and analytics. Optimise more »
impact on internal stakeholders and customers is understood Qualifications Who we're looking for: Proficient across many domains of data engineering, including ELT/ETL, metadata management, data integration, data management in transit and at rest and data streaming Experience of Kimball modelling techniques to design databases & data warehousing solutions more »
model to meet new business requirements2+ years managing an analytics engineering team using a scrum/agile methodologyExperience working with commercial data warehouses (Redshift), ETL tools (Dbt), data visualization (Python notebook, Thoughtspot, Looker, Tableau, Hex), and Data Dictionary tools (Atlan)Demonstrated experience leading 2 or more multi-department analytics projects more »
Modelling, Data Point Modelling etc.), data architecture design patterns and paradigms (e.g. data lakehouse, medallion architecture, data vault, data mesh), data integration and engineering (ETL, ELT, CDC) for enterprise scale analyticsExperience designing data pipelines, data lakes and data warehouses to support data storage (SQL, NoSQL), processing analytics and visualisation solutions more »
to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, andload data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »
Greater London, England, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
of team, including ways of working, engineering principles, data governance and best practice. Become an SME on the design, development, and deployment of data ETL pipelines (using Azure Data Factory and other technologies) to access, combine andtransform data from on-prem and cloud-based sources. Ensure that all data more »
Clerkenwell, England, United Kingdom Hybrid / WFH Options
Datatech
of team, including ways of working, engineering principles, data governance and best practice. 3.Become an SME on the design, development, and deployment of data ETL pipelines (using Azure Data Factory and other technologies) to access, combine andtransform data from on-prem and cloud-based sources. 4.Ensure that all data more »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Power BI, Azure Cloud Services (including PowerShell, Functions, Devops, and CI/CD Pipelines) Significant experience in Azure SQL Development and Data engineering, managing ETLand ELT pipelines Ability to work in a small dynamic team working across the data and analytics space University degree in a STEM subject HOW more »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Change Digital – Digital & Tech Recruitment
in front-end visualisation tools - Power BI Experience with Azure Databricks Strong skills in data storytelling and dashboard creation Understanding of backend data processes (ETL, data integration) Experience with SQL, Python, Git Additional skills: Excellent communication and stakeholder management skills Ability to translate complex data into actionable insights. Strong analytical more »
data pipelines for data ingestion, processing, and transformation in Azure. Utilise Azure Data Factory, Azure Databricks and SAP Business Objects to create and maintain ETL operations. Deliver dashboard reporting and data sets which are interactive and user-friendly via PowerBI Identifying and integrating external data into the business data model more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
Manchester Area, United Kingdom Hybrid / WFH Options
Forsyth Barnes
reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. Proficient in data modeling and data warehousing. Multiple years of more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Forsyth Barnes
within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. l Proficient in data modeling and data warehousing. l Multiple more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Reed Technology
of the below: - Cloud technology (Azure or AWS) - this organisation are migrating to cloud soon, so any experience here would be great - Data engineering (ETL) - designing and developing processes, both on-premise and maybe even cloud - Exposure to BI Tooling - Power BI would be great, however other tool are considered more »
Azure. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Strong SQL and Python skills. Experience with data modeling, ETL processes, and data warehousing. Knowledge of big data technologies such as Spark and Hadoop is a plus. Excellent problem-solving skills and attention to detail. more »