Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Azure SQL. Proficiency in SQL , Python , or Scala for data processing. Experience with ETL/ELT design patterns and building scalable, distributed data architectures. Deep understanding of data modelling , data warehousing , and data integration best practices. Knowledge of Azure more »
Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
Durham, County Durham, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
ultimately deliver data solutions including integrations, data transformations, warehousing and business intelligence reporting. The design and implementation of data ETL pipelines to extract, transformandload data from client and third-party data sources. Implementing and enforcing data governance policies and processes to ensure data is of the highest quality. … PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power BI) Strong programming skills, ideally in Python. Understanding of ETL pipeline development for data source integrations and data transformations. Understanding of data modelling to describe the data landscape, entities and relationships. Strong communication and teamwork more »
SR3, New Silksworth, Sunderland, Tyne & Wear, United Kingdom Hybrid / WFH Options
Avanti Recruitment
in Azure services: SQL, Data Factory, Databricks, Synapse Analytics Strong SQL skills, including query optimization and database design Proven track record in data warehousing, ETL processes, and data modelling Azure certifications in Database Administration or Data Engineering Nice to have: Experience with Python/PySpark and MySQL on Azure Additional more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
Asset Resourcing
data platforms using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETLand data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data more »
Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £60,000 - £65,000 To more »
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £60,000 - £65,000 This more »
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
Data Platform experience Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will more »
execution and data quality checks for the migrations you conduct. Key Skills: SQL Migration (On-prem to Cloud/On-prem to On-prem) ETL (Databricks, Data Factory, SSIS) Azure Communication Stakeholder management If the above sounds suitable then please apply! *Please note that we do not offer sponsorship, so more »
Newcastle upon Tyne, Tyne & Wear Hybrid / WFH Options
DWP
love you to join us. What skills, knowledge and experience will you need? Experience of developing, testing, maintaining, deploying and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Senitor Associates Limited
conversion processes and tools Skills Strong proficiency in data conversion tools and techniques Ability to analyse, manipulate andtransform large data sets Experience with ETL (Extract, Transform, Load) processes Knowledge of data integration and migration best practices Attention to detail and ability to ensure data accuracy and completeness Excellent problem more »
data across systems, enabling real-time insights and data-driven decision-making. Key Responsibilities : Design, build, and maintain scalable data pipelines. Develop and optimize ETL processes to ensure data is clean, accurate, and available for analysis. Collaborate with cross-functional teams to integrate data from multiple sources. Implement data security … manage data solutions. Required Skills & Experience : Proven experience as a Data Engineer or in a similar role. Strong proficiency in SQL and experience with ETL frameworks. Experience with big data tools such as Hadoop, Spark, Kafka, etc. Proficiency in programming languages such as Python or Java. Experience with cloud platforms more »
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Data Careers Ltd
analytical and problem-solving skills with the ability to resolve complex technical issues. Technical Requirements: Familiarity with integration tools and technologies (e.g., API gateways , ETL tools ). Knowledge of programming languages such as Java , Python , and cloud platforms. Experience in architect/designer roles, particularly in banking or payment systems more »
opportunity for an individual who is passionate about data engineering and keen to work with modern cloud solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using Azure services, with a focus on Azure Synapse Analytics and Azure Data Factory . Develop and optimize ETL processes leveraging Notebooks to ensure … . Strong hands-on experience with Azure Synapse Analytics and Azure Data Factory for data integration, transformation, and orchestration. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development . Familiarity with integrating Oracle data sources within Azure environments. Basic more »
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
cutting-edge Azure Data Platform - working across the end-to-end data lifecycle from architecting data ingestion solutions into their Data Lake, designing robust ETL solutions to integrate various data sources, designing data models for analytics capabilities, through to deploying Logic Apps and Function apps for process automation. As a … be better time to join the team. Requirements Prior experience leading and managing Data Engineering teams Strong SQL and data modelling experience Experience designing ETL processes Strong understanding of Data Warehousing principles Experience with some Azure technologies such as: Azure Databricks, Azure Data Lake, Azure Data Factory, Azure Logic Apps more »
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
cutting-edge Azure Data Platform - working across the end-to-end data lifecycle from architecting data ingestion solutions into their Data Lake, designing robust ETL solutions to integrate various data sources, designing data models for analytics capabilities, through to deploying Logic Apps and Function apps for process automation. As a … be better time to join the team. Requirements Prior experience leading and managing Data Engineering teams Strong SQL and data modelling experience Experience designing ETL processes Strong understanding of Data Warehousing principles Experience with some Azure technologies such as: Azure Databricks, Azure Data Lake, Azure Data Factory, Azure Logic Apps more »
evaluate if this is the right job for you. Essentials: You will have a comprehensive understanding of data warehousing and data transformation (extract, transformandload) processes and the supporting technologies You will have extensive experience of developing progressive information management solutions and end-to-end development life-cycle support more »