build and maintain batch or real-time data pipelines in production, re-engineering manual flows and optimising code to ensure processes perform optimally. • Develop ETL (extract, transform, load) processes to help extractand manipulate data from multiple sources. • Write ETL/ELT scripts and code to ensure the ETL/… optimally (T-SQL stored procedures, Azure ADF/Synapse Pipelines, Azure Databricks/Synapse Notebooks) • Automate data workflows such as data ingestion, aggregation, andETL/ELT processing. • Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems • Recognise opportunities to reuse existing data flows more »
Working knowledge of database management, big data solutions, or data analytics in a cloud environment. •Strong understanding of data integration techniques, data pipelines, andETL/ELT processes within Microsoft Fabric's ecosystem. EXPERIENCE •Proven experience in Business Intelligence and data analytics, particularly in a Microsoft Fabric environment. •Hands-on more »
to deliver impactful data products for our retail chain Key responsibilities: ETL Pipeline Development : Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, andload data from various sources, ensuring high data quality. Monitor and troubleshoot production data pipelines , ensuring their performance and reliability. Mentor junior engineers and lead … such as AWS/Azure and DBT with Snowflake to build and maintain scalable data solutions. Your Profile Key skills/knowledge/experience: ETL/ELT & Data Pipelines: Solid understanding of ETL/ELT processes, along with hands-on experience building and maintaining data pipelines using DBT, Snowflake, Python more »
Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Azure SQL. Proficiency in SQL , Python , or Scala for data processing. Experience with ETL/ELT design patterns and building scalable, distributed data architectures. Deep understanding of data modelling , data warehousing , and data integration best practices. Knowledge of Azure more »
Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of the BI team you will more »
ERP, with experience of working from D365 being beneficial for our project work. Experience of data lineage testing to ensure data quality throughout the ETL process and can check their work as they develop. Strong collaborative mindset with a willingness to work across various teams. Passion for continuous learning andmore »
flows (Desirable) Will be an effective communicator and able to work with stakeholders cross-functionally Knowledge of cloud computing platforms, in particular Azure Databricks, ETLand ELT processes, as well as experience with big data technologies and frameworks a plus more »
Chelmsford, England, United Kingdom Hybrid / WFH Options
Senitor Associates
strong data modelling experience (star schema/Kimball), SQL and Python experience Have a proven track record in data modelling, building out data infrastructure andETL pipelines Strong data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory … semantic data models using Azure Synapse Analytics/Fabric, Spark notebooks. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure notebooks to extract, transform, andload (ETL/ELT) data from raw formats (e.g. Delta, Parquet, CSV) stored in ADLS Gen2. Implement data transformation pipelines and workflows in more »
including defining scope, managing timelines, and ensuring successful delivery within budget. ETL Pipeline Development : Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, andload data from various sources, ensuring high data quality. Cloud Infrastructure and Data Integration : Lead the implementation of data solutions on cloud platforms such as … program level, using influence and adaptive communication strategies Your Profile Key skills/knowledge/experience: Advanced Data Engineering Skills : Proficiency in designing and managing ETL processes using DBT, Python, Terraform and Airflow Expertise in Cloud Platforms: In-depth knowledge of Snowflake and Azure with experience in leveraging these platforms more »
Services : Data Factory, Data Lake, Synapse Analytics, Databricks, etc. Strong proficiency in building and managing Power BI dashboards and reports. Expertise in SQL andETL processes. Solid understanding of data warehousing , data modeling , and data integration . Problem-solving mindset with a passion for optimizing data processes. Excellent communication skills more »
Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
Durham, County Durham, United Kingdom Hybrid / WFH Options
Nigel Frank International
development and maintenance of their Azure Data Warehouse, and lead on the ongoing migration of newly acquired data sources. This will involve designing effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well more »
state-of-the-art data platform to support the data needs of our rapidly growing company Design and implement scalable and efficient data pipelines, ETL processes, and data integration solutions to collect, process, and store large volumes of data within AWS Implement data transformation logic to cleanse, validate, and enrich more »
Chelmsford, Essex, United Kingdom Hybrid / WFH Options
Senitor Associates Ltd
strong data modelling experience (star schema/Kimball), SQL and Python experience Have a proven track record in data modelling, building out data infrastructure andETL pipelines Strong data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory … semantic data models using Azure Synapse Analytics/Fabric, Spark notebooks. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure notebooks to extract, transform, andload (ETL/ELT) data from raw formats (e.g. Delta, Parquet, CSV) stored in ADLS Gen2. Implement data transformation pipelines and workflows in more »
encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, andETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power Apps, GitHub, MS Teams, etc. In-depth knowledge & experience more »
ultimately deliver data solutions including integrations, data transformations, warehousing and business intelligence reporting. The design and implementation of data ETL pipelines to extract, transformandload data from client and third-party data sources. Implementing and enforcing data governance policies and processes to ensure data is of the highest quality. … PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power BI) Strong programming skills, ideally in Python. Understanding of ETL pipeline development for data source integrations and data transformations. Understanding of data modelling to describe the data landscape, entities and relationships. Strong communication and teamwork more »
compliance with healthcare data regulations and security standards (GDPR, HIPAA). Technical Skills Required Strong proficiency in SQL, Python, and data modelling. Experience with ETL tools and cloud-based platforms (AWS, Google Cloud, or Azure). Familiarity with healthcare data formats (HL7, FHIR) and large-scale databases (e.g., PostgreSQL, NoSQL more »
Data Engineer - SAS/SQL/ETL * Unfortunately Sponsorship is not available with this position * Role – Data Engineer (SAS) Salary – Up to £65k DOE Location – Manchester or London (Hybrid) A well established and award-winning Data consultancy are looking to add a Data Engineer skilled in SAS to join their more »
SR3, New Silksworth, Sunderland, Tyne & Wear, United Kingdom Hybrid / WFH Options
Avanti Recruitment
in Azure services: SQL, Data Factory, Databricks, Synapse Analytics Strong SQL skills, including query optimization and database design Proven track record in data warehousing, ETL processes, and data modelling Azure certifications in Database Administration or Data Engineering Nice to have: Experience with Python/PySpark and MySQL on Azure Additional more »
requirements for BI solutions. · Transform complex data into actionable insights, implementing best practices for data visualization and analytics. · Develop ETL processes to extract, transform, andload data from various sources into the data warehouse. · Work closely with data engineers to optimize data extraction, transformation, and loading processes. · Develop and maintain … years of experience in developing BI solutions, with expertise in Power BI and Azure services. · Strong understanding of data warehousing concepts, including data modelling, ETL/ELT processes, and dimensional modelling. · Experience in developing and maintaining data warehouses on the Azure platform, using technologies such as Azure SQL Data Warehouse … development. · A strong understanding of DAX functions and expressions to derive valuable insights. · Proficiency in Power Query is essential for data extraction, transformation, and loading (ETL) operations. Power Query allows developers to connect to various data sources, perform data cleansing, and shape the data for reporting purposes. · Strong SQL skills more »
delivery • Proactive in nature, personal drive, enthusiasm, willingness to learn • Excellent communications skills including stakeholder management Have experience in one of the following technologies: • ETL toolset (Talend, Pentaho, SAS DI, Informatica etc) • Database (Client, RDS, Redshift, MySQL, Hadoop, Postgres, etc) • Job Scheduling toolset (Job Scheduler, TWS, etc) • Programming and scripting more »
in a similar business analyst role within a scaling up company. · Familiarity with machine learning and statistical modelling techniques. · Knowledge of data warehousing andETL processes. Reasons to join our fabulous team…. · Opportunity to work in a dynamic and innovative environment at the forefront of data-driven solutions. · Collaborative more »
City of London, London, United Kingdom Hybrid / WFH Options
Asset Resourcing
data platforms using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETLand data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
Asset Resourcing
data platforms using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETLand data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data more »