and its tooling (Snowpark, Snowpipe, etc.). Familiarity with Fivetran, DBT, TensorFlow, PyTorch, and other modern data stack components. Knowledge of data integration andETL frameworks and tools. Understanding of DataOps, data mining, and data visualization/BI tools. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. more »
cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies such as Azure Data Factory. Implement and optimize data solutions using Kubernetes for container orchestration. Collaborate with more »
our data systems. Champion data quality principles and best practices throughout the organization. Required Skills and Experience: Advanced proficiency MS SQL Extensive experience with ETL/ELT techniques, data warehouse design, and data visualisation. Strong command of Microsoft tools such as Fabric, Azure Blob Storage, Data Factory, Purview, and Power more »
Sunderland, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
SCS Sofas
Azure DevOps, Visual Studio, Tabular Editor Understanding of Microsoft Dynamics, Business Central would be beneficial Solid understanding and experience of database management systems andETL Framework Experience in leading/motivating teams to deliver meaningful change and drive their professional development. Experience managing and building relationships with internal and external more »
various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »
encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, andETL processes. In-depth knowledge & experience using Visual Studio, with one of the programming languages C#/Java/JavaScript/Python, PowerShell, and Postman, SOAPUI more »
experience using Azure Stream Analytics, Azure Analysis Services, Data Lake Analytics, HDInsight, HDP, Spark, Databricks, design and configuration of data movement, streaming and transformation (ETL) technologies such as Azure Data Factory, HDF etc Leveraging knowledge related to Cloud Management Platforms, Virtualization Strategies, Automation and Orchestration Strategies, Public Cloud Platforms, Cloud more »
to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, andload data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »
Greater London, England, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
key role in transforming raw data into actionable insights that empower our business users to make data-driven decisions. Responsibilities: Utilise Power Query to extract, transform, andload (ETL) data for analysis in Power BI. Connect to various data sources, cleanse, andtransform data to ensure accuracy and consistency. Design more »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Power BI, Azure Cloud Services (including PowerShell, Functions, Devops, and CI/CD Pipelines) Significant experience in Azure SQL Development and Data engineering, managing ETLand ELT pipelines Ability to work in a small dynamic team working across the data and analytics space University degree in a STEM subject HOW more »
data pipelines for data ingestion, processing, and transformation in Azure. Utilise Azure Data Factory, Azure Databricks and SAP Business Objects to create and maintain ETL operations. Deliver dashboard reporting and data sets which are interactive and user-friendly via PowerBI Identifying and integrating external data into the business data model more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
Manchester Area, United Kingdom Hybrid / WFH Options
Forsyth Barnes
reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. Proficient in data modeling and data warehousing. Multiple years of more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Forsyth Barnes
within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. l Proficient in data modeling and data warehousing. l Multiple more »
the different data architecture patterns: Data Fabric, Data Mesh, Data Warehouse, Data Marts, data modeling, ontologies & knowledge graphs, MicroServices • You have experience in implementing ETL data flows and data pipelines, and know one or more of the following tools: Informatica PowerCenter, SAS Data Integration Studio, Microsoft SSIS, Ab Initio, etc. more »
Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience on Data Related Projects * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Reed Technology
of the below: - Cloud technology (Azure or AWS) - this organisation are migrating to cloud soon, so any experience here would be great - Data engineering (ETL) - designing and developing processes, both on-premise and maybe even cloud - Exposure to BI Tooling - Power BI would be great, however other tool are considered more »
Azure. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Strong SQL and Python skills. Experience with data modeling, ETL processes, and data warehousing. Knowledge of big data technologies such as Spark and Hadoop is a plus. Excellent problem-solving skills and attention to detail. more »
Studio, PowerDesigner). Strong understanding of relational databases (e.g., Oracle, SQL Server, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra), and data integration technologies (e.g., ETL tools, data virtualization, API integrations). Excellent analytical and problem-solving skills, with the ability to translate business requirements into technical solutions. Strong leadership andmore »
London, England, United Kingdom Hybrid / WFH Options
Aventum Group
responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, andmore »
Engineer at Open Power. The engineer will be responsible for the development of the data infrastructure of our product. They will design and implement ETL/ELT pipelines that draw heterogenous data from multiple different sources, at different time scales and with different characteristics, in order to process, store and … product managers, and will play an important part in defining the direction of development at a strategic level. Qualifications Data Engineering, Data Modeling, andETL (ExtractTransformLoad) skills Data Warehousing and Data Analytics skills Experience with REST and Data APIs Database management systems (PostgreSQL, in particular) Facility with Linux more »
Job Title: Power BI Developer Duration: 3 months Rate: £400 per day Location: Remote Skills: Power BI/Azure Cloud/ETL IR35 Determination: Outside IR35 We're … seeking a talented Power BI Developer to join us on a 3 month contract within our Azure environment, with a focus on Extract, Transform, Load (ETL) processes. Your primary responsibility will be to design, develop, and implement Power BI solutions to meet our reporting and analytical needs. You will collaborate … reports and dashboards within Azure environment, incorporating ETL processes. Collaborate with stakeholders to understand reporting requirements and translate them into actionable insights. Extract, transform, andload data from Azure data sources into Power BI for analysis, ensuring data accuracy and integrity. Optimize Power BI performance and troubleshoot any ETL-related more »
Lancashire, North West, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
with key stakeholders across the business to understand how data can be used to improve business performance - Develop and create the data sets, repositories, extract/transform/load routines and validation mechanisms - Establish the integration with all databases and software systems - currently in place is Netsuite as the ERP more »