open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Power BI, Azure Cloud Services (including PowerShell, Functions, Devops, and CI/CD Pipelines) Significant experience in Azure SQL Development and Data engineering, managing ETLand ELT pipelines Ability to work in a small dynamic team working across the data and analytics space University degree in a STEM subject HOW more »
data pipelines for data ingestion, processing, and transformation in Azure. Utilise Azure Data Factory, Azure Databricks and SAP Business Objects to create and maintain ETL operations. Deliver dashboard reporting and data sets which are interactive and user-friendly via PowerBI Identifying and integrating external data into the business data model more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
Manchester Area, United Kingdom Hybrid / WFH Options
Forsyth Barnes
reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. Proficient in data modeling and data warehousing. Multiple years of more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Forsyth Barnes
within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. l Proficient in data modeling and data warehousing. l Multiple more »
the different data architecture patterns: Data Fabric, Data Mesh, Data Warehouse, Data Marts, data modeling, ontologies & knowledge graphs, MicroServices • You have experience in implementing ETL data flows and data pipelines, and know one or more of the following tools: Informatica PowerCenter, SAS Data Integration Studio, Microsoft SSIS, Ab Initio, etc. more »
Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience on Data Related Projects * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Reed Technology
of the below: - Cloud technology (Azure or AWS) - this organisation are migrating to cloud soon, so any experience here would be great - Data engineering (ETL) - designing and developing processes, both on-premise and maybe even cloud - Exposure to BI Tooling - Power BI would be great, however other tool are considered more »
Azure. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Strong SQL and Python skills. Experience with data modeling, ETL processes, and data warehousing. Knowledge of big data technologies such as Spark and Hadoop is a plus. Excellent problem-solving skills and attention to detail. more »
London, England, United Kingdom Hybrid / WFH Options
Aventum Group
responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, andmore »
Engineer at Open Power. The engineer will be responsible for the development of the data infrastructure of our product. They will design and implement ETL/ELT pipelines that draw heterogenous data from multiple different sources, at different time scales and with different characteristics, in order to process, store and … product managers, and will play an important part in defining the direction of development at a strategic level. Qualifications Data Engineering, Data Modeling, andETL (ExtractTransformLoad) skills Data Warehousing and Data Analytics skills Experience with REST and Data APIs Database management systems (PostgreSQL, in particular) Facility with Linux more »
Lancashire, North West, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
with key stakeholders across the business to understand how data can be used to improve business performance - Develop and create the data sets, repositories, extract/transform/load routines and validation mechanisms - Establish the integration with all databases and software systems - currently in place is Netsuite as the ERP more »
levers, and lead metrics for performance improvement. Develop and create the data sets needed for BI and analytics including, where needed, the data repositories, Extract/Transform/Load routines and validation mechanisms needed to underpin reporting and analysis. Establish the integration with other databases and systems in conjunction with more »
and communicate how our data inputs and outputs affect different groups and identify areas Janes can provide additional value. Requirements Experience architecting and developing ETL pipelines solutions for the ingestion, transformation, and serving of data, as well as solutions for the orchestration of pipeline components (e.g. AWS Step Functions, Apache more »
platform in AWS. Utilise Agile methodologies to manage the development lifecycle. Design and implement data pipelines, ensuring data quality and integrity. Requirements: Proficiency in ETL tools such as SQL, SSIS, AWS, Lambda, and Python. Strong understanding of data warehouse concepts. Excellent problem-solving and communication skills. Benefits: Competitive salary andmore »
Birmingham, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Clearwater People Solutions
Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ELT processes Please apply as directed more »
London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines andETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data more »
systems. Promote best practices and principles of data quality throughout the organisation. Required Skills and Experience: Advanced proficiency in MS SQL Extensive experience with ETL techniques, data warehouse design, and data visualisation Command of Microsoft tools such as Fabric, Data Factory, and Power BI Excellent communication, presentation, and stakeholder management more »
Skills: Proficiency in front-end visualisation tools (PowerBI, Tableau, Qlik Sense) Strong skills in data storytelling and dashboard creation Understanding of backend data processes (ETL, data integration) Familiarity with SQL and data querying Experience with cloud platforms (AWS, Azure, Google Cloud) Additional Skills: Excellent communication and stakeholder management skills Ability more »
pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory Working knowledge of agile development, CI/CD, test and data automation Working knowledge or experience of more »
. Knowledge of SQL and experience with relational databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. more »
Manchester Area, United Kingdom Hybrid / WFH Options
MBN Solutions
part of a large-scale project to develop a new Data Warehouse. Responsibilities include: Being an SME in designing & building the Data Warehouse Customising ETL procedures, data mappings, and transformations to coordinate data integration Documenting solutions, tools and processes Implementing validation procedures to ensure high quality of data Collaboration with more »
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
Exeter, Devon, South West, United Kingdom Hybrid / WFH Options
Bowerford Associates
to 5 years minimum experience working as a Data Engineer, utilising the following technologies, languages, tools and methodologies: - Databricks Python TSQL/T-SQL ETL Test Automation Unit Testing/Mocking Refactoring Agile/Scrum Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell more »