Bristol, Avon, South West, United Kingdom Hybrid / WFH Options
Hays
and will make all the organisation's data accessible to be used in support of relevant aspects of the organisation. Key responsibilities: Working to Extract, TransformandLoad (ETL) data sets from a variety of data sources across the enterprise technology stack. Monitoring the execution of data workflows, including identifying … how data is used by Analysts, Data Scientists and in Business Intelligence tools (Power BI, Tableau) Experience using Cloud services (primarily Azure) Experience using ETL tools (SSIS, Data Factory) Experience using APIs to send and receive data. Good knowledge of code management principles and experience using source Control Management tools more »
Salford, Greater Manchester, North West, United Kingdom Hybrid / WFH Options
Aj Bell Limited
data solutions (including Snowflake and AWS Aurora). Work with Data Ingestion Specialist and Enterprise Architecture teams to develop implement robust data pipelines andETL processes to streamline data ingestion and transformation. Support Manager and HoD with delivery of D2C data roadmap and embedding a data-driven mindset in the more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
RDS (SQL Server) toolsets. Experience with transactional reporting solutions for critical business reporting. Experience with dimensionally modelled databases for analytics use cases. Knowledge of ETL tools and approaches. Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS. Experience with Python for scripting and automating data tasks. more »
RDS (SQL Server) toolsets. Experience with transactional reporting solutions for critical business reporting. Experience with dimensionally modelled databases for analytics use cases. Knowledge of ETL tools and approaches. Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS. Experience with Python for scripting and automating data tasks. more »
London, England, United Kingdom Hybrid / WFH Options
Morgan McKinley
across teams and unlocking the full potential of data within the organisation. Responsibilities Maintain and optimise available data warehouse infrastructure Design, implement and document ETL procedures for intake of new data from relevant sources employing industry standards and best practices; as well as ensure data is verified and quality checked more »
such as Docker and orchestration tools like Kubernetes for containerized deployments. with workflow management tools such as Airflow for orchestrating complex data pipelines andETL processes. certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem. Rewards & Benefits TCS is consistently voted a more »
london, south east england, United Kingdom Hybrid / WFH Options
Tata Consultancy Services
such as Docker and orchestration tools like Kubernetes for containerized deployments. with workflow management tools such as Airflow for orchestrating complex data pipelines andETL processes. certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem. Rewards & Benefits TCS is consistently voted a more »
development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services more »
South East London, London, United Kingdom Hybrid / WFH Options
Aj Bell Limited
and Snowflake. Support Senior BI developer by overseeing the collection and integration of data from internal and external sources. Implement robust data pipelines andETL processes to streamline data ingestion and transformation. Competence, Knowledge & Skills: Proven experience in a data management or analytics role within the financial services industry Proven more »
Sunderland, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
SCS Sofas
Azure DevOps, Visual Studio, Tabular Editor Understanding of Microsoft Dynamics, Business Central would be beneficial Solid understanding and experience of database management systems andETL Framework Experience in leading/motivating teams to deliver meaningful change and drive their professional development. Experience managing and building relationships with internal and external more »
Sunderland, England, United Kingdom Hybrid / WFH Options
ScS - Sofa Carpet Specialist
Azure DevOps, Visual Studio, Tabular Editor Understanding of Microsoft Dynamics, Business Central would be beneficial Solid understanding and experience of database management systems andETL Framework Experience in leading/motivating teams to deliver meaningful change and drive their professional development. Experience managing and building relationships with internal and external more »
Greater London, England, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
london, south east england, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
bristol, south west england, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
manchester, north west england, United Kingdom Hybrid / WFH Options
Forsyth Barnes
reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. Proficient in data modeling and data warehousing. Multiple years of more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Forsyth Barnes
within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. l Proficient in data modeling and data warehousing. l Multiple more »
Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience on Data Related Projects * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit more »
London, England, United Kingdom Hybrid / WFH Options
Aventum Group
responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, andmore »
Lancashire, North West, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
with key stakeholders across the business to understand how data can be used to improve business performance - Develop and create the data sets, repositories, extract/transform/load routines and validation mechanisms - Establish the integration with all databases and software systems - currently in place is Netsuite as the ERP more »
Birmingham, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Clearwater People Solutions
Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ELT processes Please apply as directed more »
manchester, north west england, United Kingdom Hybrid / WFH Options
MBN Solutions
part of a large-scale project to develop a new Data Warehouse. Responsibilities include: Being an SME in designing & building the Data Warehouse Customising ETL procedures, data mappings, and transformations to coordinate data integration Documenting solutions, tools and processes Implementing validation procedures to ensure high quality of data Collaboration with more »
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
to 5 years minimum experience working as a Data Engineer, utilising the following technologies, languages, tools and methodologies: - Databricks Python TSQL/T-SQL ETL Test Automation Unit Testing/Mocking Refactoring Agile/Scrum Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell more »