or data lakes Data-modelling techniques (Relational, 3NF and dimensional modelling, Kimball, DV 2.0 etc.) Strong experience in building robust and scalable ELT/ETL data pipelines Proficient coding in - python, Apache Spark and expert knowledge of SQL and good experience with shell-scripting languages Working knowledge of orchestration tools … e.g. Apache Airflow Experience of ETL/ELT tooling – for example Pentaho, AWS Glue, DBT, airflow etc. GIT and experience in building CI/CD pipelines DBA Experience in AWS cloud environment managing AWS Aurora, and Amazon RDS (MySQL, Postgres, MSSQL) Desired: Experience of financial services or consumer finance IaaC more »
Burton-On-Trent, Staffordshire, Burton upon Trent, United Kingdom
Michael Page
company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising the performance of the strategic data platform … Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience. Microsoft DevOps source control software and development lifecycle software Developing and maintaining objects within Data Warehouses/Lakehouses. Experience … Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience. Microsoft DevOps source control software and development lifecycle software Developing and maintaining objects within Data Warehouses/Lakehouses. Experience more »
efficient data ingestion, processing, storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific … applications. ● Lead end-to-end processes following the CRISP-DM process model to deliver high- quality datasets and their applications. ● Design and implement robust ETL/ELT pipelines from a variety of data sources, including RDBMS, texts, spreadsheets, and API endpoints, into the data warehouse. ● Utilise workflow management tools to … Azure DevOps and Data Factory is a plus. ● Experience with Docker and Kubernetes for creating portable and scalable environments is a plus. ● Experience with ETL tools like Pentaho Data Integration is a plus. Soft skills ● Analytical thinking with a keen attention to detail and a problem-solving mindset. ● Excellent communication more »
Leeds, West Yorkshire, Yorkshire and the Humber Hybrid / WFH Options
Lowell Group
source-to-target data mappings Re-engineer manual data flows to enable scaling and repeatable use Support the build of data streaming systems Write ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally Build accessible data for analysis What we need from you: Communicating between … scripts from agreed specifications SQL Server Management Studio/Visual Studio experience to design, code, correct and document moderate to complex programs, scripts andETL processes from agreed specifications Understanding of the core technical concepts related to the role and apply them with guidance. Testing experience A mission that gives more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
Keystream Group Limited
reporting Lead on data forums, working groups and steering groups as well as supporting the creation of Executive level reporting. Experience required: Data Integration - ETL design & development Data Engineering - Implementation of performant models within an AWS and Azure data warehouse environment Data Modelling - Conceptual, logical and physical data modelling Strong more »
pipelines Extensive experience of data mapping and data transformation Experience in building optimised data pipelines Experience of data mapping and data transformation Experience of ETL tools (Azure Data Factory highly desirable) Experience of commercial off the shelf database packages e.g. Microsoft SQL Server Experience of Microsoft Power Platform Working knowledge more »
SKILLS Proficiency in SQL and data querying validation and testing purposes. Hands on experience with Snowflake or Airflow or DBT. Familiarity with data integration, ETL processes, and data governance frameworks. Solid understanding of data structures, relational databases and data modelling concepts. Experience with CDP Customer Data Platform in a data more »
London, England, United Kingdom Hybrid / WFH Options
iO Associates - UK/EU
governance concepts, practices, and frameworks. Strong technical skills in data modelling, metadata management, and data lineage. Datawarehouse design and implementation Experience with SQL Server ETL processes A good knowledge of Power BI reporting Desirable Skills Nexthink Software SNOW Software JAMF Software Accreditations Microsoft Data Analyst Microsoft Data Engineer more »
the following: Strong commercial data engineering experience Solid coding background Must be proficient with GCP. Strong proficiency in Python and SQL. CI/CD, ETL, DBT THE BENEFITS Competitive Salary. Generous hybrid working options Discretionary Bonus HOW TO APPLY Please register your interest by sending your CV to luke.frost@xcede.com more »
database design, with experience in Python package being desirable for future developments Experience working across data engineering and BI solutions (including the build of ETL pipelines) Ability to think outside of the box, with commercial awareness of business requirements Experience of AWS and/or Azure would be really good more »
you will: Act as the go-to person for all things data and understanding client goals. Collect data from online and offline channels, build ETL data pipelines and data models, to report and advise on marketing effectiveness. Help formulate digital media strategies and refine channels through testing and development initiatives. more »
candidates with the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a more »
be involved with project migration and business-critical upgrades. You must have experience with Azure Data Factory – Google Cloud – Airflow, along with SQL andETL experience. This could be a great career move with personal development plans to grow your career. You will require a blend of the following: - Strong more »
Isleworth, England, United Kingdom Hybrid / WFH Options
WNTD
of data governance concepts and practices. Expertise in data modeling, metadata management, and data lineage. Strong background in data warehouse design and SQL Server ETL processes. Proficiency in Power BI for reporting. Desirable Skills: Experience with Nexthink, SNOW, and JAMF software. Accreditations: Microsoft Certified Data Analyst Microsoft Certified Data Engineer more »
is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines andETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. Collaborate with cross-functional teams to understand data more »
Southampton, Hampshire, South East, United Kingdom Hybrid / WFH Options
Spectrum IT Recruitment
Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. With a unique range of services more »
exposure to Terraform would be great Liaising with other areas across the business to help define requirements for new projects, including both pipeline andETL requests What’s on offer to you? 💰 £50-60k Bonus of up to 10% Flexible working (core hours) Private health 10% Pension Life Assurance more »
qualities 5+ years of experience in data engineering, with a passion for sports. Pro-level skills in Python and Bash scripting. Experience dribbling through ETL processes with tools like Prefect or Airflow. Goal-scoring knowledge of containerization and orchestration tools like Docker and Kubernetes. Captain of the cloud with expertise more »
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Leicester, Leicestershire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Leicester, Leicestershire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Derby, Derbyshire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Stoke-on-Trent, Staffordshire, United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »
Birmingham, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Nigel Frank International
join their team in Derbyshire. You will be joining their close-knit Business Intelligence team, with the primary focus of your role being developing ETL processes and SQL stored procedures to automate and optimise various systems and processes, and to look after their suite of SSRS reports. More generally, you more »