the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transformandload large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments More ❯
the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transformandload large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments More ❯
the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transformandload large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments More ❯
the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transformandload large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments More ❯
an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a small high-impact team but Jollyes is growing! Still small enough that you can launch a new product within days, but big enough to see the … your key responsibilities: Backend Development : Design, build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow … solving and wants to grow in a fast-paced retail environment. Share our values of being: Wise, Focused, Genuine, Eager, Together Proficient in SQL and Python with Experience with ETL workflows Experience with cloud-based data environments (AWS: S3, Lambda, ECS) Bachelor’s degree or equivalent qualification or equivalent experience in Data Science, Computer Science, Statistics, or a related field. More ❯
Belfast, City of Belfast, County Antrim, United Kingdom Hybrid / WFH Options
Aspire Personnel Ltd
defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. JOB DESCRIPTION Tech stack While the client … is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What More ❯
Bristol, Avon, England, United Kingdom Hybrid / WFH Options
Aspire Personnel Ltd
defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING … is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What More ❯
We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you … opportunity to join a team that invests in your growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using … solutions Create mapping documents, transformation rules, and ensure quality delivery Contribute to DevOps processes, CI/CD deployments, and agile delivery models Requirements 8+ years' experience in data engineering, ETL development and big data solutions Recent experience within Insurance Technology essential Solid expertise with Azure Databricks, Data Factory, ADLS, Synapse, and Azure SQL Strong skills in SQL, Python, and PySpark More ❯
We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you … opportunity to join a team that invests in your growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using … solutions Create mapping documents, transformation rules, and ensure quality delivery Contribute to DevOps processes, CI/CD deployments, and agile delivery models Requirements 8+ years' experience in data engineering, ETL development and big data solutions Recent experience within Insurance Technology essential Solid expertise with Azure Databricks, Data Factory, ADLS, Synapse, and Azure SQL Strong skills in SQL, Python, and PySpark More ❯
london (city of london), south east england, united kingdom
Calibre Candidates
We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing data engineering team, you … opportunity to join a team that invests in your growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using … solutions Create mapping documents, transformation rules, and ensure quality delivery Contribute to DevOps processes, CI/CD deployments, and agile delivery models Requirements 8+ years' experience in data engineering, ETL development and big data solutions Recent experience within Insurance Technology essential Solid expertise with Azure Databricks, Data Factory, ADLS, Synapse, and Azure SQL Strong skills in SQL, Python, and PySpark More ❯
hastings, south east england, united kingdom Hybrid / WFH Options
Stratospherec Limited
in their career and personal development whilst managing, maintaining, and evolving the company's data platform and data sinks to support future growth. • Designing, creating, managing, and maintaining required ETL/ELT processes. • Providing input throughout key projects and into a data strategy and road map to enable future growth as well as addressing legacy systems. • Maintaining knowledge of technology … standards-based point of view. • Demonstrable in-depth knowledge and experience of Microsoft Azure data tools, particularly Microsoft Fabric, with an emphasis on OneLake and Data Factory. • ELT/ETL experience (Data Transformation). • SQL Server database and solution design, structure, maintenance and best practises. The successful candidate will be able to demonstrate an extensive breadth and depth of T … SQL skills. Desirable Skills and Experience: • Database design, structure, maintenance and best practises • Tableau • Power BI • SSAS • SSIS • Other ETL tools, particularly Microsoft Azure data tools This exciting Lead/Senior Data Engineer opportunity is offering an exciting salary up to 70K plus an extensive benefits package. If this role looks to be of interest, please reach out as soon More ❯
and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking to support analytics and reporting. Modernise and manage databases , ensuring performance optimisation, governance standards, and … and cross-functional workshops to support platform migration and ongoing delivery. Experience: 6–10 years experience with SQL Server (including T-SQL and performance tuning). Proven background in ETL/ELT design (ideally using Azure Data Factory). Hands on experience with cloud-based data ingestion and transformation (preferably Azure). Familiarity with Azure Medallion architecture or similar layered More ❯
and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking to support analytics and reporting. Modernise and manage databases , ensuring performance optimisation, governance standards, and … and cross-functional workshops to support platform migration and ongoing delivery. Experience: 6–10 years experience with SQL Server (including T-SQL and performance tuning). Proven background in ETL/ELT design (ideally using Azure Data Factory). Hands on experience with cloud-based data ingestion and transformation (preferably Azure). Familiarity with Azure Medallion architecture or similar layered More ❯
london (city of london), south east england, united kingdom
COREcruitment Ltd
and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking to support analytics and reporting. Modernise and manage databases , ensuring performance optimisation, governance standards, and … and cross-functional workshops to support platform migration and ongoing delivery. Experience: 6–10 years experience with SQL Server (including T-SQL and performance tuning). Proven background in ETL/ELT design (ideally using Azure Data Factory). Hands on experience with cloud-based data ingestion and transformation (preferably Azure). Familiarity with Azure Medallion architecture or similar layered More ❯
dotnet and React. Leveraging the capabilities of LLMs in your daily work and in features we build Collaborate with data engineers to build, optimize, and maintain data pipelines andETL processes. Participate in cloud infrastructure design and deployment, ensuring best practices in cloud environments. Develop and integrate CI/CD workflows to enhance development processes and ensure system reliability. Contribute … have most of these, wed love to hear from you! Technical skills Python (Competent) React frontend development (Intermediate/Competent) Dotnet (Beginner) Cloud technologies (Beginner/Intermediate), ideally Azure ETL pipelines and data tools such as PySpark, Databricks CI/CD tools (Beginner/Intermediate), e.g., Azure DevOps Cross-functional skills Problem-solving mindset with strong analytical abilities Collaborative team More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote best practices in data modeling, ETL/ELT processes, data storage, and data governance across AWS and Snowflake platforms. Lead the design of data lakes, data warehouses, and real-time data pipelines using AWS-native tools … to: S3, Glue, Redshift, Lambda, Kinesis, Athena, Lake Formation. Strong hands-on experience with Snowflake - architecture, performance tuning, security, and data sharing features. Proficient in data modelling, data integration (ETL/ELT), and metadata management. Deep understanding of data governance, data security, and compliance in cloud environments. Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation) is a plus. Strong More ❯
Salesforce (CRM), NetSuite (ERP), and Cascade (HR) into an on-prem SQL data warehouse, delivering automated monthly reporting and daily Power BI snapshots. The role also involves advising on ETL tooling, process automation, and producing full documentation for internal handover. Key Deliverables Design and build an on-prem Finance Data Warehouse (SQL) integrating Salesforce, NetSuite & Cascade. Develop and optimise ETL … tooling and data orchestration best practices. Produce full technical documentation and user handover materials. Skills & Experience Proven experience designing SQL-based data models and warehouses . Strong SQL development , ETL/ELT , and performance tuning skills. Data integration expertise with Salesforce , NetSuite , and HR systems (API/ETL). Advanced Power BI (Power Query M, DAX) Proven experience designing SQL … based data models and warehouses Strong SQL development , ETL/ELT , and performance tuning skills. Understanding of SaaS metrics (ARR, MRR, churn, NRR, CAC, revenue recognition). Excellent documentation, communication, and stakeholder engagement skills. Outcomes (3 Months) Operational Finance Data Cube integrating all core data sources. Automated Power BI dashboards for executive reporting. Documented, repeatable integration and refresh processes . More ❯
dynamic team and help shape the future of their data strategy. 🔍 Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong … skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling andETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong stakeholder relationships to shape effective data solutions Design and implement data models andETLMore ❯
london (city of london), south east england, united kingdom
Primus
dynamic team and help shape the future of their data strategy. 🔍 Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong … skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling andETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong stakeholder relationships to shape effective data solutions Design and implement data models andETLMore ❯
dynamic team and help shape the future of their data strategy. 🔍 Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong … skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling andETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong stakeholder relationships to shape effective data solutions Design and implement data models andETLMore ❯
s and London Market—is essential. What You’ll Do Build and maintain advanced Power BI dashboards and visual reports Write and optimise complex SQL queries , stored procedures, andETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple … re Looking For Technical Skills Expertise in Power BI (DAX, Power Query) and building impactful dashboards Advanced SQL (T-SQL preferred) for managing and querying relational databases Experience with ETL tools (SSIS, Azure Data Factory, or similar) Strong data modelling skills (star/snowflake schema) Familiarity with Azure SQL, Synapse Analytics , or other cloud platforms is a plus Domain Knowledge More ❯
s and London Market—is essential. What You’ll Do Build and maintain advanced Power BI dashboards and visual reports Write and optimise complex SQL queries , stored procedures, andETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple … re Looking For Technical Skills Expertise in Power BI (DAX, Power Query) and building impactful dashboards Advanced SQL (T-SQL preferred) for managing and querying relational databases Experience with ETL tools (SSIS, Azure Data Factory, or similar) Strong data modelling skills (star/snowflake schema) Familiarity with Azure SQL, Synapse Analytics , or other cloud platforms is a plus Domain Knowledge More ❯
london (city of london), south east england, united kingdom
i3
s and London Market—is essential. What You’ll Do Build and maintain advanced Power BI dashboards and visual reports Write and optimise complex SQL queries , stored procedures, andETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple … re Looking For Technical Skills Expertise in Power BI (DAX, Power Query) and building impactful dashboards Advanced SQL (T-SQL preferred) for managing and querying relational databases Experience with ETL tools (SSIS, Azure Data Factory, or similar) Strong data modelling skills (star/snowflake schema) Familiarity with Azure SQL, Synapse Analytics , or other cloud platforms is a plus Domain Knowledge More ❯
business stakeholders, and technical teams to define transformation logic and ensure business alignment. Data Migration Execution Develop, configure, and execute migration scripts, ETL pipelines, or tools to extract, transform, andload data. Validate migration outputs against business and technical requirements. Identify, document, and resolve data quality and consistency issues. Data Quality & Governance Profile legacy datasets to detect anomalies, duplicates, andMore ❯
Exeter, Devon, South West, United Kingdom Hybrid / WFH Options
Bowerford Associates
processes. You will be leading the way with regards to transforming how data is managed, processed and delivered across our client's business. You will take ownership of complex ETL workflows, you will be developing automation tools, and you will ensure data is accurate, delivered in a timely fashion whilst making sure it is fit for purpose. Key Duties: - Lead … and maintain ETL processes, improving automation and data quality. Use tools like Power BI/Excel or similar to report on team metrics and performance. Support data integration and provisioning across products and services. Collaborate with internal teams and suppliers to resolve data issues and enhance workflows. Manage bespoke data requests and provide technical support to internal teams. Ensure metadata … experience in data analysis or data curation. Experience of Geospatial Data and/or Geodata is 100% required for this role. You will be confident in designing and optimizing ETL/ELT processes, ideally using tools such as FME Form and/or FME Flow . Experience of Data Governance Best Practices. Skilled with database technologies such as Oracle, SQL More ❯