batch data that they work with, the team also have a clear business opportunity to work on real-time/streaming projects. Responsibilities Manage ETL, build pipelines, and scale data infrastructure to support data science and analytics initiatives. Design, implement and improve tools and services for orchestration, observability, data governance More ❯
Telford, Shropshire, West Midlands, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
experienced data engineer with a strong technical foundation and the ability to collaborate effectively in agile, cross-functional teams. Essential experience includes: Proficiency with ETL platforms such as SSIS, AWS, or Azure Data Factory Experience configuring/administering AWS or Azure data platforms and analytics services like Power BI or More ❯
Kafka, dbt, etc.). Proven track record of leading and managing data engineering teams in a consultancy or similar environment. Strong expertise in building ETL/ELT processes and data pipelines across various data sources. Excellent problem-solving skills and the ability to think strategically and execute tactically. Familiarity with More ❯
Kafka, dbt, etc.). Proven track record of leading and managing data engineering teams in a consultancy or similar environment. Strong expertise in building ETL/ELT processes and data pipelines across various data sources. Excellent problem-solving skills and the ability to think strategically and execute tactically. Familiarity with More ❯
based data systems (e.g., Redshift, BigQuery, Snowflake) Strong coding skills in languages commonly used for data work (e.g., Python, Java, Scala) Deep understanding of ETL/ELT tools and workflow orchestration platforms (e.g., Airflow, Fivetran, dbt) Proficiency with SQL and solid grounding in data modeling concepts Familiarity with cloud services More ❯
based data systems (e.g., Redshift, BigQuery, Snowflake) Strong coding skills in languages commonly used for data work (e.g., Python, Java, Scala) Deep understanding of ETL/ELT tools and workflow orchestration platforms (e.g., Airflow, Fivetran, dbt) Proficiency with SQL and solid grounding in data modeling concepts Familiarity with cloud services More ❯
for data platforms built on Microsoft Fabric. * Leading QA efforts across agile delivery squads. * Developing automated tests for: - PySpark notebooks in Fabric or Databricks - ETL pipelines and transformation logic - Delta tables and multi-layered Lakehouse architectures * Embedding testing into CI/CD flows using Azure DevOps or GitHub Actions. * Creating More ❯
AWS (Glue, Lambda, Step Functions, S3, Redshift, etc.) Operationalize machine learning models in production environments using SageMaker or custom deployment frameworks Automate and optimize ETL/ELT processes for structured and unstructured data Integrate CI/CD and MLOps best practices for rapid model iteration and deployment Collaborate across teams More ❯
work closely with technical and non-technical teams. Desired Skills Python expertise, especially with data libraries like Pandas, NumPy, and Scikit-learn. Familiarity with ETL tools and data pipeline orchestration. Exposure to data science tools like SAS or Posit. Experience in performance-critical environments, particularly with large-scale data platforms. More ❯
Telford, Shropshire, West Midlands, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
work closely with technical and non-technical teams. Desired Skills Python expertise, especially with data libraries like Pandas, NumPy, and Scikit-learn. Familiarity with ETL tools and data pipeline orchestration. Exposure to data science tools like SAS or Posit. Experience in performance-critical environments, particularly with large-scale data platforms. More ❯
newport, midlands, united kingdom Hybrid / WFH Options
Resourcing Group
work closely with technical and non-technical teams. Desired Skills Python expertise, especially with data libraries like Pandas, NumPy, and Scikit-learn. Familiarity with ETL tools and data pipeline orchestration. Exposure to data science tools like SAS or Posit. Experience in performance-critical environments, particularly with large-scale data platforms. More ❯
belfast, antrim, United Kingdom Hybrid / WFH Options
Adepta Partners
for the client with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools, cloud technologies and approaches and while More ❯
reliable data systems and optimising data workflows. Accountabilities: Design, develop, and maintain scalable and secure data pipelines Implement best practices for data integration andETL/ELT Collaborate with data analysts and scientists to meet their data needs Optimise the performance and reliability of data systems Lead technical projects related More ❯
Winchester, Hampshire, United Kingdom Hybrid / WFH Options
Arqiva
reliable data systems and optimising data workflows. Accountabilities: Design, develop, and maintain scalable and secure data pipelines Implement best practices for data integration andETL/ELT Collaborate with data analysts and scientists to meet their data needs Optimise the performance and reliability of data systems Lead technical projects related More ❯
of data architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency in SQL , Python , and modern data pipeline design (ETL/ELT). Experience with both batch and streaming data processing architectures. Strong communication and stakeholder engagement skills, particularly with business users in financial services. More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Intellect Group
of data architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency in SQL , Python , and modern data pipeline design (ETL/ELT). Experience with both batch and streaming data processing architectures. Strong communication and stakeholder engagement skills, particularly with business users in financial services. More ❯
well as working familiarity with a variety of databases Working knowledge of one or more of the cloud platforms (AWS, Azure, GCP) Experience building ETL/ELT pipelines specifically using DBT for structured and semi-structured datasets Any orchestration toolings such as Airflow, Dagster, Azure Data Factory, Fivetran etc It More ❯
well as working familiarity with a variety of databases Working knowledge of one or more of the cloud platforms (AWS, Azure, GCP) Experience building ETL/ELT pipelines specifically using DBT for structured and semi-structured datasets Any orchestration toolings such as Airflow, Dagster, Azure Data Factory, Fivetran etc It More ❯
scientists to deliver integrated data solutions Development & Integration: Design and develop complex SQL queries, stored procedures, and views in Snowflake Build and manage robust ETL/ELT pipelines using tools like Azure Data Factory Integrate Snowflake with cloud platforms (Azure, GCP) and other systems via APIs and connectors Work with More ❯
and Finance Operations Volume Forecast Models. Owning the design, operations, and improvements for the Organization's Data Warehouse infrastructure. Maintain, improve, and manage all ETL pipelines and clusters. Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency. Define metrics and KPIs to measure the success More ❯
in AWS and/or Azure. Knowledge of PostgreSQL and Database Design Principles. Exposure to JavaScript frameworks, preferably React. Experience in designing and maintaining ETL processes. Solid understanding of Software Development Best Practices such as CI/CD. Experience working with software products focused on analytics. Bachelor's Degree (or More ❯
and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development More ❯
and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Parser
and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development More ❯
system knowledge. Troubleshoot data warehouse and integration issues and implement enhancements for improved performance and reliability. Contribute to the design, development, and maintenance of ETL pipelines and reporting systems. Requirements: Microsoft SQL Server Database deployed on-premise and in the cloud. Always On replication to a secondary DR host. Ability More ❯