1 to 25 of 284 Permanent ETL Jobs in the UK excluding London

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

considerations and enterprise data governance frameworks. As part of your duties, you will be responsible for: Design, build and maintain scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data ...

architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Experience with ...

architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Experience with ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation ...

troubleshooting skills for complex multi-system data issues. Strong understanding of data architecture concepts: Data lakes/lakehouse/warehouse, dimensional modeling, ELT/ETL patterns Batch orchestration, dependency management, SCD handling, incremental loads Azure Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure ...

Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking) Knowledge of Databricks security: RBAC, IAM, encryption Excellent analytical ...

enterprise integration tools. A developed understanding of TOGAF or equivalent enterprise architecture frameworks. Hands-on experience in data warehousing, data lakes, data modelling, and ETL processes. Excellent stakeholder engagement skills with the ability to influence and inspire across all levels. A proactive, forward-thinking mindset with a passion for innovation ...

high‐quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well‐structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration ...

high-quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well-structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration ...

Youll Do Design, build, and maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage Collaborate with ...

into technical BI solutions. Strong analytical thinking and problem-solving skills. Desirable Skills Experience working with data warehouses or data lake architectures. Knowledge of ETL processes and data integration. Experience with Azure data services or cloud-based BI platforms. Understanding of data governance and best practices in data management. ...

fundamentals in data engineering and proven experience delivering solutions within complex environments. Essential Skills and Experience: Strong SQL and data modelling skills Experience with ETL/ELT tools such as Informatica, Talend, Pentaho, AWS Glue, or similar Familiarity with data platforms such as Oracle, Cloudera, or enterprise data warehouses Proficiency ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

end. * Strong background in Lakehouse Architecture, including structured and unstructured data. * Expertise in Spark, PySpark, Delta Lake, and Databricks workflows. * Experience building scalable ETL/ELT pipelines, including Delta Live Tables. * Strong programming skills in Python, Scala, or SQL. * Solid understanding of data modelling (3NF, Kimball, Data Vault). * Experience ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

data architecture practice, ideally within complex organisations. Demonstrable technical expertise spanning: Cloud data platforms and ecosystems: e.g. Microsoft Azure, AWS Data engineering and integration: ETL/ELT, Orchestration, Batch and streaming architectures, event driven and messaging platforms, API-first design, Integration frameworks. Database & storage technologies: SQL Server, Oracle, NoSQL, Analytical ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...