1 to 25 of 381 ETL Jobs in the UK excluding London

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

roadmap, ensuring alignment with cutting-edge engineering practices. Develop secure and observable ingestion and transformation pipelines. Pipeline Development & Operations: Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory (ADF), and event-driven frameworks. Build and maintain high-performance SQL transformations, curated ...

considerations and enterprise data governance frameworks. As part of your duties, you will be responsible for: Design, build and maintain scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data ...

architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Experience with ...

architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Experience with ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation ...

troubleshooting skills for complex multi-system data issues. Strong understanding of data architecture concepts: Data lakes/lakehouse/warehouse, dimensional modeling, ELT/ETL patterns Batch orchestration, dependency management, SCD handling, incremental loads Azure Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking) Knowledge of Databricks security: RBAC, IAM, encryption Excellent analytical ...

enterprise integration tools. A developed understanding of TOGAF or equivalent enterprise architecture frameworks. Hands-on experience in data warehousing, data lakes, data modelling, and ETL processes. Excellent stakeholder engagement skills with the ability to influence and inspire across all levels. A proactive, forward-thinking mindset with a passion for innovation ...

high‐quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well‐structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration ...

high-quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well-structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration ...

Youll Do Design, build, and maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage Collaborate with ...

platforms, and modern data pipeline development. Key Responsibilities Design and architect data solutions using Snowflake Optimise workflows and integrations using Openflow Develop and maintain ETL and ELT pipelines from Salesforce, relational databases, files, and NoSQL sources Implement dimensional modelling to support data warehousing and BI reporting Build and optimise data ...

into technical BI solutions. Strong analytical thinking and problem-solving skills. Desirable Skills Experience working with data warehouses or data lake architectures. Knowledge of ETL processes and data integration. Experience with Azure data services or cloud-based BI platforms. Understanding of data governance and best practices in data management. ...

fundamentals in data engineering and proven experience delivering solutions within complex environments. Essential Skills and Experience: Strong SQL and data modelling skills Experience with ETL/ELT tools such as Informatica, Talend, Pentaho, AWS Glue, or similar Familiarity with data platforms such as Oracle, Cloudera, or enterprise data warehouses Proficiency ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

services organisation Your new role Seeking a Data Engineer to help design and maintain scalable batch and near-real-time ingestion pipelines, modernizing legacy ETL/ELT processes into Azure and Snowflake, and implementing best-practice patterns such as CDC, incremental loading, schema evolution, and automated ingestion frameworks. They build ...

regression, classification, NLP, forecasting, clustering) 2. Data & Analytics Engineering Alignment Work closely with data engineers to define: Data models and schemas Data quality rules ETL/ELT pipelines Define feature stores, training datasets, and inference pipelines 3. Model Development & Deployment Strategy Guide data scientists on: Model selection and evaluation strategies ...