1 to 25 of 533 ETL Jobs in the UK

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data modelling, and delivering analytics-ready datasets. Ability to implement approaches that improve delivery reliability: data quality checks, monitoring, and operational feedback ...

roadmap, ensuring alignment with cutting-edge engineering practices. Develop secure and observable ingestion and transformation pipelines. Pipeline Development & Operations: Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory (ADF), and event-driven frameworks. Build and maintain high-performance SQL transformations, curated ...

considerations and enterprise data governance frameworks. As part of your duties, you will be responsible for: Design, build and maintain scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data ...

into actionable insights, ensuring high data quality and scalable reporting solutions. Core Responsibilities Pipeline & Data Modeling: Design, build, and maintain scalable automated data pipelines (ETL/ELT) and data models that support complex analytical requirements. Strategic Visualization: Develop sophisticated dashboards and reporting tools that provide "at-a-glance" insights ...

Factory and Databricks Experience building dashboards and reports using Power BI or Tableau Solid understanding of data modelling and data structures Experience working with ETL/ELT processes Proficiency in Python or R for data analysis Strong analytical and problem-solving skills Ability to work with stakeholders and translate business ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

high data quality and reliability across platforms. Must have worked in the telecommunications domain. Key Responsibilities Design, develop, and maintain robust data pipelines and ETL processes Build and optimise data models to support reporting and analytics requirements Develop and enhance dashboards and reports using Power BI Write efficient and scalable ...

troubleshooting skills for complex multi-system data issues. Strong understanding of data architecture concepts: Data lakes/lakehouse/warehouse, dimensional modeling, ELT/ETL patterns Batch orchestration, dependency management, SCD handling, incremental loads Azure Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure ...

high-quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well-structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration ...

expertise in Azure data technologies, including Data Factory, Databricks, and Synapse Analytics. Proficiency in SQL and other data query languages. Knowledge of data modelling, ETL processes, and data warehousing concepts. Experience in working with large datasets and ensuring data quality. Excellent problem-solving and analytical skills. A degree in Computer ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking) Knowledge of Databricks security: RBAC, IAM, encryption Excellent analytical ...

Data Lead in a modern cloud environment Strong hands-on experience with Azure Data Factory, Data Lakes and Data Warehousing Knowledge of Power BI, ETL processes and integrating enterprise data sources (SAP, Salesforce, production systems) Excellent communication skills - able to engage across departments and translate data requirements into solutions Competent ...

with Azure Data Factory and cloud-based data environments Strong SQL skills for querying, transformation and optimisation Experience building or supporting data pipelines and ETL processes Exposure to data modelling and data warehousing concepts Working knowledge of Power BI or similar BI tools Ability to engage with stakeholders and translate ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

Google Deployment Manager) and DevOps practices, and familiarity with networking, security and identity management for AI Use Cases.* Modern Data Patterns: Solid understanding of ETL/ELT processes and modern architecture patterns such as Data Mesh and Data Fabric.* Migration & Transformation: Experience migrating legacy systems to cloud-native data stores. ...

enterprise integration tools. A developed understanding of TOGAF or equivalent enterprise architecture frameworks. Hands-on experience in data warehousing, data lakes, data modelling, and ETL processes. Excellent stakeholder engagement skills with the ability to influence and inspire across all levels. A proactive, forward-thinking mindset with a passion for innovation ...

Youll Do Design, build, and maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage Collaborate with ...

cloud technologies. The Role • Designing and building robust data pipelines and architectures • Working with Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse) • Developing and optimising ETL processes • Ensuring data quality, reliability, and performance • Supporting data science and AI initiatives • Collaborating with cross-functional teams to deliver data solutions Essential skills • Strong ...

evolution of the data architecture within the Microsoft ecosystem. Key Requirements Strong hands-on experience with Azure Synapse (ESSENTIAL) Experience building and maintaining ETL/ELT pipelines Strong skills in reverse engineering data pipelines, schemas, and legacy processes Solid programming skills in PySpark, Python, and SQL Experience with Azure Data ...

into technical BI solutions. Strong analytical thinking and problem-solving skills. Desirable Skills Experience working with data warehouses or data lake architectures. Knowledge of ETL processes and data integration. Experience with Azure data services or cloud-based BI platforms. Understanding of data governance and best practices in data management. ...

fundamentals in data engineering and proven experience delivering solutions within complex environments. Essential Skills and Experience: Strong SQL and data modelling skills Experience with ETL/ELT tools such as Informatica, Talend, Pentaho, AWS Glue, or similar Familiarity with data platforms such as Oracle, Cloudera, or enterprise data warehouses Proficiency ...

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...