1 to 25 of 1,698 ETL Jobs in the UK

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

Teams, PowerApps, Power Query, Power Automate (MS Flow) and VBA for Process Automation. Knowledge of Data Warehousing concepts and experience with ETL (Extract, Transform and Load) processes. Experience using Agile Project Management tools such as Azure DevOps, JIRA or MS Project. Exceptional communication skills with the ability to convey complex ...

minimum of 5 years’ demonstrable experience in a BI Developer, Reporting Analyst, Data Analyst or Data Engineer role Proven experience designing and building ETL/ELT pipelines and managing the data lifecycle from ingestion through to reporting and consumptionStrong programming experience in Python, with a focus on data processing and ...

data architecture, reporting and governance foundations needed for longer‐term transformation. What You'll Be Doing as a Data Engineer: Design, build and improve ETL and ELT pipelines that support data ingestion, profiling, reconciliation, cleansing and reporting across enterprise source systems. Building data catalogues, data flows, interface views and trusted ...

business functions. Qualifications & Experience Essential Experience Demonstrable experience delivering data engineering solutions within complex project, programme, or enterprise environments. Strong experience designing and maintaining ETL/ELT pipelines, data integration processes, and structured data platforms. Experience working with Microsoft Fabric, Azure Data Services, SQL, Power BI, or equivalent modern data ...

data pipelines, automation, and data processing workflows, including use of PySpark.* Proficiency in SQL for querying, transformation, and analytical data processing.* Solid understanding of ETL/ELT pipelines, data transformation patterns, and data integration concepts.* Experience analyzing enterprise data sources to identify data relationships, transformations, and business rules.* Experience building ...

Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault Azure Data Technologies; Azure Data Lake Storage, Azure Data Factory, Azure Databricks, MS Fabric ETL/ELT processes and designing, building and testing data pipelines Building data transformations using Python/PySpark Azure Cloud Version control and CI/ ...

automation. Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation. Experience with SSIS for ETL processes and legacy data integration tasks. Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps. Experience with Infrastructure ...

SDLC) submitting work for technical test, cosmetic test and applying re-work when required. Dimensional Modelling (Kimball Methodology), database principles and ETL (Extract, Transform and Load). Coordinate and maintain the reporting requirements backlog, working with stakeholders to deliver value at the right time. Required to perform duties ...

and report troubleshooting. Support and maintain data warehouse environments such as Azure Synapse Analytics, SQL Server/Azure SQL DB, Snowflake or BigQuery. Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCA Investigate job failures and performance issues across data pipelines, ML endpoints, and ...

.Ideally, you’ll also have:Delivery experience using the following technology: SAS (SAS EG, SAS DI, SAS Viya).Relational Databases and Data Warehousing concepts.Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx.Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce.Cross and multi-platform ...

Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic ...

automation. Hands‐on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation. Experience with SSIS for ETL processes and legacy data integration tasks. Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps. Experience with Infrastructure ...

concepts clearly, explaining solution choices, trade-offs, dependencies and recommendations to both technical and non-technical audiences. Design and implement robust data models and ETL/ELT patterns that support enterprise reporting, analytics, machine learning and AI use cases. Optimise data pipelines and workloads for performance, reliability, scalability and cost ...

technical concepts clearly, explaining solution choices, trade-offs, dependencies and recommendations to both technical and non-technical audiences.Design and implement robust data models and ETL/ELT patterns that support enterprise reporting, analytics, machine learning and AI use cases.Optimise data pipelines and workloads for performance, reliability, scalability and cost, identifying ...

semantic modelling using DAX and Power Query. Analysing data to identify trends, risks and recommendations. Data Engineering and Analytics Engineering Building data pipelines and ETL/ELT workflows. Working with at least one cloud data platform (e.g., Azure, Microsoft Fabric, Databricks, Snowflake). Designing data models for reporting, analytics ...

also have: Delivery experience using the following technology: SAS (SAS EG, SAS DI, SAS Viya). Relational Databases and Data Warehousing concepts. Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx. Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce. Cross and multi ...

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

Python for automation.Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation.Experience with SSIS for ETL processes and legacy data integration tasks.Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps.Experience with Infrastructure as Code (e.g. ...

and accessibility of information.Data Platform Development: Builds and maintains scalable and robust data platforms to support analytics, machine learning, and business intelligence.Data Integration and ETL: Develops and optimizes ETL (Extract, Transform, Load) processes and data integration pipelines. Ensures efficient data flow across various sources and systems.Advanced File Processing: Develops extensible ...

Contribute to embedding the new data platform and architecture in the business and working to ensure our investment is maximised. Enhance, develop, and maintain ETL/ELT, middleware, and integrations. Ingest data from WMS, ERP, ecommerce, IoT and ad-hoc sources (CSV, APIs, unstructured). Analytics & Reporting Model data ...

and maintain data warehouse environments, such as:Azure Synapse AnalyticsSQL Server/Azure SQL DBSnowflake or BigQuery (optional, if used in hybrid environments)Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCAInvestigate job failures and performance issues across data pipelines, ML endpoints, and dashboards.Perform ...

Bachelor’s or master’s degree in computer science, Engineering, or a related technical field 5+ Years of hands-on experience in data engineering, ETL/ELT development, cloud-based data solutions, or data products for analytics, automation, or machine learning Deep expertise in AWS services, including S3, Lambda, Glue ...

data governance, lineage, security, and compliance controls within modern data platforms. Experience leading architecture decisions across complex stakeholder environments. Strong understanding of data pipelines, ETL/ELT frameworks, orchestration tooling, and data engineering best practices. Familiarity with technologies such as Spark, Python, SQL, Delta Lake, Unity Catalog, dbt, Azure Data ...