1 to 25 of 568 Permanent ETL Jobs in the UK excluding London

warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.* Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services.* Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality … more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven ...

Teams, PowerApps, Power Query, Power Automate (MS Flow) and VBA for Process Automation. Knowledge of Data Warehousing concepts and experience with ETL (Extract, Transform and Load) processes. Experience using Agile Project Management tools such as Azure DevOps, JIRA or MS Project. Exceptional communication skills with the ability to convey complex ...

Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic ...

automation. Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation. Experience with SSIS for ETL processes and legacy data integration tasks. Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps. Experience with Infrastructure ...

semantic modelling using DAX and Power Query. Analysing data to identify trends, risks and recommendations. Data Engineering and Analytics Engineering Building data pipelines and ETL/ELT workflows. Working with at least one cloud data platform (e.g., Azure, Microsoft Fabric, Databricks, Snowflake). Designing data models for reporting, analytics ...

with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java ...

successfully built, enhanced or operated cloud-based data platforms, ideally within Azure environments. Data Architecture Knowledge - You understand data modelling, ELT/ETL design, Delta Lake principles, data quality frameworks and modern engineering best practices. Cloud & DevOps Capability - You have experience with Azure services, automation, CI/CD pipelines and ...

include large scale data migrations to cloud, new project delivery, service enhancement and support. Relevant experience may include: • Strong SQL and data modelling experience. • ETL/ELT design and delivery. • Data pipeline design, build, monitoring and operations. • Batch and real-time data integration patterns. • AWS cloud data platforms. • Data lake ...

accelerate development and testing of data pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience ...

similar data-focused role. Strong hands-on experience with Microsoft Fabric, including Data Factory, Dataflows Gen2, Lakehouse and Warehouse solutions. Experience designing and developing ETL/ELT processes, enterprise data pipelines and transformation workflows. Strong SQL and Python skills, including experience with PySpark. Experience working with OneLake, Delta tables and ...

transition from legacy platforms where applicable Data Engineering & Integration Providing technical leadership across data engineering practices, including: Batch and streaming data pipelines ELT/ETL frameworks CI/CD for data platforms Architecting robust integrations from internal and third-party systems Defining data quality, validation, and monitoring standards Governance, Security ...

accelerate development and testing of data pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience ...

architecture and governance, including metadata management, controlled vocabularies, data lineage, validation rules, role-based access controls, and regulatory or compliance considerations. Practical knowledge of Extract, Transform and Load (ETL), data integration, and automation tools, including Power Query, Power Automate, APIs, connectors, integration hubs, or equivalent platforms. Strong working knowledge ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

Engineer high‐performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

Engineer high-performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. Experience building modern AI-enabled data architectures. Knowledge of Retrieval-Augmented Generation ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

and dashboards. ·Foundational knowledge of Python for data manipulation, automation, or analysis. ·Experience with cloud data environments such as Azure or AWS. ·Familiarity with ETL tools, or similar data‐integration technologies. ·Understanding of data modelling concepts. ·Familiarity with legal industry data and metrics. Equal Opportunities Our approach to our people ...

data governance, quality, security and operational best practice within production environments. Experience with DevOps, CI/CD practices, Fabric capacity management, or decommissioning legacy ETL tooling such as SSIS or KingswaySoft would be advantageous. If you're looking for a role where you can combine deep technical expertise with genuine ...

and Data Science to review and refine designs and translate them into robust implementations. Build and operate data pipelines: design, develop, test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting ...

and our communities in more than 40 countries around the world. What you'll do in the role: Develop and maintain data pipelines and ETL (Extract, Transform, Load) processes. Work with structured and unstructured data to ensure it is accessible and usable. Optimize data systems for performance and scalability. Implement ...