1 to 25 of 226 Permanent ETL Jobs in the UK excluding London

improve their financial wellbeing. Key Responsibilities: Data Pipelines and ETL Processes • ETL Implementation: Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions.• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such ...

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

Engineering & DevOps Silo Elimination & Data Ingestion: Identify isolated data pockets across the business and unify them into the central platform. Design robust ELT/ETL pipelines (using Python, SQL or Spark) to ingest high-volume data from internal systems, APIs and flat files. Modernisation & Migration: Lead the technical migration ...

Essential Skills Proven experience as a Data Architect (or similar/related role) Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience with Big Data Experience with Enterprise level Data sets Experience of using programming languages such as Python, Scala and SQL Ability … data solutions are closely aligned with business objectives and effectively meet user needs. Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information Managing the aspirations of a variety ...

multiple internal systems and data sources into a single, consistent data model Lead the migration and decommissioning of legacy reporting systems Build and optimise ETL/ELT pipelines Develop and maintain data models and dashboards Implement best practices around data governance, quality, and security Monitor and optimise data pipelines ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

Experience with data warehouse design and data modelling (Kimball, Lakehouse/Medallion, Data Vault preferred) Building data lakes and end-to-end ELT/ETL pipelines Performance tuning across varied database environments Desirable: dbt, Docker, Microsoft BI stack, Aurora DB, Step Functions, Batch, IAM, SQS, SNS Excellent data development, modelling ...

design and deliver data solutions that meet real analytical needs Designing and building Data Warehouses, Data Lakes and Lakehouse architectures Developing complex and reliable ETL pipelines Designing secure, scalable and high-performance data infrastructure Ensuring solutions are well documented from both a design and support perspective Acting as a trusted ...

users on business intelligence tools. Identify opportunities to improve data processes and implement solutions. Integrate various data sources to provide comprehensive insights. ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources using SQL and other tools Maintain documentation for all analytics tools …/FI & Power BI should have: Expert user of Power BI. SQL, DAX and Databases - Ability to query databases and structure financial data efficiently ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources. Strong analytical and problem-solving skills. Experience ...

known business in their search for a Data Engineer. The purpose of this role will be to design and build data infrastructure for efficient ETL from diverse sources, including integration and maintenance of analytics tools and ongoing pipeline monitoring and performance optimisation. This sits within the IT Department and ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

matures Skills & Experience Strong experience in data engineering within a Microsoft ecosystem with hands-on experience with: Azure Data Lake Azure data pipelines/ETL SQL and relational data modelling Comfortable working with high-volume, low-value transaction data Experience integrating multiple systems into a central data platform Ability ...

and Microsoft Fabric. Strong SQL skills for managing large-scale datasets. Experience integrating Microsoft Dynamics 365 data solutions. Knowledge of data modelling, warehousing, and ETL/ELT principles. Familiarity with data governance and security best practices. Proficiency in scripting and automation (PowerShell, Python or similar). Excellent communication and stakeholder ...

stakeholders across the organisation to define metrics and deliver analysis, translating findings into clear, actionable recommendations and compelling data stories. Engineer and manage robust ETL pipelines (including APIs) to integrate diverse data sources, enabling the creation of impactful, real-time reporting solutions. Design and maintain fit-for-purpose data models ...

data pipelines, managing data warehousing, and ensuring high-quality data is available for business decision-making. Responsibilities: Data Pipeline Development: Design, build, and maintain ETL (Extract, Transform, Load) processes to enable efficient data ingestion and transformation. Database Management: Support and optimise SQL databases, ensuring performance, reliability, and data integrity. ...

scheduled r-training pipelines. Data Management and Preprocessing: Collect, clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control ...