1 to 25 of 193 ETL Jobs in the North of England

Lakes, Blob Containers). Experience with data transformation and modelling techniques. Thorough understanding and experience with data warehousing concepts and dimensional modelling. Experience with ETL and orchestration tooling (Data Factory, Databricks). Experience with data governance and cataloguing using Databricks Unity Catalog (access control, lineage, discoverability). Experience with Azure ...

automation. Hands-on experience with Microsoft Fabric and Azure Data Factory, including pipeline orchestration, linked services, environment management, and parameterisation. Experience with SSIS for ETL processes and legacy data integration tasks. Expertise in designing and implementing CI/CD pipelines using tools such as Azure DevOps. Experience with Infrastructure ...

across business intelligence and data engineering. What you’ll be doing Developing and maintaining Power BI reports, dashboards and semantic models Designing and improving ETL and ELT pipelines using SQL, Python and, where appropriate, PySpark or Spark Working with Microsoft Fabric, Azure data services, data warehouses, lakehouses and data lakes ...

across business intelligence and data engineering. What you'll be doing Developing and maintaining Power BI reports, dashboards and semantic models Designing and improving ETL and ELT pipelines using SQL, Python and, where appropriate, PySpark or Spark Working with Microsoft Fabric, Azure data services, data warehouses, lakehouses and data lakes ...

term sustainability. 5+ years of experience in data engineering (or 3+ years with strong Foundry depth). Key Responsibilities Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated ...

with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java ...

summary Designing, developing and maintaining data ingestion, transformation and integration processes across multiple business systems. Building and optimising ETL/ELT pipelines using Microsoft Fabric and Azure Data Factory. Developing and supporting modern data warehouse architectures, including bronze, silver and gold data layers. Integrating data from clinical, operational, HR and ...

commercially aware data professional who can work independently, manage competing priorities and translate business requirements into practical data solutions. Key requirements: Strong experience of ETL and ELT processes Proficiency in SQL, including DDL and DML within a data warehouse environment Experience of data modelling, ideally including dimensional or Kimball modelling ...

data analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding of : Data modelling Metadata management Data ...

Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. Experience building modern AI-enabled data architectures. Knowledge of Retrieval-Augmented Generation ...

stream processing concepts (e.g., event time, state, backpressure). Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms, ideally AWS, but Azure/GCP also ...

and Data Science to review and refine designs and translate them into robust implementations. Build and operate data pipelines: design, develop, test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting ...

and their integration within enterprise analytics platforms. Strong proficiency in Azure Data Factory, Synapse, and cloud data services. Expert‐level skills in data modelling, ETL processes, and semantic layer design. Advanced programming capabilities in SQL (T‐SQL/Spark SQL), Python, and PySpark. Hands‐on experience with Power BI (Desktop ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

EXPERIENCE The successful Data Engineer will have the following skills and experience: Strong commercial experience with SQL and data modelling. Experience designing and managing ETL or ELT processes. Knowledge of data warehousing concepts and best practices. Familiarity with Azure Data Factory and Snowflake. Experience working with Power BI and ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

validation and reconciliation. Communicating analytical findings clearly to a range of audiences. Nice to have Experience with Databricks, Salesforce reporting, Python, Azure/AWS, ETL technologies or data modelling would be highly beneficial. Why this role? This is a great opportunity for a hands-on Data Analyst to join ...

Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow Optimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performance Develop and fine‐tune complex ...

unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within unified, standardised schemas Basic ...

Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT Familiarity with various data architectures such as Lakes and Warehouses Hands-on experience with data cleansing and transformation within unified, standardised schemas Technologies ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Write clean, maintainable, and efficient code, ensuring adherence to best practices through code reviews Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow Optimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performance Develop and fine-tune complex ...

data pipelines using Palantir Foundry (Pipeline Builder, Code Repositories, Data Lineage, Ontology, Workshop, Quiver, etc.). Implement batch, incremental, and streaming ETL/ELT workflows with reusable, production-ready components. Build and maintain high-quality, version-controlled data products aligned to business use cases. Work with federated data environments, handling ...

dataflows and dev/test/prod environments. Experience building shared semantic models and reusable datasets. Solid grounding in dimensional modelling, relational databases and ETL/ELT principles. Ability to gather requirements and translate them into scalable analytical solutions. Personal Qualities Analytical and methodical, with strong attention to detail. Confident ...

skills, with practical experience using Python for data engineering, dataprocessingor automation. Proven experience designing and building data pipelines, with a strong understanding of modern ETL/ELT practices. Experience working with modern cloud data platforms and orchestration technologies. Experience within the Microsoft data ecosystem would beadvantageous. Experience of data modelling ...