26 to 50 of 1,291 ETL Jobs in England

summary Designing, developing and maintaining data ingestion, transformation and integration processes across multiple business systems. Building and optimising ETL/ELT pipelines using Microsoft Fabric and Azure Data Factory. Developing and supporting modern data warehouse architectures, including bronze, silver and gold data layers. Integrating data from clinical, operational, HR and ...

dimensional modelling Experience with CI/CD pipelines using Azure DevOps or GitHub Understanding cloud architecture and distributed data processing Data Management Experience with ETL/ELT frameworks and data integration patterns Knowledge of data quality, data governance and metadata management Familiarity with big data technologies and streaming solutions ...

data sharing, including contracts, data minimisation, and consent where applicable. Skills, Knowledge and Expertise Technical Expertise: MS Fabric, Power BI, data modelling, SQL, Python, ETL tools, cloud platforms (Azure/AWS/GCP), and working knowledge of AI productivity tools including Microsoft Copilot and Claude. Data Governance & Quality: Strong understanding ...

transition from legacy platforms where applicable Data Engineering & Integration Providing technical leadership across data engineering practices, including: Batch and streaming data pipelines ELT/ETL frameworks CI/CD for data platforms Architecting robust integrations from internal and third-party systems Defining data quality, validation, and monitoring standards Governance, Security ...

data warehousing, data lakes, and lakehouse architectures Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java ETL/ELT design and data pipeline orchestration Streaming and event-driven data architectures Agile and DevOps delivery methodologies applied to data platforms (DataOps) Expertise ...

data warehousing, data lakes, and lakehouse architectures. Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps).Expertise ...

major cloud providers (Azure, AWS, or GCP).Solid understanding of data governance, access control, and security practices in cloud environments. Experience with large-scale ETL/ELT design and migration programmes. Familiarity with how AI/ML and agentic systems are integrated with enterprise data platforms. Demonstrated experience with cloud ...

architecture and governance, including metadata management, controlled vocabularies, data lineage, validation rules, role‐based access controls, and regulatory or compliance considerations. Practical knowledge of Extract, Transform and Load (ETL), data integration, and automation tools, including Power Query, Power Automate, APIs, connectors, integration hubs, or equivalent platforms. Strong working knowledge ...

commercially aware data professional who can work independently, manage competing priorities and translate business requirements into practical data solutions. Key requirements: Strong experience of ETL and ELT processes Proficiency in SQL, including DDL and DML within a data warehouse environment Experience of data modelling, ideally including dimensional or Kimball modelling ...

data integration, migration, and enhancement of existing pipelines. Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads. Builds and maintains robust data pipelines to support reporting, analytics, and application data needs. Creates and maintains Snowflake objects like tables, views ...

/NoSQL databases* Familiarity with data visualisation tools (e.g. Power BI, Tableau)* Programming ability in Python, R, or Java* Understanding of data modelling, ETL processes, or data pipelines (desirable)* Exposure to cloud platforms (AWS, Azure, GCP)* Understanding of software development lifecycle (SDLC) and testing principles* Academic, personal, or internship projects ...

/NoSQL databases* Familiarity with data visualisation tools (e.g. Power BI, Tableau)* Programming ability in Python, R, or Java* Understanding of data modelling, ETL processes, or data pipelines (desirable)* Exposure to cloud platforms (AWS, Azure, GCP)* Understanding of software development lifecycle (SDLC) and testing principles* Academic, personal, or internship projects ...

pipelines and automated deployments Experience with Python for data engineering or analytics An understanding of data warehousing principles and methodologies is preferable Experience developing ETL/ELT processes Knowledge of Microsoft Fabric and modern data platform technologies is preferable Knowledge of Microsoft Purview and data governance frameworks Microsoft certifications including ...

Engineer high‐performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise-scale ETL/ELT,batchand streaming patterns Transformation and quality:dbt, Great Expectations and equivalent tooling Orchestration:Apache Airflow and cloud-native orchestration services Event streaming:Kafka ...

data analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding of : Data modelling Metadata management Data ...

Factory, and other data pipeline tools Experience with cloud platforms such as Azure, AWS, or GCP Solid understanding of data modeling, data warehousing, and ETL/ELT processes Familiarity with AI and machine learning concepts, with hands\u2011on experience in implementing AI-driven solutions Excellent problem-solving skills and ...

Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. Experience building modern AI-enabled data architectures. Knowledge of Retrieval-Augmented Generation ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

stream processing concepts (e.g., event time, state, backpressure). Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms, ideally AWS, but Azure/GCP also ...

across BigQuery or equivalent cloud data warehouses; familiarity with Scala or Java is a plus. Deep expertise in data pipeline design: batch vs. streaming, ETL/ELT, schema design, partitioning, and efficient storage patterns. Hands-on experience with dbt Core (or dbt Cloud) and Airflow for orchestration and transformation ...

and Data Science to review and refine designs and translate them into robust implementations. Build and operate data pipelines: design, develop, test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting ...

technical requirements, success criteria and delivery plans. Elicit and translate business and technical requirements into data, integration and solution specifications. Design and implement scalable ETL pipelines and data models; own data quality, lineage and documentation. Build and operationalise predictive analytics and automated processes; ensure monitoring and maintainability. Develop high impact … and ability to map analytics to measurable business outcomes. Understanding of Python and SQL is not required but would be beneficial Solid knowledge of ETL, ETL design patterns, data warehousing and data governance. Problem solving mindset. Familiarity with Microsoft Azure and AI/ML platforms. Current security clearance, or ability ...

language and simple analysis techniques to profile data. Technical experience and knowledge in On‐Premise and Public Cloud Data Services focused on database architecture, ETL, data mining, business intelligence, big data, data governance, data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks ...

Data Governance, Data Quality, Metadata Management, and Data Lineage.* Experience designing and implementing Data Warehouses, Data Lakes, and Modern Data Platforms.* Strong understanding of ETL/ELT Architecture and Data Integration Frameworks.* Experience with Cloud Data Platforms such as Azure, AWS, or GCP.* Strong SQL and data analysis skills.* Knowledge ...