14 of 14 ETL Jobs in West Yorkshire

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows, threat hunting, incident response, detection ...

Engineer Key skills: * Microsoft Fabric * Azure Cloud Technologies * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good communication skills ...

and the opportunity to help build a data engineering function from the ground up. THE ROLE * Design, build and maintain scalable data pipelines and ETL/ELT processes * Integrate data from multiple internal and external sources, including APIs and third-party platforms * Build and optimise data models to support analytics ...

and best practices. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development. Advanced SQL skills. Experience with Azure, AWS or GCP. ETL/ELT development. Data pipeline design and optimisation. Core data engineering principles. Strong stakeholder communication skills. Working independently within fast-paced project environments. THE BENEFITS ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

teams to influence data strategy and architecture. Required Experience Strong hands-on experience building and operating production-grade data platforms. Expertise in data architecture, ETL/ELT pipelines, data modelling and orchestration. Experience working with large-scale or complex datasets. Background delivering analytics and business intelligence solutions. Experience designing secure ...

systems integrate with ERP platforms through various business and technical approaches. Strong knowledge of Enterprise Resource Planning (ERP) systems. Knowledge in data modeling, ETL processes, and data warehousing. Knowledge in SQL and experience with database management systems (e.g., Oracle, SQL Server, MySQL). Experience with data integration tools and technologies. ...

systems integrate with ERP platforms through various business and technical approaches. Strong knowledge of Enterprise Resource Planning (ERP) systems. Knowledge in data modeling, ETL processes, and data warehousing. Knowledge in SQL and experience with database management systems (e.g., Oracle, SQL Server, MySQL). Experience with data integration tools and technologies. ...

using Databricks, Apache Spark, and Python. Develop & Deliver: Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective … with Apache Spark, and SQL. Strong proficiency in Python (PySpark preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge ...

used the platform in a genuine delivery environment rather than someone with only limited exposure. Key responsibilities • Design and build end to end ETL and ELT solutions using Microsoft Fabric • Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with … experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...