6 of 6 ETL Jobs in Newcastle upon Tyne

guide junior engineers where appropriate Key Requirements As a Data Engineer , you should have: Strong programming experience in Java (preferred) or Python Experience building ETL/ELT or streaming data pipelines Hands-on experience with Kafka, Flink, or Spark (streaming experience preferred) Good understanding of stream-processing concepts (event time ...

preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with ...

role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle. Key Responsibilities • Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark • Build and optimise Delta Lake architectures and data pipelines on AWS • Implement ingestion frameworks using Databricks ...

and secure data handling Key Skills & Experience Technical Skills Strong SQL and data modelling experience Azure data stack (ADF, Synapse, Fabric, Databricks) Experience building ETL/ELT pipelines Python/PySpark (desirable) DBT or similar transformation tools Experience with orchestration tools (ADF, Airflow, Prefect) CI/CD, Git, and Azure ...

3+ years of experience in Software Development Active SC is required for this role Strong experience using Python for data processing, transformation, and ETL workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. ...

data arriving from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata management and ...