2 of 2 Batch Processing Jobs in the South West

a recent focus on developing data and analytics solutions on cloud platform (e.g. GCP/AWS/Azure). Technical know-how in data engineering techniques which cover both batch processing and/or streaming Agile Delivery: Significant experience in scoping and development of technical solutions in an Agile environment. Technical Proficiency: Deep technical expertise in software and … data engineering, programming languages (python, java etc.). Understanding of orchestration (Composer, DAGs), data processing (Kafka, Flink, DataFlow, dbt), and database capabilities (e.g. BigQuery, CloudSQL, BigTable). Container technologies (Docker, Kubernetes), IaaC (Terraform) and experience with cloud platforms such as GCP. CI/CD: Detailed understanding of working automated CI/CD pipelines and experience of working with tools … had Industry Standard: GCP Data Engineer/Cloud Architect certifications Good appreciation of data security and privacy, and architectural implications it has on application design. Modern progressive technologies– e.g. batch/streaming pipelines, machine learning, artificial intelligence etc. High-level knowledge of QA, data quality, and software quality tools such as SonarQube, etc. About working for us Our ambition More ❯

CloudSQL, Spanner, Pub Sub, Cloud composer and GKE. Data Engineering : Proficient in modern data tools and frameworks for building, operating, and optimising ETL/ELT pipelines, streaming data, and batch processing. SRE & Automation : Strong understanding of SRE principles, CI/CD, infrastructure as code, and operational automation. Data Literacy : Ability to design, develop, and apply data and analytics experience More ❯