2 of 2 Apache Jobs in Scotland

pipelines using AWS Glue, EMR, S3 and Athena. Build and optimise ETL/ELT workflows using PySpark, Python and SQL. Orchestrate data pipelines using Apache Airflow. Ensure data quality, performance, governance and security across cloud platforms. Collaborate with business stakeholders to translate requirements into robust technical solutions. Required Skills ...

Cloud: Hands-on experience with Kubernetes , Docker, Terraform, and CI/CD tools like Jenkins or GitHub Actions. Data & Messaging: Expert knowledge of Kafka , Apache Flink, PostgreSQL, Oracle, and Elasticsearch. Security: Deep understanding of OAuth 2.0, secure web services, and API gateway management. Candidate Profile Enterprise Experience: Proven track ...