6 of 6 Apache Jobs in the North East

modern data engineering best practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited to join a start-up in a role that you can shape and influence ...

using Docker and Kubernetes (EKS/AKS). Develop automation scripts and tooling using Python, Bash, and PowerShell. Support data and orchestration platforms using Apache Spark and Apache Airflow. Use Jupyter Notebooks for development, troubleshooting, and operational analysis. Implement monitoring, logging, and observability solutions using Prometheus, Grafana … Ansible/Chef Containers & Orchestration Docker Kubernetes (EKS/AKS) CI/CD & Automation GitLab CI/CD Python Bash PowerShell Data & Platform Engineering Apache Spark Apache Airflow Jupyter Notebooks Observability & Monitoring Prometheus Grafana Splunk Security & DevSecOps Trivy Trend Micro Wiz Security scanning and compliance automation Networking & Integration ...

Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing frameworks Hands-on experience with Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena ...

Swagger, alongside accessibility testing (WCAG 2.2 with assistive tech such as JAWS/Dragon), plus Infrastructure as Code and data platforms using Terraform, Apache Spark, Python/Airflow, Docker, security scanning (e.g., Trixy, Trend Micro, Wiz) and Juryter Notebooks, integrated with DWP Integration Team products (e.g.Data Access Layer … Azure cloud with Terraform for Infrastructure as Code, Java and Python services built as RESTful microservices (Spring Boot) supported by TDD/BDD, Apache Spark for data processing and Apache Airflow for orchestration, containerization with Docker, CI/CD and source control with GitLab/GitHub, streaming with ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

expand their Devops team (multiple roles). Key requirements: Strong experience with AWS services and infrastructure as code using Terraform Data engineering expertise using Apache Spark and Python, including development in Jupyter Notebooks Workflow orchestration and containerisation experience with Apache Airflow and Docker Version control and CI/ ...