Data Engineer

**We Are Hiring – Senior Data Engineer (PySpark & AWS)**

Perm 75k GBP

We are seeking an experienced Senior Data Engineer to enhance our team, focusing on scalable data platforms and cloud technologies.

### About The Role

You will design and optimize data pipelines for analytics and machine learning, ensuring reliable data access for real-time and batch processing.

### Key Responsibilities

- Build and maintain data pipelines using PySpark and Python.

- Develop ETL/ELT workflows, ensuring data quality.

- Use Apache Airflow for orchestration.

- Implement AWS solutions (Lambda, Redshift, S3).

- Manage infrastructure with Terraform.

- Create CI/CD pipelines with GitHub Actions.

- Optimize Spark jobs and troubleshoot issues.

### Required Qualifications

- 6+ years in data engineering.

- Proficiency in Python, PySpark, SQL, Spark, and Airflow.

- Experience with AWS services and Terraform.