GCP Data Engineer - Contract
Location: London
Working Model: Hybrid - 2-3 days per week in the office
Contract Duration: 12 months
Rate: £400 per day
Role Type: Contract
The Role
We are seeking an experienced GCP Data Engineer to design, build and optimise scalable cloud-native data solutions on Google Cloud Platform (GCP).
You will be responsible for developing batch and Real Time data pipelines, implementing data lake and data warehouse solutions, and supporting data-driven analytics and AI/ML initiatives.
The role involves close collaboration with architects, data scientists, business analysts and application teams to deliver secure, reliable and high-quality data solutions.
Key Responsibilities
- Design and build scalable batch and streaming data ingestion pipelines using Dataflow, Dataproc, Pub/Sub and Cloud Functions
- Develop reusable and optimised data processing solutions using Python and PySpark
- Design and manage data warehouse solutions using BigQuery
- Implement workflow orchestration using Cloud Composer/Apache Airflow
- Develop solutions for structured, semi-structured and unstructured data
- Implement BigQuery partitioning, clustering and performance optimisation
- Ensure data quality, integrity, lineage and governance across data platforms
- Implement IAM policies, security controls and compliance requirements
- Develop and maintain cloud infrastructure using Terraform
- Support automated deployments using Git and CI/CD
- Participate in technical design discussions, code reviews and solution governance
- Collaborate with technical and business stakeholders throughout the delivery life cycle
Essential Skills and Experience
Strong hands-on experience with:
- Google Cloud Platform (GCP)
- BigQuery
- Dataflow
- Dataproc
- Cloud Composer/Apache Airflow
- Pub/Sub
- Google Cloud Storage
- Python
- PySpark
- SQL
- Terraform
- Git
- CI/CD
Desirable Skills and Experience
- Strong analytical and problem-solving skills
- Excellent communication and stakeholder management skills
- Experience working in global or multi-vendor environments
- Experience delivering data modernisation and cloud migration programmes
- Good understanding of data governance, security and cloud architecture best practices