Data Engineer
- Hiring Organisation
- Searches @ Wenham Carter
- Location
- Newport, Isle of Wight, UK
- Employment Type
- Full-time
from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance, scalability, and cost • Manage data quality, validation, and monitoring • Collaborate with analytics and ML teams to support reporting and model development • Implement CI/CD, version control, and automated testing for data pipelines Required Qualifications • 3+ … experience as a Data Engineer • Strong experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault ...