Data Engineer
- Hiring Organisation
- Jacobs
- Location
- Manchester, Lancashire, United Kingdom
- Employment Type
- Permanent
- Salary
- GBP Annual
Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark … data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2 ...