AWS Databricks Engineer
- Hiring Organisation
- Capgemini
- Location
- London Area, United Kingdom
engineers and support code reviews, design reviews, and engineering best practices. Your Skills: Strong hands-on experience with Databricks on AWS. Strong experience with Apache Spark/PySpark. Excellent programming skills in Python. Strong SQL skills including complex queries, joins, CTEs, window functions, and query optimization. Experience with Spark … storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding of data modelling, data warehousing, and dimensional modelling concepts. Experience with data validation, reconciliation, data quality, audit ...