Lead Software Engineer - Python, Databricks, AWS
- Location
- Glasgow, Scotland, United Kingdom
data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across Software Engineering to promote awareness and adoption of new technologies. Foster a team culture of diversity, opportunity … with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data quality, security, and lineage best practices. Experience with cloud-based ...