Lead Software Engineer - Python, Databricks, AWS
- Location
- Auchentibber, Scotland, United Kingdom
ability to think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting and analytics. Write … Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience ...