Senior Databricks Engineer
Belfast, Northern Ireland, United Kingdom
Version 1
pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and delivering early proofs of concept and production implementation. You will ideally have experience in building solutions using … high quality work to tight deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and … methodology to deliver proof of concept and production implementation in iterative sprints. Qualifications Direct experience of building data piplines using Azure Data Factory and Databricks Spark. Building data integration with Python Hands on experience designing and delivering solutions using the Azure Data Analytics platform. Experience building data warehouse solutions using more »
Posted: