Senior Databricks Engineer
Banbury, Oxfordshire, South East, United Kingdom
Bibby Financial Services
ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques Collaborate with the BI Product Owner, analysts, and other business stakeholders to understand data requirements and deliver solutions that meet business needs Optimize … and tune data processing systems for performance, reliability, and scalability Implement data quality and validation processes to ensure the accuracy and integrity of data throughout the pipelines Operate an agile CI/CD environment within Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data … ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques What we are looking for in our ideal Senior Databricks Engineer: Significant years of Databricks experience, including Unity Catalog Terraform, defining, deploying, and More ❯
Employment Type: Permanent
Salary: £80,000
Posted: