Databricks Architect
- Hiring Organisation
- Avance Consulting
- Location
- City of London, London, United Kingdom
/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. • Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server. • Working knowledge of AWS data services, especially S3. • Understanding of data product thinking, data mesh concepts, and modern data engineering … best practices. Key Responsibilities • Build and maintain batch and streaming data pipelines from legacy mainframe DB2 and on prem SQL Server systems into an AWS-based data lake. • Implement real-time ingestion using Confluent Kafka and land data in Amazon S3. • Develop data transformations and analytics pipelines in Databricks ...