GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid
Cardiff, South Glamorgan, United Kingdom
Hybrid / WFH Options
Hybrid / WFH Options
Hamilton Barnes
and replication to guarantee the highest performance and reliability of data streams. Configure Kafka Connectors: Apply your expertise to set up Kafka connectors for batch processing, managing both source and sink connectors to seamlessly integrate data. Python and Apache Beam Proficiency: Utilize Python and Apache Beam to craft … tailored data processing logic and transformations within pipelines, enabling swift and effective data analysis. Ensure Security: Implement SSL/TLS encryption, SASL authentication, and ACL-based authorization to fortify Kafka clusters and communication channels, ensuring data integrity and privacy. What you will Ideally Bring: Hands-On Kafka Configuration: Proven … expertise in configuring Kafka connectors for batch processing, optimizing their number for improved performance. Python and DataFlow/Apache Beam Proficiency: Skilled in Python and DataFlow/Apache Beam, adept at developing custom data processing logic within pipelines Streaming Data Management: Demonstrated ability in handling streaming data more »
Employment Type: Contract
Rate: GBP 550 Daily
Posted: