1 year ago
#340592
ZZzzZZzz
Replicate Kafka Data from AWS Kafka to confluent kafka using Load alancer
I have a use case to replicate Kafka
topics and data from one Kafka cluster in AWS
to Confluent Kafka
deployed on AWS. The issue is, my Kafka in AWS is deployed in a VPC, say VPC-1
that dosent allow for VPC peering with confluent cloud. I need to use a Load balancer/Proxy
service deployed in another VPC say VPC-2
that is peered with VPC-1 and Confluent Kafka cluster VPC (VPC-3
). Also, VPC-3 is peered with VPC-1. What would be a idea Load balancer setup to point to AWS VPC-1
so that that data could be then replicated to Confluent cloud kafka? Below is how the VPC's are peered and I need something to run on VPC-2
and forward data from Confluent Kafka to Kafka in VPC-1
. The data in source Kafka is few hundred GB per day.
amazon-web-services
apache-kafka
confluent-platform
amazon-vpc
google-vpc
0 Answers
Your Answer