1 year ago

#340592

test-img

ZZzzZZzz

Replicate Kafka Data from AWS Kafka to confluent kafka using Load alancer

I have a use case to replicate Kafka topics and data from one Kafka cluster in AWS to Confluent Kafka deployed on AWS. The issue is, my Kafka in AWS is deployed in a VPC, say VPC-1 that dosent allow for VPC peering with confluent cloud. I need to use a Load balancer/Proxy service deployed in another VPC say VPC-2 that is peered with VPC-1 and Confluent Kafka cluster VPC (VPC-3). Also, VPC-3 is peered with VPC-1. What would be a idea Load balancer setup to point to AWS VPC-1 so that that data could be then replicated to Confluent cloud kafka? Below is how the VPC's are peered and I need something to run on VPC-2 and forward data from Confluent Kafka to Kafka in VPC-1. The data in source Kafka is few hundred GB per day.

enter image description here

amazon-web-services

apache-kafka

confluent-platform

amazon-vpc

google-vpc

0 Answers

Your Answer

Accepted video resources