Apache Pulsar multi-cluster disaster recovery and progressive traffic migration

Dezhi LIU
  • 📅Sun, Aug 9
  • 🕐15:45GMT+8
  • 📍JingYi Hall
  • 🎤Chinese Session
  • #Messaging

Multi-cluster Pulsar operations face two core challenges: rapid disaster recovery failover in the event of a primary cluster failure, and smooth traffic migration during cluster relocation. This presentation introduces the design and implementation of a proxy, which unifies disaster recovery and scheduling through three key technologies—directed connection closure, native weighted routing, and a progressive migration engine—to achieve arbitrary-precision traffic allocation and zero-explosion-radius failover.

Speakers:


Dezhi LIU: AscentStream Technology co-founder

● Co-founder of AscentStream Technology

● 10+ years of experience in large-scale internet/financial infrastructure development

● Former expert engineer at Tencent, successfully driving the large-scale deployment of Pulsar on Tencent Group’s unified billing platform’s message bus (capable of handling hundreds of billions of messages) and Tencent Cloud’s financial-grade messaging service (TDMQ).