Query Failure under High Volume of Topics and Consumers

[Crazylychee]

Issue: Query Timeout and Unavailability in Production Environment with High Volume of Topics and Consumers

Environment:

Docker
Latest Dashboard Source Code
RocketMQ 5.3.0
Description:
The system exhibits stable performance and reliable query responses under low data volumes. However, upon transitioning to the production environment with a broker hosting over 900 topics and 2300 consumers, the system encounters severe query issues. Queries frequently result in timeouts and become unavailable, severely impacting the dashboard’s functionality and user experience.

Symptoms:

Prolonged query response times leading to timeouts.
High frequency of failed queries.
Dashboard unresponsiveness and partial data retrieval.
Impact:

Critical disruption in monitoring and managing the messaging system.
Potential data visibility issues due to incomplete or failed queries.
Significantly degraded user experience for dashboard users.