On September 8th, at 6:56 UTC hrs, a hardware fault in our Singapore Data Center affected the SIP services within the APAC region. Customers may have experienced causing network disruption or latency.
A hardware fault developed on our cloud provider's incoming router in the Singapore Data Center. Our Primary load-balancer failed over to the Secondary and rerouted traffic. Once our vendor rectified the fault, our services switched back to the Primary, however, due to network address caching some services were not immediately restored and required manual intervention. The incident fully resolved at 7:20 UTC hrs.
We are making some preventative changes in our failover process and working with our cloud provider to modernise the hardware that supports it.