We are losing whole branches, yet the plant looks like it is getting ready to bloom again. The plant may be up to 40 years old.
Certified GKH Gardening Expert
I would check the plant for crown rot. This would cause the plant to rot at the base and cause whole branches to fall off. In this plant, it would be normally caused by overly wet conditions the soil.
This article has more information: