Certified GKH Gardening Expert
It could be a watering issue. They not only need more water during warmer conditions but also while fruiting. The tree normally puts most of its energy into fruit production and will thus shed its leaves when water is getting scarce. Try upping the water a bit.