I have planted orange and grapefruit plants. Now they are almost 7 feet of high and healthy, but the problem is when ever they have flowers, they are very healthy and I can see fruits in between them but after some time when the flower petals are falling, the whole fruit also falls and, thus, no fruits. This is happening 2 straight years.
Grapefruit Tree and Orange Tree
Certified GKH Gardening Expert
This article will help with the blossom/fruit drop (same reasons would apply to these fruits as well as limes): https://www.gardeningknowhow.com/edible/fruits/lime/is-lime-fruit-and-lime-blossoms-falling-off-tree-normal.htm
Additionally, poor pollination can result in blossoms and fruit dropping from trees.