I have two healthy, beautiful fig trees. Figs appear and then in just a few days they are gone off the tree. Is it squirrels, birds, etc.? They are not on the ground either. They bloomed early in the spring, then completely died off. Then they bloomed again even more beautiful. But no fruit.
Though it could be birds or animals, this does sound more like a pollination issue.
The article below will help you pinpoint the issues and how to correct.