Figs keep dropping from the tree before they are ripe for picking. Soil is kind of clayey. Watering or not watering much does not help.
Figs Dropping From Tree
Certified GKH Gardening Expert
This article will help with the fig fruit drop: https://www.gardeningknowhow.com/edible/fruits/figs/fig-drop.htm
You may need to amend your clay soil. This article will help with that: https://www.gardeningknowhow.com/garden-how-to/soil-fertilizers/how-to-improve-clay-soil.htm