This is where you are going to have tough love, you are going to prune the plant back by 1/2.
You need to wait until your tree is dormant for this prune.
This will make for a stronger tree that will send it's energy into making roots. It will then start to send out branches for a better growing and fruiting tree.
Here are some links to help you.
https://www.gardeningknowhow.com/edible/fruits/figs/pruning-fig-trees.htm
https://www.gardeningknowhow.com/edible/fruits/figs/potted-fig-tree-pruning.htm
https://www.gardeningknowhow.com/edible/fruits/figs/growing-figs-in-pots.htm