I planted a lime tree in the ground, got lots of flowers and has good amount of limes since May. The limes are not growing though. They are the same size since a month ago.
Limes Do Not Get Bigger
Certified GKH Gardening Expert
You may need to thin a crop of limes in order to encourage larger fruit.
Also make sure the tree is adequately watered.
Here are a few links for you.