I recently purchased a lime tree and since I live in Maryland, my tree will remain inside. I noted that several of the tips of branches have up to six limes starting to grow. The tree is only about 1 1/2 feet high and about 2 1/2 feet wide. I am concerned that the weight of all the fruit at the end of the branch will be too heavy. Do I need to reduce the number of limes clumped together?