What's your question? Ask

You mention you have a small garden, the size of a mature Loquat tree may be overwhelming for your space.

I have included a few links for you to help in your decision.

https://www.gardeningknowhow.com/edible/fruits/loquat/growing-loquat-fruit.htm

http://fruitsandnuts.ucdavis.edu/dsadditions/Loquat_Fact_Sheet/

https://www.gardeningknowhow.com/ornamental/trees/tgen/small-trees-for-gardens.htm

It may be a fertilizing issue, likely a nitrogen/phosphorus inbalance. Too much nitrogen in the soil will prodcue healthy growth but limit flowering and fruiting production. Try adding some more phosphorus-rich fertilizer or bone meal to the soil to encourage more flowering and fruiting. Plants need phosphorus for flowering and fruiting. Without it, there will be no blooms and thus no fruit. Here is more information: https://www.gardeningknowhow.com/garden-how-to/soil-fertilizers/phosphorus-plant-growth.htm

It may be a fertilizing issue, likely a nitrogen/phosphorus imbalance. Too much nitrogen in the soil will produce healthy growth but limit flowering and fruiting production. Try adding some more phosphorus-rich fertilizer or bone meal to the soil to encourage more flowering and subsequent fruiting.

I believe you may have a few issues with your Loquat Tree.
Your tree has had some lose of leaves and branching from either lack of water or transplant stress.
From this image, the tree looks of substantial size and transplating larger trees can be more difficult and require more care.

A stressed tree can be more susceptible to desease and insects.

The damage that appears in this particular image matches the pattern that is caused by the Yellow-bellied sapsucker.
If the damage becomes to severe the tree can become girdled and can lead to the death of the tree.

Here is a link with more information.

http://www.na.fs.fed.us/spfo/pubs/howtos/ht_sap/sap.htm

Here are some links that have more information for you.
Refresh yourself on the watering, fertilizing and weed control.

Additional link has information on the diseases know to effect Loquat Tree's. Please compare the information to the leaf markings that you are experiencing on your tree.

https://www.gardeningknowhow.com/edible/fruits/loquat/growing-loquat-fruit.htm
https://hort.purdue.edu/newcrop/morton/loquat.html

Both can be used to make tea. I found these links for you with more information.

http://www.globalhealingcenter.com/natural-health/health-benefits-of-loquat-leaf/
http://www.green-tea-shop.com/dried-kumquat-tea-p-362.html