Why does my orange smell like an orange but taste like a lemon?
Do you know the variety of Orange Tree that you have planted?
There are different types of oranges, and some are of a bitter variety.
Optimizing the growing conditions and plenty of warm sunshine produces the best tasting fruit.
Here are some links with more information.