Certified GKH Gardening Expert
It is likely poor soil fertility than cross pollination. Cross pollination would affect the fruit of the tree grown from the seed of the cross pollinated fruit, not the fruit that was growing cross pollinated seeds.
Have your soil tested and adjust for anything that is off balance. Also make sure that your trees are regularly watered as irregular can also sometimes produce sour fruit.