Certified GKH Gardening Expert
These trees will either be only male, or only female. I can't see a male branch, but I do see what looks like another tree growing right beside the tree. You may want to get rid of this before it takes from the health of your tree.
Please include a close up photo of the male flowered branch.
I too have this and I would say to leave it be. It's simple. I only have a female tree = not bearing edible fruit. A couple of years ago, I noted that I now had edible fruit but could not figure out how this happened. I assumed that there was a nearby male tree. Ends up, the male tree was growing out of the bottom of the trunk of my female tree. It is indeed a male tree, and is growing from the bottom of the trunk (not out of the ground, but the trunk). I've had edible fruit/nuts for years now. If it is damaging your tree, try cutting it back or you may have to remove it to save your female tree - if it is causing problems, since it is half way up the tree. You may try replanting a cutting from the male tree.