We have a couple chocolate Joe Pye weeds planted in our flower beds next to our patio. I simply adore the foliage and the white flowers that bloom in late summer/early fall. However, I'm finding the sheer number of flies attracted to the plants overwhelming. If they would stay on the plant, that would be fine, but they usually roam around into our gathering/play spaces, too. How can I control/eliminate the flies?