Certified GKH Gardening Expert
Choosing rust resistant berries is the best course of action. If only a few leaves are involved, remove them. If the whole plant is covered, remove the plant. In this extension article, it says as long as there isn't any rust on the fruit it should be OK to eat. However, I don't know exactly what you sprayed on your berry patch, so read the product label for toxicity (though you say it is organic) or call the company.