Certified GKH Gardening Expert
The leaves should be left on the plant through the summer and fall. The plant needs them to store energy for next year. You can optionally cut the flower stalks down.
You can trim the old leaves from the previous year in late winter/early spring each year. This improves the plant's appearance in time for the new leaves and flowers to grow.