Certified GKH Gardening Expert
You will want to leave them until they die back as much as possible. Do not cut them while they are still alive, since that will destroy their ability to store energy for next year's growth.
Once they are almost dead enough to cut back, you can dig them up and winter them indoors. Here are some articles that will help: