Certified GKH Gardening Expert
As these are considered fairly hardy plants, you can leave them in the pot. If you live in zone 6, you will need to move your container to a sheltered area, such as near the foundation of your house. You may also wrap the pot in bubble wrap or something similar. If you live closer to zone 5, you will need to store your the container in a cool place out of the elements, such as in a garage or basement. Even if you are in zone 6, you may want to consider storing your container in the garage or basement to prevent poor drainage and ice from killing your roots.
Your container will require some watering over winter unless it's left outside in the elements where it receives snow or other moisture. If you need to provide water, do so about once a month.