Certified GKH Gardening Expert
They are ready to be harvested when they are dry and brown. If you are worried about the cold damaging the seeds, you can harvest the pods green and then place them in a paper bag in a cool, dry place and they will dry there and be ready to harvest when the have turned brown in the bag.
You certainly want to gather them before they open. Here's a couple of articles that should help: