Why are my bell peppers falling off when they are the size of a hat pin? My plants have been in the ground about six weeks. Plants are about 20 inches tall. They bloom, but as soon as the peppers set, they turn yellow and fall off. My Jalapeno plants are full of peppers. This is happening with my green, yellow, and red bells. I have over 80 tomatoes on 9 plants.