Caterpillars on Dutchman pipe vine
What should I do? Remove the caterpillars by hand?
See if you can make an identification, these could very well be the Pipevine Swallowtail caterpillar.
These Caterpillar don't generally harm the host plant, so they can stay!
Here is a link with more information.