Q.I’m Wondering What Type Of Bug Is On My Sweet Potato Plant & How To Deal With It?
I was thinking of making soap/water solution, but I don’t know how much of each.

Certified GKH Gardening Expert
That looks like a response to overly wet soil. They will exude a sort of "sap". You can prune these leaves off, as they will remain unsightly.
I would hold off on the watering until the soil is dry, almost, halfway down the pot. They are very drought tolerant. Try and increase the temperature around them, also, if possible. They tend to do better when it is hot.
Here is an article that will help you care for sweet potatoes:
https://www.gardeningknowhow.com/edible/vegetables/sweet-potato/sweet-potato-container-crops.htm