Q.overwintering dipladenia
I have a dipladenia that I bought this summer and plan on overwintering indoors (zone 7). There are some very small bugs on the tips, yellow in color and I don’t really want to bring them indoors. What should I do to get rid of them before I bring it inside?

Those yellow bugs are probably oleander aphids. Here is an article that will give you ideas on how to contend with them - Horticultural soap sprays or neem oil work well for aphid control.:
https://www.gardeningknowhow.com/plant-problems/pests/insects/homemade-aphid-control.htm