Q.What kind of bug is this?
It’s small. Small enough where it can fit through a window screen. I found it near but not on one of my ficus. Should I spray? I have some insecticidal soap that contains Rosemary oil, peppermint oil, cedar oil and mineral oil. Or do you have a better recommendation?
I'm sorry, but I'm not able to identify your bug from this image.
If it's just this one bug, I would not worry.
Watch your plants for signs of insects and treat if necessary.
Neem Oil is a good choice.
https://www.gardeningknowhow.com/plant-problems/pests/pesticides/neem-oil-uses.htm