How do I get rid of these with out harming my plant?
Bugs Eating the Leaves of My Gardenia
Certified GKH Gardening Expert
If you suspect insect infestation there are many ways to deal with it. Neem oil, and rosemary oil are both very good means to keep pests away. This link leads to a collection of articles that will give you many more options on how to control pests, naturally: https://www.gardeningknowhow.com/special/organic/