Certified GKH Gardening Expert
As long as you live within zone 8 or above, which you should be in Southeaster GA, then you can plant these in mid to late Spring, after any threat of cold weather. You can plant in early Autumn, but that can lead to a failed transplant if it gets too chilly too fast.
They are tolerant of many soil types, so it isn't really all that important, unless a soil test tells you that you are lacking in nutrients.
This article will help you care for these trees: https://www.gardeningknowhow.com/ornamental/shrubs/osmanthus/tea-olive-cultivation.htm