What's your question? Ask

I would wait it out and prune only if necessary and then only prune when it is dormant.

https://www.gardeningknowhow.com/ornamental/shrubs/holly/growing-yaupon-holly.htm

From your description this could be weather related or fungal infection.

Plants generally can recover from winter damage.
Fungal infections are quite common in damp spring weather but can attack plants at any time of year.
Left untreated the infections spread and the leaves turn black and drop off the plant.
A broad spectrum fungicide can be applied to the point of running off the plant.
Application can be once a week until the fungus is under control.

Here are some more articles that will help you.

https://www.gardeningknowhow.com/ornamental/shrubs/holly/growing-yaupon-holly.htm
http://www.clemson.edu/extension/hgic/pests/plant_pests/shrubs/hgic2055.html
https://www.gardeningknowhow.com/ornamental/shrubs/holly/diseases-of-holly-bushes-pests-and-diseases-damaging-holly-bushes.htm
https://www.gardeningknowhow.com/ornamental/shrubs/holly/holly-problems-holly-leaf-spot-or-holly-tar-spot.htm
https://www.gardeningknowhow.com/ornamental/shrubs/holly/leaf-scorching-in-holly.htm
https://www.gardeningknowhow.com/ornamental/shrubs/holly/holly-yellow-leaves.htm

Hand pulling the unwanted seedlings is the only safe way to remove them.

This could very well be bacterial or fungal in nature. Here is a remedy that I like to use, and recommend.

First, you will want to prime the ground with dolomitic lime, then spread wettable sulfur to Kill off any infection in the soil. I Also like to spray the plant itself. Mix a few drops of one or more of these ingredients into warm water with a spoonful of coconut oil: Rosemary oil, lavender oil, neem oil, garlic oil, cinnamon extract/oil and for really bad cases, also add clove oil.

I would suggest taking a soil sample to your local extension. They can tell you what is going on, but I'm going to guess that the soil is somewhat salty. This can cause nutrient lockout. Usually these don't need a large amount of fertilizer, so I don't really think it needs food. This leaves me to believe that the soil isn't the proper environment for this shrub.

This link will help you to find the nearest extension service to you: https://www.gardeningknowhow.com/extension-search/

This choice will be much better than the ficus. There will be, virtually, no chance of the roots becoming invasive enough to cause damage to structures, although removing these shrubs after some time will prove difficult. Once they are established, they will stay in an area, even once pulled up.

This article will give you more information on the care of these shrubs: https://www.gardeningknowhow.com/ornamental/shrubs/holly/growing-yaupon-holly.htm