I've had experience with a small animal farming self provisioning situation.
I did buy a lot of prepared food for them, and learned that the best diet resulted in the most healthy animal.
We had goats, and only for their milk. We kept our 'herd' small by selling off the kids and replacing as needed. Had 'em more than 10 yrs...
They' re friendly if skittish and sensitive creatures and as with most lactating animals, perform best with regularity.
I built a small 'goat barn' with space for hay storage and a milk stand, grain storage and lots of open airflow...I live in FL.
The animals themselves do require a bit of maintenance. Hooves should be trimmed rather than allowed to grow over to the point of hobbling the animal. If they're on rough surfaces, they tend to take care of themselves.
Horn buds. I learned to burn off those things. It was not fun.
My late ex-wife did the milking most of the time..she was the main proponent initially for the goats...my hands allowed me to use about 2 fingers...and of course, if I milked, it was not their routine so I didn't get them to let as much down.
I guess if you don't want the milk, you don't have to feed them as good.
One thing about the smell and taste is that if you don't keep a stinking old billy goat on your premises, you won't get that taste. Also...diet.
We had Nubians...they're not the most productive, but their milk fat content is highest...the milk tasted fantastic.