I have been advised that my Alpaca aren't clified as livestock, rather pets.Could I keep them in my garden?

I have 2 alpaca that I keep with my horse in a paddock not far from my home. I would like to keep them for a while in my garden with my chickens (large garden), but I'm not sure if this is allowed. They're not livestock, so would the covenant that applies to the property restricting the keeping of livestock, apply to this and would anyone have the right to object?