Adverse possession is losing legal right to the property, pretty hard to get here in Utah. However, if you have had demonstrated use of the property for at least 20 years, you may have created a Prescriptive Easement. Meaning, even if it is indeed his property, he can’t keep you from using it...