The word "vestiary" comes from Latin vestiarius. It started in Latin vestiarium. Then it appeared in Old French vestiarie.
vestry – A related word in the same word family.
Latin's grammatical structure influenced how English speakers think about verb tenses and cases.