Perilla mint is listed as toxic to cattle, sheep, and horses. If it is toxic to sheep, chances are good that it isn't good for goats, either.
Oops. So mowing it is not good enough... Time for chemical warfare. I have an e-mail out to my vet asking what herbicides work on horsemint that won't hurt the animals.