Wilkins and Patel's 19-year age-gap has been the center of some attacks that have accused the country music artist of being a foreign spy 'honeypot'