Elizabeth's son Damian, 23, previously gave his public seal of approval of their relationship by including Billy Ray in his Father's Day tribute