The duo previously cancelled two shows back in February because Martin got COVID after attending the Saturday Night Live 50th Anniversary special (pictured)