Simon Cowell made sure he had his workout equipment in hand as he arrived at the America's Got Talent set in Pasadena, California on Wednesday