Rogan's criticisms of Trump come after he had the president on his show in the run-up to the election; seen over the weekend