While on the course, onlookers were heard shouting how 'terrible' Brooklyn was to him and that he had 'no talent'