Nunez paced back and forth behind Flannery as he placed his hands on his head while jokingly saying, 'I hate this game'