He also stated he was perplexed by Lively's decision to not go after his channel, but maintained he wasn't 'easily scared'