Matthew Lewis admitted he was going to struggle to let go of his time as Neville, and see his character re-acted