Fans have expressed concern after Keith Urban skipped a family holiday with his wife Nicole Kidman and their children