Orlando Bloom joined Katy Perry and their daughter Daisy Dove, five, in Australia on Sunday amid rumors of trouble in their relationship