Joe and Caitlin were accompanied on holiday by his beloved chihuahua Bubbles, whom he adopted in 2019 when she was abandoned and suffering from cancer