She shared an image of his new album, Music for People Who Believe in Love on her Instagram Stories earlier last month (Joe pictured in April)