The singer, who recently raised eyebrows with her latest album cover's artwork, arrived at riverside venue Spindler & Klatt on a boat