Jennifer Garner, 52, looked casually chic on Sunday in Los Angeles, wearing a white and gold striped golf shirt with a pair of high waist white pants