The 52-year-old entrepreneur wore a black T-shirt, distressed jeans, and gray sneakers as he removed his wedding ring in his first public sighting since the split