Celebrity guests will join Clarkson, with the Jonas Brothers appearing on the first episode (pictured), followed in subsequent weeks by Gloria Estefan, Teddy Swims and Lizzo