News of the birth was confirmed over the weekend when Paul shared a series of tender family photos with Instagram followers