It comes after Brooklyn appeared to publicly fail to acknowledge Father's Day, despite his parents publicly reaching out (David is pictured with his family at his birthday celebrations)