They put on a very romantic public display of affection just shortly after the pair dropped clues that they were dating each other in their recent social posts this week