Jenner seemed to want to show Chalamet what he was missing. The two have not been seen together in about a month