Yeah, he was indeed use your handkerchief because it is expensive and the fabric is soft. He's not flirting on you at all (=・ω・=)