I've never heard anyone describe someones scent this way during sex. Milk always seems slightly sweet to me, so maybe that's what he meant.
