Well I think u already know that he is expecting to do smth sexual. If you think it's way too soon or it isn't the type of relationship u want, don't go. But if that's what u want from him too, go and have fun. But from the way I see it, that's not what u expected and also not what you're looking for in a relationship. If so you're gonna regret it ......
