I wonder if he also goes back to the present if he looks at her and thats why he said that she kept getting in his way. Just an outlandish theory tho *shrug*
