But he'll do exactly that when he returns to his first home for our Premiership clash against Charlton Athletic on Monday.
Luke played 76 games for us between 1998-2001 having joined us as a trainee in 1995 before leaving for the Valley in the summer. Now, having played against us back in December, he runs out at the Lane for the first time as a Charlton player.
"It will be strange I suppose," he said. "But then again, there have been a lot of changes at the club even since I left.
"It will certainly be a different experience but I'm looking forward to it. In fact, I've been looking forward to it for a long time and I'll try to enjoy it.
"It was strange the first time I played against Spurs at the Valley earlier in the season but you have to be professional about it.
"I've nothing but great memories from my time at Spurs and I can't wait for Monday."
Luke has firmly established himself in Alan Curbishley's plans this season - playing 30 games already. "The move has worked out well," he added.
"I wanted to play first team football week in, week out and I've got that opportunity. I also wanted to play right-back and that's been the case as well.
"It's gone well. It took a couple of months to settle down but we've done well, especially against the London teams. We're unbeaten in 11 derbies now and hopefully we'll make it 12 on Monday."
Luke Young admits it will be a strange feeling to walk into the visitors' dressing room at the Lane on Monday.