The midfielder failed to hit the net in a competitive game for Spurs in over four years at the club although he did register in a pre-season friendly at Stevenage.
He is now set to return with the Foxes in Sunday's televised Premiership clash.
Steffen said: "I would love to score for Leicester and win the game.
"But no, I wouldn't celebrate. That is out of respect for the club and supporters.
"I will try to score, no question. It would be a special moment for me but I know it would upset Spurs supporters!
"But the fans know I will give everything for Leicester now and I'm sure they will appreciate that. They know me well enough."
Check out THTV for our exclusive interview with Steffen - our video service has a free trial offer at the moment...CLICK HERE
Steffen Freund promised he wouldn't celebrate if he finally broke his goalscoring duck at the Lane for Leicester City on Sunday.