Indeed, the Addicks have yet to lose at the Lane in the Premiership with two wins and three draws in five games.
To continue the trend between the two clubs, we've won three of our Premiership clashes - including the last two - and an FA Cup tie at The Valley in recent years.
Both teams go into the derby in patchy form - we've lost three successive league games while Charlton are without a win in five.
"We've always had difficult games against Charlton at White Hart Lane and we're expecting another one," said Ledley.
"They haven't had a great run and they'll be fighting for the points just like us.
"They will feel they can get a result here because of the way it's gone over the last couple of seasons and we'll have to be aware of that.
"We need to get back on track and it's important we get our confidence back before the games against Burnley and Arsenal. It's a game we need to win."
Ledley King has warned that Charlton will arrive with real belief on Saturday thanks to their recent record at White Hart Lane.