The striker pounced two minutes from time to make it 4-4 in another amazing encounter at the Lane.
But we led 3-1 at the break before Foxes hit back to lead 4-3 with ex-Spurs Les Ferdinand and Ben Thatcher on target.
Jermain said: "I'm devastated, we should have won the game. I thought we were the better side throughout. In the first half we played really well but we let them get back in and it's really disappointing."
His strike parter Robbie Keane was also on the scoresheet alongside midfielder Michael Brown.
Robbie reflected: "We need to analyse it and work on it on the training pitch, not just the people at the back but as a team.
"As a team we can do better. We are conceding too many goals."
Jermain Defoe admitted he was 'devastated' despite bagging a double including a late equaliser against Leicester City yesterday.