The midfielder appeared to get through the encounter unscathed after a month on the sidelines with an ankle injury.
But that was just about as far as the good news went as Charlton first capitalised on a couple of defensive lapses and then had the game just about handed to them as Rodrigo Defendi was sent off after giving away a penalty at the start of the second half.
It was an eventful night for Defendi having opened the scoring with his second goal in as many games as we started well against the league leaders.
Philip Ifil was the star of the first half with a succession of crosses from the right and it was no surprise when one hit the target in the 17th minute as Defendi glanced home from 10 yards.
Simon Royce did well to flick a certain tap in away from Eddie Silva Sousa minutes later and it took Charlton until the 28th minute to trouble Marton Fulop, Paul Konchesky's curler no trouble.
However, the visitors got more into the game towards the end of the first half and levelled in spectacular fashion when we failed to clear Jerome Thomas' cross and Lloyd Sam volleyed home from 12 yards.
Charlton grabbed the lead with another somewhat disappointing goal from our perspective as Thomas latched onto Konchesky's long pass, skipped around Fulop caught in no man's land and tapped home.
The game ended as a contest three minutes in the second half. Paul O'Donoghue's attempted back pass clipped Defendi and fell into the path of Varney. He raced into the box, Defendi got back to make a clumsy challenge and while a penalty was never really in doubt, a red card was perhaps a little harsh on the Brazilian. Konchesky made no mistake from the spot and it was 3-1 down, 10 men and an uphill task.
To the lads credit, they weren't breached again although they had to thank Fulop for three fine saves, the best to deny Varney from 10 yards in the 58th minute.
Try as we might, we couldn't create another chance and the closest either side came to adding to the score was when Walker hit the top of the crossbar with Fulop finally beaten four minutes from time.
MINUTE BY MINUTE
14mins: Superb cross from Ifil inches away from Silva Sousa and Barnard and scrambled away.
17mins: Another great cross from Ifil this time gets just reward as Defendi glances header past Royce. 1-0.
22mins: SAVE. Royce spilled tricky free-kick from Marney but up quickly to flick ball away from Silva Sousa in front of goal.
28mins: Konchesky 25-yard curling free-kick comfortable enough for Fulop.
31mins: CHANCE. Charlton's first real chance - Walker one-two with Sam and into box with only Fulop to beat but slid ball wide.
35mins: Ifil heavily involved again, took pass well from Richards, cut in from right and drove just over from 22 yards.
38mins: GOAL. Thomas cross only half-cleared to allow Sam to spin and volley home spectacularly in one movement from 12 yards. 1-1.
44mins: GOAL. Thomas latched onto Konchesky's ball over the top, Fulop out to meet him but ended up selling himself and Thomas rolled into empty net. 1-2.
45mins: Brown yard of space in box, low shot deflected into side-netting.
Half-time: Spurs 1, Charlton 2
48mins: PENALTY/RED CARD/GOAL. O'Donoghue's attempted back pass hit Defendi and fell into path of Varney who was clean through on goal. Defendi got back, the pair went over, the referee awarded a penalty and sent Defendi off. Konchesky sent Fulop wrong way from spot. 1-3.
54mins: Brown's 30-yard rasper straight at Royce.
56mins: SAVE. Fulop flying save to his left to push away Varney's drive.
58mins: SAVE. Fulop denied Varney again, this time better reaction save to his left to touch effort wide from 10 yards.
68mins: Yeates injected yard of pace into attack, skipped past one challenge before striking just wide.
85mins: Long rifled drive in from 25 yards but Fulop up to test, palming away at full stretch low to his right.
86mins: WOODWORK. Walker hit top of crossbar with dipper from 18 yards.
Spurs: Fulop, Ifil, McKie, Brown (Hughes, 77), Richards (O'Donoghue, 45), Defendi, Marney (Yeates, 60), Carrick, Barnard, Silva Sousa, Dilevski. Subs: Burch, O'Hara.
Charlton: Royce, Fuller, Koncesky, Long (Thanda, 88), Ricketts, Fish, Sam, McCafferty, Walker, Varney (Wilson, 77), Thomas. Subs: Gross, Elliot, Phillips.
Michael Carrick completed the full 90 minutes as our reserves lost 3-1 to high-flying Charlton in the FA Premier Reserve League at Stevenage on Monday night.