The central defender was selected to start the friendly in Stockholm and at 20 years, 321 days, became the third-youngest Spurs player to earn a full England cap behind Aaron Lennon (19 years, 48 days) and Jimmy Dimmock (20 years, 125 days).
However, when Steven converted Steven Gerrard's free-kick to hand the Three Lions a 2-1 lead in the 38th minute, he became the youngest Spur to score in a full England international, beating Jermain Defoe's record of 21 years, 337 days.
Steven performed well up against Zlatan Ibrahimovic and Udinese's Mathias Ranegie at the official opening of the new Friends Stadium.
Ibrahimovic opened the scoring with a slice of fortune as Steven blocked his initial shot in front of goal, but the Paris St Germain star poked home the loose ball.
Danny Welbeck and then Steven's close-range effort saw Roy Hodgson's men 2-1 up at half-time and England looked in control at the start of the second half.
Steven departed with the score still at 2-1 in the 74th minute, replaced by Stoke's Ryan Shawcross.
Tom Huddlestone also entered the fray at that point for his fourth cap and first since May, 2010 in place of skipper Gerrard, who earned his 100th cap on the night.
Ibrahimovic then took over.
He vollyed home the equaliser on 77 minutes, drilled in a free-kick from 30 yards for 3-2 on 84 and then capped the lot with one of the best international goals of recent years, an overhead kick from fully 30 yards after Joe Hart had raced out of his area to head the ball clear.