Both teams created a hatful of chances in the first hour and the home side managed to take one, Nigel Quashie's header five minutes into the second half securing the points.
We had all the chances after that but Paul Smith stood firm to deny Jermain Defoe and Fredi Kanoute just before the final whistle.
Here's what Head Coach Martin made of it all...
"I always know we'll create chances but we had a lot of chances and that was a surprise in an away game. We knew we hadn't done well at Southampton but that was in the past and I thought we would get the three points.
"We did well in the first 10 minutes but then we had a bit of a problem with Crouch and Camara. We regained our form in the second half but then gave away a silly goal, bad defending in the 18-yard box.
"I still thought we would get a draw. We had four or five chances after that, so it was a bit disappointing. We didn't put the ball in the net like we have at home and we have to work on that to kill teams off.
"After 75 minutes I was thinking it was going to be hard work but we still carved out a couple of chances and Fredi Kanoute went one-on-one with the keeper. Perhaps it wasn't our day.
"Credit to Southampton though, they played well and they've only lost twice at home all season, so they obviously have something at home.
"The big disappointment is that we would have gone sixth if we won and to lose it was a bit of a setback.
"We have to go on and hopefully we can learn from it."
Back at Spurs Lodge on Monday, Martin Jol took a more reflective look at Saturday's encounter against Southampton at St Mary's.