The difficulties follow the decision to change the Academy League system from Under-17 and Under-19 to just one Under-18 division.
That has meant more players in the squad, less continuity and, not surprisingly, a bit of a rollercoaster ride in terms of results.
Pat explained: "It's been tough because there hasn't been a set team in terms of 16 players with the lads who don't get a game with Jimmy Neighbour. That's how it's been over the years.
"I've ended up with 20 senior players and you want to keep everyone happy but it's impossible.
"You can only play one side and it's nice to have some continuity within that so boys get to know each other. That's what team play is all about.
"When you are chopping and changing, you sometimes don't get a feel.
"Having said all that, there have been plusses with Phil Ifil playing in the first team and Jamie O'Hara moving up to the reserves.
"But when it comes to the Youth Cup, it's difficult to get a shape and understanding although they gelled quite well when we played Forest.
"I just miss the continuity. This year is very much about looking at players - call it development."
Pat Holland believes this season so far has been one of the most difficult in almost 15 years of coaching youth teams at Spurs.