The shadow England team surged into a 17-point lead with tries from Henry Trinder, Ugo Monye and James Simpson-Daniel but the Barbarians staged a comeback either side of the interval.
Tim Visser, George Smith and Joe Van Niekerk added to the first-half tries from Benoit Baby and Frederic Michalak as the Barbarians took control.
England thought they had escaped with the win with a late try from the Exeter flanker Tom Johnson, but the Barbarians sealed the victory with a second effort from Visser.
Lancaster said: "I was proud of our performance in terms of the inexperience of our side in relation to theirs. We put ourselves in a position at 32-31 where we could have won it.
"I guess at the end their experience and quality told.
"As a lead into the Churchill Cup and for players to get the experience of playing at Twickenham and benchmark themselves against World Cup players, it is valuable."
England team manager Martin Johnson was left frowning in the stands as a handful of World Cup contenders failed to make the most of their chances.
Monye limped off while Simpson-Daniel, having enhanced his credentials with a sparkling try, blotted his copybook by allowing Visser to score his first.
"Ugo has got an MCL (medial collateral ligament) strain. He will be assessed in the morning but it doesn't look too while Matt Banahan has a soft tissue injury," said Lancaster.
"(Joe) Marler has a mild concussion. It wasn't spinal. That is the protocol to get him off field."
On the positive side, captain Luke Narraway had a hand in the tries scored by Trinder and Simpson-Daniel and will be pressing for a place in England's World Cup training squad.
Banahan enjoyed a confident trial run at inside centre, his different third position in an England jersey this season, and he seems certain to travel to New Zealand as a utility back.
"I tried to play to the best of my ability," said Narraway.
"If it is enough to make the World Cup training squad I'll be happy.
"This was a massive massive opportunity because some of those guys were going out there for the first time against world class opposition."
The England Saxons squad for the Churchill Cup will be named on Monday and is set to include a red rose return for Saracens prop Matt Stevens.
Jordan Crane and Andy Saull will be checked over after sustaining injuries in the Aviva Premiership while the likes of Banahan and Charlie Hodgson have been told to rest ahead of the World Cup build-up.
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The entire All Blacks apparel line has been updated for 2013/14. Check out the New Zealand All Blacks polo.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Gilbert Blitz 8S rugby cleat is a great cleat at a great price of $69.99. Get a new pair of cleats today.
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
The All Blacks Performance t-shirt is black with hints of blue from the training jersey. Very Cool.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.