Oddly enough, a test like this was done recently in Japan (I've spent the last hour looking for the link but for the life of me I can't find it). If I remember correctly, they took ten members of a professional orchestra, sat them down in an acoustically treated room and played two versions of the same piece. They were asked to identify which version was a real and which was sampled. Wouldn't you know it? They all chose incorrectly.
Actually, the test proctors pulled a fast one on their subjects. Both versions were sampled. But they were sampled by two different skilled MIDIstrators, if you will. They never mentioned which libraries were used only saying that they were top of line, the best money could buy from the most professional manufacturers in the business. I think it's safe to assume that VSL libraries were used to some extent.
Now some flaws that I see with this test, right off the bat, are that they limited their test subjects to musicians who play in an orchestra. I know a flautist who plays in a professional orchestra and she's never even heard of sample libraries. So if she were to hear a sampled piece programmed by the great Guy Bacos, she probably wouldn't know the difference either. Why didn't they use composers who work with samples for a living? Also, why trick the subjects by using two sampled versions? Why not use a real one?
@Aerovons
You’re right. Most people who do this for a living would be able to tell the difference but that doesn’t necessarily make a live piece sound better than a sampled one does it? (I think that’s the point William was trying to make) Maybe it’s all a matter of taste. I’ve said this on this forum before and I’ll say it again, there are just times when sampled performances sound better than the real thing. Ask yourself, what is it about sampled performances that give them away? For me, it’s the fact that samples just sound so pristine and clean. There are times when that’s what I want in my sound, so samples are a godsend. I agree with William in that we are at the point where it’s nearly impossible for the AVERAGE JOE (not professionals) to tell the difference between real and fake and if the average Joe comes away remembering my little melodies then who cares whether the orchestra’s real or fake.
I think we composers think within the realms of the orchestral box too much as well. How many of you guys run your string or brass samples through various guitar amps and then put a car horn impulse verb on it? It makes a pretty interesting color. How many of you have over three hundred players in your Double Bass section as a standard? There are an infinite number of things you can do with samples that would either be too cumbersome or too expensive with a real orchestra.
I think of samples as another means to an end and not as an artificial means that approximates a real orchestra end. If the real deal is what you want and you have it at your disposal and you restrict yourself to that orchestral box then more power to you. If I had a real orchestra at my disposal I’d probably be looking for ways to make them sound like a fake sampled one. But that’s just me. Again, I guess it’s all just a matter of taste.