no doubt i agree with you on the 4 samples issue,the funnier thing is,they were actually trying to be generous with 4 samples,since they used to use only 1 sample before.
Yeah...and we moan about youtube tests...usually they have about 15
but i disagree that results are redundant by the time they're released,especially if an av is consistent,multiple tests will give the consumer a good idea about a product.
even inconsistent results for a particular av will give a good idea of that av.
The problem for me is, that one detection is simply that, so it they are basically a snapshot of that specific moment in time. And in simply collecting all of your results, the conditions may have changed.
That is why I said initially that I thought they would be better if those that failed were re-tested until the detections are added. That would give a better idea of how the av tackles the newer malware. (i.e. How quick they pick it up, not do they detect it when we gat a sample in?)
i also disagree with the "real world" statement,since the real world probably differs greatly from 1 individual to another; thats where large scale testing holds value.
I would agree there that each user is different, but when you look at tests, all people care about is detection.
All other factors that would be thought about normally go out the window as far as I can tell. People seem to say "right well that one has the highest detection this week, I'll pick that one." (or they condemn their current av because it wasn't as quick to catch something as another one)
Without considering other things like whether there are multiple updates (which would theoretically help with the zero day stuff) or whether it is actually easy to use/set up.
If you can't actually use it, then how can you protect yourself from it.
btw scott,actually you (and others with knowledge and experience)are the right person to ask,because you actually have the ability to think independently,even though we may disagree on certain things.
Well, I think I may be a little biased against tests...I do try and look at both sides, and I can see the value that some people get from tests, but (repeating myself again
) it detracts from the actual use of the av.