New stats out on av-comparatives

oma · Mar 22, 2009

New results of Feb 2009

To see the results, one needs to download the PDF file.
http://www.av-comparatives.org/comparativesreviews/main-tests/144

Stubby · Mar 22, 2009

Quite interesting. I've been using Avast for the longest time and if it wouldn't be for all those FPs, they may have made it into the 3-star awards!

LauraR · Mar 23, 2009

Interesting that symantec and mcafee got the highest award.

I use Avira and have not had many false positives in the time I've used it. (maybe 2-3 in the 2 years I've had it.)

DavidGP · Mar 23, 2009

No a bad test and result for many popular AVs, as many where over 90%, TBH the AV is only part of your PC security so personally I can live with some FPs and many that where found, really where likely to be found as they are files from other security apps, and we all know some conflict, likely hence the FPs when scanning packages from other security apps.

Whats striking in many FPs is that virtually all of them flag up Googles Packages!! Symantec while one of the 3* apps did have a glarning FP in OpenOffice, wasnt it them who highlighted Excel files a while back too, having end users delete an office application can cause more disruption in productivity than deleting and cripling an application like Zuma or GoogleToolbar, is not wonderful and maybe the tests should also factor in the level of seriousness some of the FPs are.

Think its a bit of a balencing act against Detection rates vs FPs vs Speed, while G-DATA scores well on Set B Detection rates in doing so it seems to have a high FP rate.

Personally McAfee's score should be lower to the 2* range as its high score here relies on you having an live internet connection so it can connect to Artemis, and we all know if you have malware, many of them disable your ability to connect to the net properly.

I will like Stubby, be sticking to Avast free as that with the other security applications and main one of safe surf and download, works for me, personally only had 2 FPs with Avast and with dat updates they where gone in a day or so, plus its positive over the other free favorite for me in AVG is that its rare for its updater to go wrong, whereas many have issues with AVGs update server.

But from the results, ESet Nod32, KAV and Symantec (would personally if going the Norton route go for the Gamer Edition and add your own Software FW over a all in one) are the best overalls. BUT as I mentioned personally best overall is the set of security tools and methods you use, if they keep you malware free then they score 100%.

wildwolf220 · Mar 23, 2009

Interesting debate over at the MRU on this to.
One teachers thoughts.

My Thoughts on Anti-Malware Comparison Testing

When I see all the many different so called tests of anti-malware products, all I see is a bunch of advertising. In addition to the fact that no two of these so called tests find the same results, I have some other concerns;

How does one who is testing take into account the fact that all of the variables involved as well as the tools themselves are in a perpetual state of flux? Any real testing takes a bit of time. Even before any test is published, the results will already be invalid. While BrandX is still working on a particular definition, BrandY has already done so. Yet the BrandX definition will be published the next day and possibly better developed than that of BrandY.

Any real benchmark of these tools must include the study of it's removal routines for each type of nasty currently in the wild. That alone is a daunting study. But without it, there is no value to the testing.

Most F/Ps (false positives) don't occur on a freshly installed system. Removing items falsely can and very often does cripple innocent components. How do you measure the probability of F/Ps?

A true benchmark of the detections must include a validating sampling of targets. Limiting the sampling does not represent a true test at all. I can make any tool look good by simply limiting the sampling for the test. In all of the testing that has been published by online magazines and other so called professionals, this limiting has caused every single one to have different results. This has also been used as a marketing strategy.

In addition to studying the detections and removals, what other features are offered by the tools? What proactive features exist and do they work as pitched? Almost every scanner advertises that it protects the system. Do they really?...to what degree?...how much of it is just bloat?

Should any testing done by those affiliated with a particular tool be considered viable? How does anyone reading a test result know if a test was done by someone who is affiliated or has interest in a particular tool?

I have yet to see a real viable comparison test/benchmark. IMO, the methodology to perform a real comparison does not exist. Also, I believe that 99% of the so called tests published to date are simply advertising ploys and have absolutely no truth to them. I believe the other 1% are just done by well meaning folk who just simply don't have the understanding or expertise required in order to perform such testing.

Ask yourself; Why doesn't any two published comparison testings report the same results?
Click to expand...

oma · Mar 23, 2009

While the report says that AVG turns up more FP than some others who scored higher, I've never had one sofar. *knock wood*

I think that the ability of AV's to remove malware is just as important (or even more so) as detecting them.

Senlis · Mar 23, 2009

what about active scanning. I see the on-demand scan results on the report, which for most anti-virus programs will score above 90% on. Active scanning is where the difficulty lies, as you will see detection rates from 30% to 70%.

Looking closer at the report, I see that this is an on-demand report. I recall this website releases active scanning reports, but they probably have not completed it yet.

Log in or Sign up

New stats out on av-comparatives

oma MajorGeek

Stubby R.I.P. (September 3, 1949 - January 26, 2011)

LauraR MajorGeeks Super-Duper Administrator Staff Member

DavidGP MajorGeeks Forum Administrator - Grand Pooh-Bah Staff Member

wildwolf220 Oracle of Doom

oma MajorGeek

Senlis Staff Sergeant