VB100 update

Post-test analysis corrects results for MS Forefront, CA.

In the wake of the mammoth VB100 comparative released earlier this week, the lab team have been conducting thorough reviews of the results in collaboration with product developers. Having performed checks and retests on several products whose results have been questioned, it was found that two products were incorrectly labelled as having had problems.

After close analysis, it was spotted that Microsoft's corporate solution Microsoft Forefront Client Security was not run with the default settings, as per the standard procedures of the VB100. When tests were rerun in the correct manner the product was found fully capable of detecting all samples on the official WildList, and a VB100 award is thus awarded to the product retrospectively. Detection scores in the trojan and RAP sets were also affected by the adjustment, and new scores will be calculated and added to the online records and charts as soon as possible.

In a second issue, re-analysis of a false positive alerted on by CA's consumer product CA Internet Security Suite Plus 2010 was also carried out, and it was found that while the false positive existed in the installer submitted by the company, it was no longer present in the updated definition set also included in the submission. As users would be updated to the fixed protection level prior to running any scans, the issue should not emerge in the real world. As the product is confirmed to have also had problems in the WildList set, this will not affect qualification for a VB100 award, but the product's scores from this month's test will no longer be excluded from the four-month RAP aggregate graphs.

Virus Bulletin extends its apologies to the companies concerned. As always VB continues to strive for excellence in its testing and makes every effort to correct any inaccurate data as rapidly as possible.

04 December 2009

Tags: CA, Forefront, Microsoft, VB100, testing. del.icio.us digg this