Does this divergence necessitate new testing methodologies? How can such methodologies appropriately be evolved, and to what extent can AMTSO successfully play a part? The claimed divergence in anti-malware technologies, and mindsets, across the spectrum of mainstream and newer vendors. A new generation of conflicts between vendors and testers.VirusTotal's re-engineering of its policies, and the impact on AMTSO of the subsequent semi-assimilation of self-named 'next-gen' vendors into its membership.The painful evolution of AMTSO into a source of testing guidelines and, somewhat less reliably, mediation between the opposed yet interdependent testing and vendor communities.The good, the bad and the ugly in early product testing, and the slow-burn reaction of the security industry, culminating in the 'International Antivirus Testing Workshop' and the first steps towards the foundation of AMTSO.In this paper, we re-examine those assumptions, set in the context of: Have so many of the assumptions made on both sides of the vendor/tester divide been wrong all along? Or is this just another instance of The (Testing) World Turned Upside Down by marketing? Promotion of D-I-Y testing as superior to independent testing.Opaque sourcing, selection, classification and validation of samples.Simulation as a comparative testing tool.Disabling of layers of functionality and the demotion of whole product testing.Yet we've recently seen a resurgence in approaches to comparative testing that have long been flagged with a red light: We often hear that anti-virus is dead, but if that is really so, where does it leave anti-malware product testing?Īfter decades of slow progress, security product testing has been moving away from the chaotic practices of the early 90s, to models of better practice as to some extent codified in the AMTSO 'Fundamental Principles of Testing'.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |