Every Vendor Claims 99%. What Security Tests Really Measure | AV Comparatives

Every endpoint product on the market claims 99%-plus protection, and they're all telling the truth. That is exactly why independent testing exists. Thomas Uhlemann of AV-Comparatives, the Innsbruck lab that has spent two decades trying to make "does it work?" a question with a defensible answer, walks through what each test actually does, what it deliberately doesn't measure, and how to read a report without being led by a vendor's cherry-picked chart.Disclosure: Broadcom participates in AV-Comparatives testing. Thomas runs communications, not testing, and this conversation is about methodology. No results or placements are discussed.What's inside: why the Real-World Protection Test runs products at default settings, online and offline, with USB and web-borne attack paths; why certification demands zero false positives on common business software ("malware might break your productivity, false positives will"); how vendors try to buy detection rates with false positives and why bi-monthly testing exposes it; why the EDR Detection Validation test disables blocking to measure signal-to-noise, and why failing vendors are anonymized; how the EPR test folds downtime and man-hours into total cost of ownership and refuses to name a winner; and a defender's checklist for reading any test report, starting with the methodology, not the chart.Chapters00:00 – Why independent testing exists, and who AV-Comparatives is06:24 – Real-World Protection: default settings, online, offline, USB09:40 – Malware Protection and the zero-false-positive rule14:53 – How vendors try to game tests, and why bi-monthly runs matter18:24 – EDR Detection Validation: signal-to-noise and anonymized vendors24:12 – EPR test: TCO, the quadrant, and why no winner is declared28:40 – How to read a report, and what tests can't measure34:21 – A defender checklist and healthy paranoia36:57 – AI in testing: faster, not newLinksAV-Comparatives: https://www.av-comparatives.orgMore episodes: https://www.youtube.com/@symantec/podcastsMore research and expert perspectives: https://www.security.comGuest: Thomas Uhlemann, Cybersecurity Evangelist, AV-Comparatives.Host: Dan Mellinger.SECURITY.COM The Podcast — In-depth intel. Real talk. Human factor.