A new era for VPN testing? ATMSO publishes the first-ever testing standards in an "important milestone"

A VPN running on a mobile device
(Image credit: Getty Images)

Leading cybersecurity company AMTSO has just unveiled its "first-ever" standards for VPN testing.

AMTSO, short for Anti-Malware Testing Standards Organization, is an NGO established in 2008 to improve the quality of anti-malware testing methods. On February 19, 2025, the experts published the VPN Performance Testing Guidelines to help enhance fair privacy and security for VPN assessments.

Regular security and privacy audits carried out by independent experts have become a common practice among the best VPN providers. Third-party audits are users' guarantee their VPN service does what it claims to be.

New VPN testing guidelines

The recent publication, developed by AMTSO's VPN working group, which includes VPN vendors and testers, is only the first in a series of VPN standard guidelines.

"This first release is an important milestone in our mission to provide testing guidance in the world of privacy and security," said John Hawes, COO of AMTSO. "By setting clear benchmarks, we enable fair comparisons and help users make informed choices when selecting a VPN provider."

AMTSO's VPN testing guidelines include key aspects that testers must check when assessing the software's performance.

These include launch on-boot and auto-connection testing to ensure VPNs activate automatically for maximum protection, kill switch tests to verify that no data leaks occur when the VPN connection drops, check whether VPNs effectively block DNS, IP, and WebRTC leaks, and split tunneling testing.

Did you know?

A hand holds a smartphone displaying the NordVPN logo

TechRadar's top pick NordVPN has recently proved its no-logs claims with a successful independent audit. It's then official – NordVPN never stored users' data. This was the fifth third-party audit of its privacy policy since 2018.

According to AMTSO's guidelines, testers should also evaluate how VPN services perform under different network conditions while measuring how well VPNs maintain access to websites.

Virtual private network (VPN) apps have become crucial tools for many people worldwide who want to regain control over their online privacy. A VPN encrypts all users' connections to avoid third-party access and spoofs their IP address to keep their online activities anonymous.

IP spoofing is also why increasingly more people are using streaming VPN services to keep up with their favorite shows while traveling.

Even more notably, VPN usage is soaring for the same reason among citizens living under a restricted internet environment as a censorship-resistant tool. As per ProtonVPN's latest data, 119 countries saw VPN usage spiking throughout 2024.

All this interest in VPN solutions makes it even more crucial to follow a standardized process when assessing these services.

AMTSO is now inviting independent testers and VPN vendors to adopt these guidelines. "Moving forward, the AMTSO VPN Working Group will expand its focus to include malware testing within VPN environments and additional security feature evaluations."

Chiara Castro
News Editor (Tech Software)

Chiara is a multimedia journalist committed to covering stories to help promote the rights and denounce the abuses of the digital side of life – wherever cybersecurity, markets, and politics tangle up. She writes news, interviews, and analysis on data privacy, online censorship, digital rights, cybercrime, and security software, with a special focus on VPNs, for TechRadar and TechRadar Pro. Got a story, tip-off, or something tech-interesting to say? Reach out to chiara.castro@futurenet.com

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.

Read more
A repeating pattern of pink magnifying glasses on a light blue background
Why do VPN audits matter?
NordVPN running on a desktop, mobile devices, Apple TV, a router and a game console
NordVPN reacts to results from its latest security audit
A VPN runs on a mobile phone placed on a laptop keyboard
The 3 biggest VPN innovations of 2024 – what does the future hold?
Screenshot of Obscura VPN website
Obscura VPN promises to “set the standard for the next-generation of VPNs”
Outlook Calendar on a Tablet
What we learned from VPNs in 2024
best Secure VPN
Secure VPN providers 2025: safe options for the best security and encryption
Latest in VPN Services
Proton VPN and Vivaldi partnership – promo image
Proton joins forces with Vivaldi browser to help you break free from Big Tech
A hand holds a smartphone displaying the NordVPN logo
NordVPN Prime hits lowest-ever price in VPN Spring sale
ExpressVPN mobile app and Aircove
ExpressVPN ‘reduces workforce’ for the second time in two years
Harry Halpin, CEO and co-founder of Nym Technologies, and Chelsea Manning, Nym Technlogies' security consultant, on stage at the Frontline Club in London during the NymVPN launch on March 13, 2025.
NymVPN is now live – here's everything you need to know
Green background featuring laptop with connect button
I tried the "world's most secure VPN" and while it's not the VPN you'll want, you'll need it sooner than you think
A representational concept of a social media network
Living in the US? You can now measure your online data exposure for free
Latest in News
Nintendo Switch 2 Joy-Con up-close from app store
Nintendo's new app gave us another look at the Switch 2, and there's something different with the Joy-Con
cheap Nintendo Switch game deals sales
Nintendo didn't anticipate that Mario Kart 8 Deluxe was 'going to be the juggernaut' for the Nintendo Switch when it was ported to the console, according to former employees
Three angles of the Apple MacBook Air 15-inch M4 laptop above a desk
Apple MacBook Air 15-inch (M4) review roundup – should you buy Apple's new lightweight laptop?
Witchbrook
Witchbrook, the life-sim I've been waiting years for, finally has a release window and it's sooner than you think
Amazon Echo Smart Speaker
Amazon is experimenting with renaming Echo speakers to Alexa speakers, and it's about time
Shigeru Miyamoto presents Nintendo Today app
Nintendo Today smartphone app is out now on iOS and Android devices – and here's what it does