Firewall vendors challenge findings of NSS Labs report

Firewall vendors take exception to claims by NSS Labs that their firewalls can't guard against a common TCP attack.

Apparently, NSS Labs struck a nerve. NSS Labs revealed that almost all of the firewalls it tested for a recent report are susceptible to crash or compromise using common attacks. The firewall vendors in question, though, beg to differ and take exception to the claims made by NSS Labs.

The main point of contention seems to be the assertion by NSS Labs that five of the six firewalls tested can not protect the network against a TCP Split Handshake spoof attack (a.k.a. Sneak ACK attack). Both SonicWALL and Fortinet contacted me to refute the claims made by NSS Labs, yet when asked about the dispute NSS Labs said that it stands behind its findings 100 percent.

Jock Breitwieser, director of PR at SonicWALL, emailed me to explain that, contrary to the NSS Labs report, its firewall does provide protection against the TCP Split Handshake attack, and has since SonicOS 3.0 was released in 2004. It's just not enabled by default.

SonicWALL claims that it stressed to NSS Labs that this feature must be enabled to get an accurate result for SonicWALL's effectiveness against the TCP Split Handshake spoof, but NSS Labs chose not to do so. Breitwieser also has an issue with NSS Labs' claim that enabling the feature results in a performance impact on the firewall.

Meanwhile, Patrick Bedwell, VP of product marketing for Fortinet, also emailed me to address misconceptions Fortinet feels are propagated by the NSS Labs report. Bedwell explained that the Fortinet firewall tested by NSS Labs was supplied by a customer rather than being configured by Fortinet specifically for the NSS Labs tests.

Like SonicWALL, Fortinet also asserts that its firewall can successfully defend against a TCP Split Handshake attack. However, Fortinet's approach involves the integration of AV and IPS elements rather than just flipping a switch in the firewall configuration.

Bedwell stated, "We feel strongly that integrated protection is the best approach for blocking this issue, as customers that have IPS working with their firewall are better protected against a wider range of threats." He also clarified that the majority of Fortinet customers rely on the combined protection of the integrated whole rather than the firewall alone.

Still, Fortinet developed an IPS signature designed to explicitly block the TCP Split Handshake attack as a temporary protective measure, and it is in the process of developing a firmware upgrade that will prevent the spoof attack even on the standalone firewall.

In response to the claims from the firewall vendors, an NSS Labs spokesperson responded, "We've clarified our remediation brief to show that both Juniper and Sonicwall have protection, but it's not on by default."

NSS Labs has some issues of its own, though, with claims made in a Fortinet blog post regarding the NSS Labs testing. NSS Labs says that Fortinet was invited to participate in the testing process, but chose not to. NSS Labs did use a Fortinet firewall from a customer, but that the firewall had been configured by Fortinet for the customer using default settings. Since that is the way customers likely have the firewall configured in the real-world, NSS Labs chose to test based on that configuration.

Finally, the NSS Labs spokesperson told me, "[Fortinet's] arguments about IPS and AV show they don't understand the attack. Those technologies do not address the TCP issue, period."

Obviously, there is some disagreement between NSS Labs and the firewall vendors -- particularly Fortinet -- over the standalone firewall vs. a more holistic, integrated network defense. In NSS Labs defense, though, it was a firewall test specifically, so it seems fair to limit the results based on what the firewall alone is capable of.

Join the Good Gear Guide newsletter!

Error: Please check your email address.

Tags hackersfirewallsNSS LabsFortinetsecuritymobile securitywireless securitymalware

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Tony Bradley

PC World (US online)
Show Comments

Essentials

Microsoft L5V-00027 Sculpt Ergonomic Keyboard Desktop

Learn more >

Lexar® JumpDrive® S57 USB 3.0 flash drive

Learn more >

Mobile

Lexar® JumpDrive® S45 USB 3.0 flash drive 

Learn more >

Exec

HD Pan/Tilt Wi-Fi Camera with Night Vision NC450

Learn more >

Lexar® JumpDrive® C20c USB Type-C flash drive 

Learn more >

Audio-Technica ATH-ANC70 Noise Cancelling Headphones

Learn more >

Lexar® Professional 1800x microSDHC™/microSDXC™ UHS-II cards 

Learn more >

Budget

Back To Business Guide

Click for more ›

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?