search menu icon-carat-right cmu-wordmark

CERT Coordination Center

Cylance Antivirus Products Susceptible to Concatenation Bypass

Vulnerability Note VU#489481

Original Release Date: 2019-08-01 | Last Revised: 2019-08-01

Overview

The Cylance AI-based antivirus product, prior to July 21, 2019, contains flaws that allow an adversary to craft malicious files that the AV product will likely mistake for benign files.

Description

Cylance PROTECT is an endpoint protection system. It contains an antivirus functionality that uses a machine learning algorithm (specifically, a neural network) to classify executables as malicious or benign. Security researchers isolated properties of the machine learning algorithm allowing them to change most known-malicious files in simple ways that cause the Cylance product to misclassify the file as benign. Several common malware families, such as Dridex, Gh0stRAT, and Zeus, were reported as successfully modified to bypass the Cylance product in this way. The success rate of the bypass is reported as approximately 85% of malicious files tested. Cylance reports a 50% bypass creation success rate based on internal testing. Either way, attacker effort to find a successful bypass would be low. Unsophisticated attackers can leverage this flaw to change any executable to which they have access; the defense evasion does not require rewriting the malware, just appending strings to it.

The specific attack reported by Skylight Cyber relies on a particular set of strings used by the Cylance product. Although Cylance used an ensemble model that made some uncommon model design choices to achieve a white-listing functionality, this over-reliance on specific details when classifying a file is an instance of a common weakness in machine learning algorithms. For a comprehensive discussion of attacks on machine learning systems, see Papernot N, McDaniel P, Sinha A, Wellman MP. SoK: Security and privacy in machine learning. IEEE EuroS&P 2018. Because this flaw is an instance of a broader category of weaknesses in machine learning algorithms, we do not expect an easy solution. Cylance describes their response as "three-fold: First, we have added anti-tampering controls to the parser in order to detect feature manipulation and prevent them from impacting the model score. Second, we have strengthened the model itself to detect when certain features become proportionally overweight. Lastly, we have removed the features in the model that were most susceptible to tampering." This patch should stop the specific keywords used by the Skylight Cyber researchers from allowing an attacker to bypass detection and increase attacker effort required to find similar bypass techniques.

However, the method described by the Skylight Cyber researchers to find and recover the features of the Cylance product is likely to enable the recovery of manipulable features from other security products that rely on machine learning. Although Cylance has removed features "most susceptible to tampering," our understanding of adversarial manipulation of machine learning classifiers in other domains suggests that the remaining features almost certainly provide adequate freedom for tampering. This inference is based on the structural similarity of the Cylance machine learning model (a neural network) to models that have been successfully deceived in the domains of, for example, facial recognition or visual recognition in self-driving cars. There is some evidence that deception remains relatively easy despite the structure of computer network traffic; we are unaware of public evidence as to whether file structure carries the same limitations. This environment is the context behind and likely driver of Cylance's statement that "AI and machine learning models are, by nature, living models. They are designed to evolve and do require periodic retraining and field servicing when appropriate."

Impact

An attacker can easily and significantly improve their malware's defense evasion against affected antivirus products. Unsophisticated attackers can leverage this flaw to change any executable to which they have access; the defense evasion does not require rewriting the malware, just appending strings to it.

Solution

Apply a patch
Cylance has issued and automatically deployed a patch. Affected products that have connected to Cylance's services since July 21, 2019, should have silently applied the patch.

Consider applying workarounds as well as the patch, because it is unclear whether or not this patch protects against all similar easy methods for forced misclassifications of malicious files.

System Deployers
Defense in depth is an applicable work around for host-based systems. For example, if a host is downloading a file, a network IDS, web proxy, or email server should be configured to provide an additional layer of detection.

Security Product Developers
For developers of security products, defense in depth is also the essence of the recommendation. Machine learning approaches will remain vulnerable to attacker manipulation. Continue to use other traditional methods of detection and prevention (signatures, rules, etc.) in addition to machine learning. Test your machine learning tool against known adversarial example generation tool kits, such as CleverHans, Foolbox, or the Adversarial Robustness Toolbox.

Vendor Information

489481
 
Affected   Unknown   Unaffected

Cylance

Updated:  July 31, 2019

Status

  Affected

Vendor Statement

Cylance was made aware of this vulnerability on July, 18th 2019. The vulnerability was fully remediated and the patch was automatically deployed to customers. Cylance values the work of security researchers who responsibly disclose vulnerabilities and move the industry forward. Thanks to these efforts Cylance products are continuously improved providing a more robust security solution to our customers.

Vendor Information

We are not aware of further vendor information regarding this vulnerability.

Vendor References


CVSS Metrics

Group Score Vector
Base 0 AV:--/AC:--/Au:--/C:--/I:--/A:--
Temporal 0 E:ND/RL:ND/RC:ND
Environmental 0 CDP:ND/TD:ND/CR:ND/IR:ND/AR:ND

References

Acknowledgements

Thanks to Skylight Cyber for publishing about this vulnerability on July 18, 2019.

The vulnerability was acknowledged and patched by Cylance on July 21, 2019.

This document was written by Jonathan Spring and Allen Householder.

Other Information

CVE IDs: None
Date Public: 2019-07-18
Date First Published: 2019-08-01
Date Last Updated: 2019-08-01 17:20 UTC
Document Revision: 12

Sponsored by the Department of Homeland Security Office of Cybersecurity and Communications.