An Efficient Adversarial Learning Strategy for Constructing Robust Classification Boundaries^*

Wei Liu¹, Sanjay Chawla², James Bailey¹, Christopher Leckie¹, and Kotagiri Ramamohanarao¹

¹Dept of Computing and Information Systems, The University of Melbourne, Australia
wei.liu@unimelb.edu.au

²School of Information Technologies, The University of Sydney, Australia

Abstract. Traditional classification methods assume that the training and the test data arise from the same underlying distribution. However in some adversarial settings, the test set can be deliberately constructed in order to increase the error rates of a classifier. A prominent example is email spam where words are transformed to avoid word-based features embedded in a spam filter. Recent research has modeled interactions between a data miner and an adversary as a sequential Stackelberg game, and solved its Nash equilibrium to build classifiers that are more robust to subsequent manipulations on training data sets. However in this paper we argue that the iterative algorithm used in the Stackelberg game, which solves an optimization problem at each step of play, is sufficient but not necessary for achieving Nash equilibria in classification problems. Instead, we propose a method that transforms singular vectors of a training data matrix to simulate manipulations by an adversary, and from that perspective a Nash equilibrium can be obtained by solving a novel optimization problem only once. We show that compared with the iterative algorithm used in recent literature, our one-step game significantly reduces computing time while still being able to produce good Nash equilibria results.

^*This research was partially funded by Australia Research Council Discovery Grants (DP110102621 and DP0881537).

LNAI 7691, p. 649 ff.

Full article in PDF | BibTeX

lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012