Skip to main navigation Skip to search Skip to main content

Iterative Boolean combination of classifiers in the ROC space: An application to anomaly detection with HMMs

  • École de technologie supérieure
  • University of Ottawa

Research output: Contribution to journal › Journal Article › peer-review

100 Citations (Scopus)

Abstract

Hidden Markov models (HMMs) have been shown to provide a high level performance for detecting anomalies in sequences of system calls to the operating system kernel. Using Boolean conjunction and disjunction functions to combine the responses of multiple HMMs in the ROC space may significantly improve performance over a "single best" HMM. However, these techniques assume that the classifiers are conditional independent, and their of ROC curves are convex. These assumptions are violated in most real-world applications, especially when classifiers are designed using limited and imbalanced training data. In this paper, the iterative Boolean combination (IBC) technique is proposed for efficient fusion of the responses from multiple classifiers in the ROC space. It applies all Boolean functions to combine the ROC curves corresponding to multiple classifiers, requires no prior assumptions, and its time complexity is linear with the number of classifiers. The results of computer simulations conducted on both synthetic and real-world host-based intrusion detection data indicate that the IBC of responses from multiple HMMs can achieve a significantly higher level of performance than the Boolean conjunction and disjunction combinations, especially when training data are limited and imbalanced. The proposed IBC is general in that it can be employed to combine diverse responses of any crisp or soft one- or two-class classifiers, and for wide range of application domains.

Original languageEnglish
Pages (from-to)2732-2752
Number of pages21
JournalPattern Recognition
Volume43
Issue number8
DOIs
Publication statusPublished - Aug 2010

Keywords

  • Anomaly detection
  • Combination of classifiers
  • Computer and network security
  • Hidden Markov models
  • Limited and imbalanced data
  • Receiver operating characteristics

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Iterative Boolean combination of classifiers in the ROC space: An application to anomaly detection with HMMs'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this