论文标题

实时企业网络SAD-F:SPARK基于异常检测框架的智能且时间效率的DDOS标识框架

An Intelligent and Time-Efficient DDoS Identification Framework for Real-Time Enterprise Networks SAD-F: Spark Based Anomaly Detection Framework

论文作者

Ahmed, Awais, Hameed, Sufian, Rafi, Muhammad, Mirza, Qublai Khan Ali

论文摘要

异常检测是防止网络中恶意活动并一直为合法用户提供资源的关键步骤。从各种研究中注意到,经典异常检测器与小型和采样的数据很好地工作,但是故障的机会随实时(未采样的数据)流量数据而增加。在本文中,我们将使用不同的机器学习技术探索用于DDOS异常检测的安全分析技术。在本文中,我们提出了一种新颖的方法,该方法将实际流量作为系统的输入。此外,我们研究并比较了我们提出的框架在三个不同的测试床上的性能因素,包括普通商品硬件,低端系统和高端系统。测试床的硬件详细信息在各个部分中讨论。此外,在本文中,我们研究了分类器在(接近)实时检测异常攻击中的性能。这项研究还集中在特征选择过程中,这对于异常检测过程与对一般建模问题一样重要。已经研究了几种技术以进行功能选择,并且观察到适当的功能选择可以在模型的执行时间上提高性能 - 这完全取决于流量文件或流量捕获过程。

Anomaly detection is a crucial step for preventing malicious activities in the network and keeping resources available all the time for legitimate users. It is noticed from various studies that classical anomaly detectors work well with small and sampled data, but the chances of failures increase with real-time (non-sampled data) traffic data. In this paper, we will be exploring security analytic techniques for DDoS anomaly detection using different machine learning techniques. In this paper, we are proposing a novel approach which deals with real traffic as input to the system. Further, we study and compare the performance factor of our proposed framework on three different testbeds including normal commodity hardware, low-end system, and high-end system. Hardware details of testbeds are discussed in the respective section. Further in this paper, we investigate the performance of the classifiers in (near) real-time detection of anomalies attacks. This study also focused on the feature selection process that is as important for the anomaly detection process as it is for general modeling problems. Several techniques have been studied for feature selection and it is observed that proper feature selection can increase performance in terms of model's execution time - which totally depends upon the traffic file or traffic capturing process.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源